8. Ideate Features
FeatureByte provides two primary methods for feature creation:
- Manual Creation: Utilize the SDK declarative framework for complete control over the feature engineering process.
- Automatic Creation: Accelerate feature engineering through Feature Ideation an AI-powered, automated method that intelligently suggests relevant features for your use case.
How FeatureByte Ideates Features
Feature Ideation adopts an agentic approach that dynamically tailors feature generation to your use case. The process includes:
- Analyzing tables and relationships to identify relevant data.
- Inferring missing semantic tags based on column metadata.
- Recommending column transformations, such as time deltas, ratios, and differences.
- Identifying key filters to isolate critical events.
- Highlighting key columns for further feature engineering.
- Proposing appropriate aggregation time windows.
- Analyzing event frequency patterns to detect timing signals.
- Recommending and evaluating features for their semantic relevance.
- Promoting feature reuse by detecting duplicates in the Catalog.
- Conducting EDA on each feature and assigning an individual Predictive Score.
- Selecting the optimal feature set based on SHAP value analysis.
Every step is transparently documented to ensure full traceability.
Modes of Operation
Feature Ideation supports two modes:
- Fully automated mode: Executes the full workflow end-to-end with minimal user intervention.
- Semi-automated mode: Gives you control to configure ideation settings, review and refine results, and reuse insights from previous runs.
This tutorial focuses on the Semi-Automated Mode.
Tutorial Workflow
-
Initial Ideation: Run Feature Ideation on a single time window to identify the most informative columns in your dataset.
-
Refined Ideation: Use the outputs from the first run to prune uninformative columns, enable filter detection, and allow the system to automatically select optimal aggregation windows.
This two-step workflow reduces the number of ideated features in scenarios involving many tables and columns, while preserving accuracy by enabling a more targeted feature engineering process in the second step.
Note
If you want to learn how to manually create features, please consult our SDK tutorials.
Step 1: Select Your Use Case¶
-
Navigate to Feature Ideation from the 'Ideate' section of the menu.
-
Select the use case: "Loan Default by client".
Step 2: Initiate a New Feature Ideation Workflow¶
-
Click
to start the Feature Ideation process.
-
Edit the Feature Ideation name and description by clicking
.
Step 3: Start Ideation with a single aggregation window (52 weeks)¶
- Begin the automated Feature Ideation workflow by clicking
.
-
You can stop the process at any stage if needed. For example, you could stop at the Feature Ideation Setup to review the recommendations for feature aggregration windows, select one and then proceed to Feature Selection.
-
You can configure the ideation by clicking
. We will here set the feature aggregation window to 52 weeks in Ideation Setup.
-
Click
to start ideation.
Once the process is initiated, you’ll see confirmation that the run has started:
Step 4: Review the Feature Ideation Report¶
After the process completes, a feature selection will be displayed for your review.
-
Access the Detailed Report, describing each step of the ideation process, by clicking
next to the Ideation name "Simple Ideation".
-
Visualize the full report with an indexed view in a new tab, by clicking
.
Step 5: Review Features¶
Select the Features tab to review the suggested features.
Click on a feature to open its details. You can use the filter or the search
, to find a specific feature.
Review Feature Relevance¶
Check Semantic Relevance in the 'About' tab of the feature.
Review Feature Lineage¶
-
Explore Feature Lineage by going to the 'Lineage' tab.
-
Click
to trace the feature's origin and transformations.
Review Feature Distribution¶
Analyze Feature Distribution and its relationship with the Target in the 'EDA' tab.
Interact with EDA Plots. Within the 'EDA'' tab, click on the plot to activate tooltips for additional insights.
Review SDK Code¶
For an Individual Feature¶
Go to the 'SDK Code' tab of the feature.
For a Feature Selection¶
-
Clear Filters by clicking
and close the filter panel by clicking
.
-
Ensure the feature selection is properly selected.
-
Select features in the feature list by clicking
.
-
Download the notebook to inspect the feature declaration code by clicking
.
-
Open the notebook to review the feature engineering code.