8. Ideate Features
FeatureByte provides two primary methods for feature creation:
- Manual Creation: Utilize the SDK declarative framework for complete control over the feature engineering process.
- Automatic Creation: Accelerate feature engineering through Feature Ideation an AI-powered, automated method that intelligently suggests relevant features for your use case.
How FeatureByte Ideates Features
Feature Ideation adopts an agentic approach that dynamically tailors feature generation to your use case. The process includes:
- Analyzing tables and relationships to identify relevant data.
- Inferring missing semantic tags based on column metadata.
- Recommending column transformations, such as time deltas, ratios, and differences.
- Identifying key filters to isolate critical events.
- Highlighting key columns for further feature engineering.
- Proposing appropriate aggregation time windows.
- Analyzing event frequency patterns to detect timing signals.
- Recommending and evaluating features for their semantic relevance.
- Promoting feature reuse by detecting duplicates in the Catalog.
- Conducting EDA on each feature and assigning an individual Predictive Score.
- Selecting the optimal feature set based on SHAP value analysis.
Every step is transparently documented to ensure full traceability.
Modes of Operation
Feature Ideation offers two modes of operation:
- Fully automated mode: Automatically executes the entire workflow.
- Semi-automated mode: Enables you to review and refine recommendations step by step.
This tutorial demonstrates the fully automated mode of Feature Ideation. A detailed guide to the semi-automated mode will follow in the next section.
Note
If you want to learn how to manually create features, please consult our SDK tutorials.
Step 1: Select Your Use Case¶
-
Navigate to Feature Ideation from the 'Ideate' section of the menu.
-
Select the use case: "Customer Activity Next Week before a purchase".
- If the target could not be created in the SDK, select "Customer Activity Next Week before a purchase (using the descriptive target)" instead.
Step 2: Initiate a New Feature Ideation Workflow¶
- Click
to start the Feature Ideation process.
- Edit the Feature Ideation name and description by clicking
.
Step 3: Start Automated Mode¶
- Begin the automated Feature Ideation workflow by clicking
.
- Optionally, you can stop the process at any stage if needed.
- You can also choose to configure the ideation by clicking
. Note that by default, the search for Filters is disabled in Filter Setup.
Once the process is initiated, you’ll see confirmation that the run has started:
Step 4: Review the Feature Ideation Report¶
After the process completes, a feature selection will be displayed for your review.
-
Access the Detailed Report, describing each step of the ideation process, by clicking
next to the Ideation name "Simple Ideation".
-
Visualize the full report with an indexed view in a new tab, by clicking
.
Step 4: Review Features¶
Select the Features tab to review the suggested features.
Click on a feature to open its details. You can use the filter or the search
, to find a specific feature.
Review Feature Relevance¶
Check Semantic Relevance in the 'About' tab of the feature.
Review Feature Lineage¶
-
Explore Feature Lineage by going to the 'Lineage' tab.
-
Click
to trace the feature's origin and transformations.
Review Feature Distribution¶
Analyze Feature Distribution and its relationship with the Target in the 'EDA' tab.
Interact with EDA Plots. Within the 'EDA'' tab, click on the plot to activate tooltips for additional insights.
Review SDK Code¶
For an Individual Feature¶
Go to the 'SDK Code' tab of the feature.
For a Feature Selection¶
-
Clear Filters by clicking
and close the filter panel by clicking
.
-
Ensure the feature selection is properly selected.
-
Select features in the feature list by clicking
.
-
Download the notebook to inspect the feature declaration code by clicking
.
-
Open the notebook to review the feature engineering code.
Step 8: Add the SHAP Feature Selection to the Feature Catalog¶
Save the selected features into the Feature Catalog by clicking . Call the feature list "SHAP selection from Automated Mode".
After saving, the readiness of the features should be "DRAFT".