Skip to content

8. Ideate Features

FeatureByte provides two primary methods for feature creation:

  • Manual Creation: Utilize the SDK declarative framework for complete control over feature engineering.
  • Automatic Creation: Accelerate feature engineering through Feature Ideation an AI-powered, automated approach.

How FeatureByte Ideates Features

Feature Ideation uses an agentic approach to tailor features to your use case. It can:

  1. Analyze tables and relationships to identify relevant data.
  2. Fill in missing semantic tags using column metadata.
  3. Suggest useful column transformations, such as time deltas, ratios, and differences.
  4. Recommend key filters to isolate important events.
  5. Highlight key columns for advanced feature engineering.
  6. Propose relevant time windows for feature aggregation.
  7. Analyze event frequencies to identify timing signals.
  8. Recommend features and evaluate their semantic relevance to your use case.
  9. Ensure feature reuse by detecting and avoiding duplicate features in the Catalog.

Each step is documented, ensuring complete transparency and traceability throughout the process

Modes of Operation

Feature Ideation offers two modes of operation:

  • Fully automated mode: Automatically executes the entire workflow.
  • Semi-automated mode: Enables you to review and refine recommendations step by step.

After ideating features, leverage exploratory data analysis (EDA) and advanced feature selection techniques to finalize your feature set.

This tutorial demonstrates the fully automated mode of Feature Ideation. A detailed guide to the semi-automated mode will follow in the next section.

Note

If you want to learn how to manually create features, please consult our SDK tutorials.

Step 1: Select Your Use Case

  1. Navigate to Feature Ideation from the 'Ideate' section of the menu.

  2. Select the use case: "Customer Activity Next Week before a purchase".

    • If the target could not be created in the SDK, select "Customer Activity Next Week before a purchase (using the descriptive target)" instead.

Name

Step 2: Initiate a New Feature Ideation Workflow

  1. Click New Ideation Button to start the Feature Ideation process.
  2. Edit the Feature Ideation name and description by clicking Edit Button.

Name

Step 3: Start Automated Mode

  1. Begin the automated Feature Ideation workflow by clicking Auto Run Button.
  2. Optionally, you can stop the process at any stage if needed.

Name

Once the process is initiated, you’ll see confirmation that the run has started:

Name

Step 4: Review the Feature Ideation Report

After the process completes, a table of ideated features will be displayed for your review.

Name

Accessing the Detailed Report: To view the full report describing each step of the ideation process, click Report Button next to the Ideation run name "Automated Mode".

Name

To visualize the full report with an indexed view in a new tab, click Report tab Button.

Name

Step 5: Run EDA

Select All Ideated Features: Click Select All Button to select all ideated features.

Name

Initiate EDA: Scroll to the bottom of the ideated features table and click EDA Button to begin the Exploratory Data Anaylsis (EDA) process.

Name

Sort by Predictive Score: After EDA completes, each feature will have a univariate Predictive Score. Sort the features by predictive score to identify those with the highest predictive power.

Name

View Detailed EDA for a Feature: To explore the EDA results for a specific feature, click on the feature name to open its details, then navigate to the 'EDA' tab.

Name

Interact with EDA Plots: Within the 'EDA'' tab, click on the plot to activate tooltips for additional insights.

Name

Step 6: Run Feature Selection

  1. Start Feature Selection by clicking on the Magic Ward Magic Ward.
  2. Select the SHAP-Based mode and choose the option to exclude Low Added Value Features.

Name

Once the selection is complete, review the selected features.

Name

Step 7: Review Features

Review Individual Features

Select a Feature to Review: Click on a feature to open its details. You can use the search, to find a specific feature.

Check Semantic Relevance: Go to the 'About' tab to assess its Semantic Relevance.

Name

Explore Feature Lineage: Switch to the 'Lineage' tab to trace the feature's origin and transformations.

Name

Click Lineage Button.

Name

Analyze Feature Distribution: Navigate to the 'EDA' tab to examine the feature's distribution and its relationship with the Target.

Name

Review SDK Code for Feature Declaration

  1. Clear the search (if you used it), then select features in the feature list by clicking Select All Button after clearing the search.
  2. Download the notebook to inspect the feature declaration code by clicking Download Notebook.

Name

Open the notebook to review the feature engineering code.

Name

Step 8: Add Features to the Feature Catalog

  1. Clear the search (if you used it) and any prior selection (if any) by clicking Clear Button
  2. Select features in the feature list by clicking Select All Button.
  3. Save the selected features into the Feature Catalog by clicking Save Feature List.

Name

Name

Name