Skip to content

featurebyte.DatabricksDetails

class DatabricksDetails(
*,
host: StrictStr,
http_path: StrictStr,
featurebyte_catalog: StrictStr,
featurebyte_schema: StrictStr,
storage_spark_url: StrictStr
)

Description

Model for details used to connect to a Databricks data source.

Parameters

  • host: StrictStr
    Databricks host. This is typically the URL you use to go to to access your databricks environment.

  • http_path: StrictStr
    Databricks compute resource URL.

  • featurebyte_catalog: StrictStr
    Name of the database that holds metadata about the actual data. This is commonly filled as hive_metastore.

  • featurebyte_schema: StrictStr
    The name of the schema containing the tables and columns.

  • storage_spark_url: StrictStr
    DBFS path where we will be reading our data from.

Examples

>>> details = fb.DatabricksDetails(
...   host="<host_name>",
...   http_path="<http_path>",
...   featurebyte_catalog="hive_metastore",
...   featurebyte_schema="<schema_name>",
...   storage_spark_url="dbfs:/FileStore/<schema_name>",
... )