Overview
Stigg’s integration with Databricks allows you to export your product catalog, customer, and subscription data directly to a Databricks SQL warehouse for analytics and data engineering workflows.Stigg’s native data export integrations are included in the Scale plan, and are also available as an optional add-on to the Growth plan. See Stigg’s pricing for more details.
Exported entities
When connecting Databricks, you can choose which Stigg entity groups to include in the sync. All groups are selected by default. See Exported entities for the full list of entity groups and the tables within each.Entity schema
Setting up the integration
Prerequisites
- A Databricks workspace with a SQL warehouse
- A service principal (recommended) or personal access token with permission to read/write the target catalog and schema
Create a service principal (recommended)
In your Databricks workspace, create a service principal and generate an OAuth client ID and secret. Grant the service principal
USE CATALOG, USE SCHEMA, CREATE TABLE, and MODIFY privileges on your target catalog and schema.Using a service principal with OAuth is recommended over a personal access token, as it provides short-lived credentials and better security controls.Connect Stigg with Databricks
In Stigg, navigate to Integrations > Apps > Databricks.Enter the following information in the connection form:
Click Test & connect.
| Field | Description |
|---|---|
| Server hostname | The SQL warehouse hostname from the Connection Details tab in your Databricks workspace |
| Port | The port for the SQL warehouse connection, from the Connection Details tab. Typically 443. |
| HTTP path | The HTTP path from the Connection Details tab |
| Catalog | The target Unity Catalog name |
| Schema | The schema where Stigg will create and sync tables |
| Auth method | OAuth (service principal) (recommended) or Personal access token |
| Client ID / Token | The OAuth client ID or personal access token |
| Client secret | The OAuth client secret (OAuth only) |
Select entities to export
After entering your connection details, expand the Entities to export section to choose which entity groups to include in the sync. All groups are selected by default.See Exported entities for a description of each group.