Skip to main content

​
Overview

Stigg’s integration with Databricks allows you to export your product catalog, customer, and subscription data directly to a Databricks SQL warehouse for analytics and data engineering workflows.
Stigg’s native data export integrations are included in the Scale plan, and are also available as an optional add-on to the Growth plan. See Stigg’s pricing for more details.

​
Exported entities

When connecting Databricks, you can choose which Stigg entity groups to include in the sync. All groups are selected by default. See Exported entities for the full list of entity groups and the tables within each.

Entity schema

​
Setting up the integration

​
Prerequisites

  • A Databricks workspace with a SQL warehouse
  • A service principal (recommended) or personal access token with permission to read/write the target catalog and schema
1

Create a service principal (recommended)

In your Databricks workspace, create a service principal and generate an OAuth client ID and secret. Grant the service principal USE CATALOG, USE SCHEMA, CREATE TABLE, and MODIFY privileges on your target catalog and schema.Using a service principal with OAuth is recommended over a personal access token, as it provides short-lived credentials and better security controls.
2

Connect Stigg with Databricks

In Stigg, navigate to Integrations > Apps > Databricks.Enter the following information in the connection form:Click Test & connect.
3

Select entities to export

After entering your connection details, expand the Entities to export section to choose which entity groups to include in the sync. All groups are selected by default.See Exported entities for a description of each group.

​
Sync process and schedule

After setup, Stigg performs a full sync of all selected entities. Subsequent syncs are incremental, transferring only changes since the last run. Stigg syncs data on a configurable schedule — daily at 12:00 AM UTC by default. You can adjust the sync frequency from the integration settings at any time.

​
Manual sync

To trigger an immediate sync, open the Databricks integration in Stigg and click Sync now.

​
Sync history

The integration page shows a log of all past and in-progress syncs. The dashboard updates automatically as syncs complete. Each row shows the sync status and timestamps. Expand a row to see rows synced per entity, sync duration, trigger source, and who initiated it. Use the status and date filters to find a specific sync run.

​
Removing the integration

To remove the integration, click on the dotted menu icon and select the Remove action. Confirm the action by clicking on the Remove button in the opened modal.