Bruin¶

Bruin is a data platform that allows you to build, test, and deploy data pipelines. Bruin Cloud provides an API to access your pipeline metadata and execution information.

omniload supports Bruin as a source.

URI format¶

The URI format for Bruin is as follows:

bruin://?api_key=<api-key-here>

URI parameters:

api_key: the API key used for authentication with the Bruin API

Setting up a Bruin Integration¶

To get your API key:

Go to cloud.getbruin.com
Navigate to Teams section
Click on Create API Token
Make sure Pipeline List is selected as the permission
Copy the generated API key

Once you have your API key, here’s a sample command that will copy the data from Bruin into a DuckDB database:

omniload ingest \
    --source-uri 'bruin://?api_key=your_api_key_here' \
    --source-table 'pipelines' \
    --dest-uri duckdb:///bruin.duckdb \
    --dest-table 'dest.pipelines'

Tables¶

Bruin source allows ingesting the following sources into separate tables:

Table	Inc Key	Inc Strategy	Description
`pipelines`	-	replace	Contains information about your data pipelines including metadata and configuration.
`assets`	-	replace	Contains information about your pipeline assets including their definitions and dependencies.

Use these as --source-table parameter in the omniload ingest command.