Add Data Source
Chaos Genius supports multiple data sources. Please find a complete list of data sources & setup instructions for each data source in the section Data Sources Catalog
If you do not find the data source you are looking to add, please drop us a line on our Community Slack channel.
For third-party data sources such as Google Sheets
, Google Analytics
, Shopify
, Stripe
, Bind Ads
, Facebook Marketing
and Google Ads
, Chaos Genius uses Airbyte to load and sync data. For the said data sources, Chaos Genius follows the documentation support provided by Airbyte.
info
Third-party data sources are not available in the default version. If you need them, please install the third-party version or upgrade to it.
All third-party data sources are NOT enabled by default. Please see this section to enable specific third-party data sources.
Add a New Data Source​
Within the Data Sources section, you can find a list of all the Data Sources that have been added along with the Status, Data Source Type, Number of KPIs currently defined using the particular data source, Last sync time and the date of creation.
For adding a new Data Source, click on the "New Data Source" button on top right. You are required to follow the following steps:
Name the Data Source
Choose your Data Source's time zone. By default this value is set to UTC.
Select the Data Source type from the drop down
Fill in the required credentials
The credential information varies by each Data Source type. Once you've filled in the credentials, you are required to test the connection by pressing "Test Connection".
If the connection is successfully tested, you can add the Data Source by pressing the "Add Data Source" button on the bottom that will replace the "Test Connection" button.
Metadata sync​
Once you've added a data source, give Chaos Genius a couple of minutes to sync its metadata.
Metadata here refers to all the schemas, tables and columns present in a data source. This data is used to help you add a KPI. When a new data source is added, and every day hence, the metadata of the data source is cached inside Chaos Genius. The time at which metadata is synchronized daily can be set globally.
Metadata sync status​
The metadata will be in one of three states:
- In Progress: synchronization is underway. For large data warehouses, the synchronization can take anywhere from a few seconds to 1 or 2 minutes.
- Live (a.k.a. "Completed"): synchronization is complete and KPIs can be added if not already.
- Broken (a.k.a. "Error"): synchronization could not complete due to an error. Please check the logs of the
chaosgenius-worker-alerts
service for details on the error.
Force update metadata​
If the metadata is out of date, you can trigger an update by clicking on the 3 dots menu and selecting "Sync schema". The metadata update runs as a background job.
.