DataSyncs

HockeyStack's DataSyncs tool helps you connect your data warehouse and sync data. We currently support the following providers.

Import or Export your Data

Configure a DataSync Import

One Time vs Recurring Syncs

• One Time syncs import data from your source into HockeyStack only once

• Recurring Syncs will do a daily import of updated information from your warehouse to HockeyStack

  • For S3 imports, the process is based on the file's upload time. This means that for each import type, new data should be included in a new file.

  • For all other providers, new data is pulled based on a timestamp from a specified column. This timestamp should reflect when the data was inserted into your source.

Test Connection

After configuring a DataSync, the first step is to test the connection.

• For imports, this ensures a proper connection to your source and the ability to read and format data correctly based on the selected import type

• If validation fails, an error message will display what is wrong. Common issues are:

  • permission errors authenticating to your warehouse

  • missing required columns for the given import type

Common Pitfalls

I'm having trouble authenticating my source with DataSyncs

It is recommended to attempt connecting to your source using the same exact provided credentials. Use CLI tools for the respective provider (aws-cli for S3, or bq for BigQuery for example) or a GUI client such as DataGrip.