Snowflake

Overview

HockeyStack’s Snowflake integration allows you to seamlessly connect your Snowflake instance to our platform. This custom-built connector is designed to pull in data from Snowflake based on your unique infrastructure and analytics needs. Typical use cases include:

• Pulling specific user profile data to enrich your analytics

• Mapping offline revenue opportunities to your CRM activities

• Incorporating additional custom data points that help unify your customer data story

If you’re unsure about what data is most valuable to pull, we’re happy to schedule a call to help you determine which tables and fields will best support your use cases.

Prerequisites

Before we begin, please ensure you have:

• Access to your Snowflake instance with the ability to manage users, permissions, and network policies.

• Clear information on which Snowflake tables, databases, and columns contain the data you’d like HockeyStack to ingest.

• An understanding of whether HockeyStack should have read-only access, or if write permissions are also needed (for pushing data back to Snowflake).

Connecting to Snowflake

To establish a secure connection between HockeyStack and Snowflake, follow these steps:

1. User Invitation (if using email-based authentication): Invite [e-mail] to your Snowflake instance. This grants HockeyStack the ability to authenticate and connect.

2. IP Whitelisting (if applicable): If you have IP restrictions in place, whitelist the following IP addresses to allow HockeyStack’s workers to communicate with Snowflake:

   • 18.184.228.143

   • 18.192.106.69

   • 35.157.54.242

   • 3.69.98.171

3. Assigning Permissions: Decide whether HockeyStack should have read-only or read-write permissions, depending on your use case. Please create a Role that HockeyStack can use to access necessary databases, schemas and tables. Then, create a User that can access this role either using a password or a key-pair.

   1. Extra Resources:

      1. tutorial on creating a user a granting roles

      2. more information on creating a Key-Pair

   2. When you are finished creating the role, please provide us with the following in the secure manner of your choice. (Popular choices are One Time Secret, or 1Password):

      1. Account (usually, abc-xyz.snowflakecomputing.com)

      2. Warehouse

      3. Database

      4. Schema

      5. Table

      6. Username

      7. Password or Private Key (and private key password, if encrypted).

4. Node.js Integration Details: We connect using Node.js workers to ensure a stable and efficient integration. For more technical details on how the Node.js connector works, refer to Snowflake’s official documentation: Node.js Snowflake Driver Connect Docs

Pulling Data from Snowflake

HockeyStack runs scheduled workers (typically daily, though this can be customized) to pull data from your Snowflake instance. The process is as follows:

1. Initial Historical Backfill: We start by running a full backfill of your historical data. This ensures that HockeyStack has all necessary historical records before moving on to incremental updates. Depending on the size of your data and infrastructure, this can take some time.

2. Ongoing Incremental Updates: After the initial backfill, HockeyStack’s daily (or otherwise scheduled) jobs will query your specified Snowflake tables to fetch any new or updated data. This process continues until the connection is closed or modified.

3. Data Processing: The pulled data is processed on HockeyStack’s servers and inserted into our database, making it available for analysis, reporting, and integrations.

Pushing Data into Snowflake

If you need to send data from HockeyStack back into Snowflake, we can configure a daily sync to your Snowflake table. This will start with an initial export backfill of all tracked data for your export type, and recur on a daily basis with incremental additions.

Data Formatting: Our workers query HockeyStack’s database, and export either raw actions or stage data to your destination table.

---

If you have any questions, need more details on the integration process, or want to discuss the specifics of your data pulls, please reach out to our support team. We’re here to help make sure your Snowflake integration is set up seamlessly and supports your analytics goals.