Snowflake to Azure Blob Storage by COZYROC

This gem involves extracting data from Snowflake, converting it to CSV files, and securely uploading them to a specified Blob Storage container ensuring efficient, reliable, and scalable data storage and access.

Setup Guide

This gem will establish a connection between Snowflake and Azure Blob Storage. Once the connection is established, the gem will pull the data from each Snowflake table specified in the List Table parameter. The gem will then generate a CSV file for each table data and upload all files to a desired location in Azure Blob Storage. The uploaded files will be named Table_currentdate.

To run this gem and connect Snowflake to Azure Blob Storage, you need to specify the parameters below.

Snowflake

• Server Host Required. Specify the correct [account identifier] in the server host URL.
• Token File Required. Select the Rest Token file from the drop-down list. Review the KB Article mentioned here on how to generate the token file.
• Warehouse Required. Specify the Snowflake warehouse name.
• Database Required. Specify the Snowflake database name.
• Schema Required. Specify the Snowflake schema name.
• List Table Required. This parameter accepts comma-separated values to pull data from multiple Snowflake tables.
• Timeout Required. Specify the timeout. The default is set to 60.
• Where Optional. Specify to filter the data.
• Batch Size Required. The default is set to 200.
• Compression Optional. The default is set to false.

Azure Blob Storage

• Server Host Required. Specify the storage account name in the server host URL https://[account].blob.core.windows.net.
• Storage Account Required. Specify the storage account name.
• Shared Key Required. Specify the shared key.
• Destination Folder Required. Specify the path to the destination folder ending with the trailing slash.

Note This gem only supports Shared Key authentication type for Azure Blob Storage.