Snowflake to Amazon S3 by COZYROC

This gem involves extracting data from Snowflake, converting it to CSV files, and securely uploading them to a specified S3 location. This ensures efficient, reliable, and timely data availability for further processing and analysis.

Setup Guide

This gem will establish a connection between Snowflake and the Amazon S3 location of your choosing. Once the connection is established, the gem will pull the data from each Snowflake table specified in the List Table parameter. The gem will then generate a CSV file for each table data and upload all files to the desired Amazon S3 location. The uploaded files will be named Table_currentdate.

To run this gem and connect Snowflake to Amazin S3, you need to specify the parameters below.

Snowflake

• Server Host Required. Specify the correct [account identifier] in the server host URL.
• Token File Required. Select the Rest Token file from the drop-down list. Review the KB Article mentioned here on how to generate the token file.
• Warehouse Required. Specify the Snowflake warehouse name.
• Database Required. Specify the Snowflake database name.
• Schema Required. Specify the Snowflake schema name.
• List Table Required. This parameter accepts comma-separated values to pull data from multiple Snowflake tables.
• Timeout Required. Specify the timeout. The default is set to 60.
• Where Optional. Specify to filter the data.
• Batch Size Required. The default is set to 200.
• Compression Optional. The default is set to false.

Amazon S3

• Server Host Required. Provide the relevant [bucket] and [region] in the server URL.
• Access Key Required. Specify the access key for the Amazon S3 service.
• Secret Key Required. Specify a secret key for the Amazon S3 service.
• Destination Folder Required. Specify the path to the destination folder, ending with a trailing slash.