This gem involves extracting data from Snowflake, converting it to CSV files, and uploading them to a desired SFTP server folder. This ensures that data is readily accessible at the chosen SFTP server for collaboration and reporting. Automation and monitoring ensure data accuracy and timely updates.
Setup Guide
This gem will establish a connection between Snowflake and the SFTP server of your choosing. Once the connection is established, the gem will pull the data from each Snowflake table specified in the List Table
parameter. The gem will then generate a CSV file for each table data and upload all files to an SFTP server. The uploaded files will be named Table_currentdate
.
To run this gem and connect Snowflake to an SFTP server, you need to specify the parameters below.
Snowflake
Server Host
Required. Specify the correct [account identifier] in the server host URL.Token File
Required. Select the Rest Token file from the drop-down list. Review the KB Article mentioned here on how to generate the token file.Warehouse
Required. Specify the Snowflake warehouse name.Database
Required. Specify the Snowflake database name.Schema
Required. Specify the Snowflake schema name.List Table
Required. This parameter accepts comma-separated values to pull data from multiple Snowflake tables.Timeout
Required. Specify the timeout. The default is set to 60.Where
Optional. Specify to filter the data.Batch Size
Required. The default is set to 200.Compression
Optional. The default is set to false.
SFTP
Server Host
Required. Specify the name or IP address of the SFTP server.Port
Required. Specify the port number.Username
Required. Specify a username to access the SFTP server.Password
Required. Specify a password to access the SFTP server.Destination Folder
Required. Specify the path to the destination folder ending with a trailing slash.