This gem involves extracting data from Snowflake, converting it to CSV files, and uploading them to a desired SFTP server folder. This ensures that data is readily accessible at the chosen SFTP server for collaboration and reporting. Automation and monitoring ensure data accuracy and timely updates.
Setup Guide
This gem will establish a connection between Snowflake and the SFTP server of your choosing. Once the connection is established, the gem will pull the data from each Snowflake table specified in the List Table parameter. The gem will then generate a CSV file for each table data and upload all files to an SFTP server. The uploaded files will be named Table_currentdate.
To run this gem and connect Snowflake to an SFTP server, you need to specify the parameters below.
Snowflake
Server HostRequired. Specify the correct [account identifier] in the server host URL.Token FileRequired. Select the Rest Token file from the drop-down list. Review the KB Article mentioned here on how to generate the token file.WarehouseRequired. Specify the Snowflake warehouse name.DatabaseRequired. Specify the Snowflake database name.SchemaRequired. Specify the Snowflake schema name.List TableRequired. This parameter accepts comma-separated values to pull data from multiple Snowflake tables.TimeoutRequired. Specify the timeout. The default is set to 60.WhereOptional. Specify to filter the data.Batch SizeRequired. The default is set to 200.CompressionOptional. The default is set to false.
SFTP
Server HostRequired. Specify the name or IP address of the SFTP server.PortRequired. Specify the port number.UsernameRequired. Specify a username to access the SFTP server.PasswordRequired. Specify a password to access the SFTP server.Destination FolderRequired. Specify the path to the destination folder ending with a trailing slash.