Salesforce Objects to Parquet File on Amazon S3 by COZYROC

This gem automates the extraction of data from Salesforce object, converting it into Parquet files and uploading them to a specified Amazon S3 bucket. It streamlines the data export process, ensuring that data is securely and efficiently transferred to the cloud in the Parquet format, ideal for large-scale data storage and analytics. By automating this task, it eliminates manual intervention, reduces errors, and enhances operational efficiency. The uploaded files are named in the format ObjectName_CurrentDate, ensuring easy organization and traceability of data exports.

Setup Guide

This gem generates a Parquet file for each Salesforce Object and uploads each file to the designated Amazon S3 bucket.

To run this gem and export an Salesforce object data to an Amazon S3 bucket as a Parquet file, configure the following parameters

Salesforce

• Server Host Required. Specify the Salesforce service URL.
• Username Required. Specify a username in an email-like format.
• Password Required. Specify a password to access the Salesforce service.
• Security Token Required. Specify your Salesforce service security token.
• Object List Required. This parameter accepts comma-separated values if you want to pull data from multiple Salesforce objects, e.g. Account, Contact, Case, etc.

Amazon S3

• Server Host Required. Provide the relevant [bucket] and [region] in the Server URL.
• Access Key Required. Specify the access key for Amazon S3 service.
• Secret Key Required. Specify the secret key for Amazon S3 service.
• Destination Folder Required. Specify the path to the destination folder ending with a trailing slash.