This gem automates the ingestion of Excel worksheet data from Amazon S3 into a designated Airtable table. By eliminating manual steps, it streamlines the data pipeline and ensures accurate, consistent, and timely updates. Designed for scalability and reliability, this solution enables seamless, hands-free data migration from cloud-based storage into Airtable.
Setup Guide
This gem will establish a connection between Amazon S3 and Airtable. It will then pull data from the specified worksheet within the Amazon S3 Excel file (provided in the Excel File
parameter) and transfer it to the target Airtable destination table.
To run this gem and connect desired Amazon S3 bucket to Airtable, configure the parameters that are mentioned below.
Amazon S3
Server Host
Required. Provide the relevant [bucket] and [region] in the Server URL.Access Key
Required. Specify the access key for Amazon S3 service.Secret Key
Required. Specify the secret key for Amazon S3 service.Source Folder
Required. Specify the path to the source folder ending with a trailing slash, for example:Dev/Files/Excel/
.Excel File
Required. Specify the source excel file name for example:Automobile.xlsx
.Worksheet
Required. Specify the worksheet name.Filter Column
Optional. Specify a regular expression to exclude unwanted columns from the Excel file.
Airtable
Server Host
Required. Specify the correct [base id] in the server host URL.Token File
Required. Select the airtable token file from the drop-down list. Review the documentation article here on how to generate the token file.Table
Required. Specify the target Airtable table name.
Mapping
Mapping
Optional. Use this parameter when source and destination columns differ. Specify mappings in a key-value format, with each pair on a new line, e.g., SourceColumn1=DestinationColumn1.