[file-transfer] Support additional file transfer destinations beyond S3 and Azure Blob Storage #72958
Ilja Herdt (Airbyte) (iherdt-airbyte)
started this conversation in
Connector Ideas and Features
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
The file transfer feature currently only supports two destinations: S3 (v1.4.0+) and Azure Blob Storage (v1.1.6+). Sources that support file transfer (e.g., Google Drive, SFTP, Azure Blob Storage) cannot deliver files to warehouse destinations like Snowflake, GCS, or BigQuery.
Request: Expand file transfer destination support to include Snowflake (via internal/external stage), GCS, and other warehouse or object-store destinations.
Context: Organizations using file-based sources (Google Drive, SFTP) to sync structured files (.xlsx, .csv) into warehouse destinations have no native Airbyte path today. The current workaround is to land files in S3 via Airbyte file transfer and then use external tooling (e.g., Snowflake
COPY INTOfrom an S3 stage) to complete the pipeline. This adds operational overhead and monitoring outside of Airbyte.Expected behavior:
Related issues:
Beta Was this translation helpful? Give feedback.
All reactions