Add support for compressed file formats (gzip/zip) in source-gcs connector

[Lucas Leadbetter (lleadbet)]

Current Limitation

The source-gcs connector currently doesn't support gzip or zip compressed files as a selectable file format option. This means users cannot directly read compressed files from GCS buckets, which is a common storage optimization practice. This feature currently exists on the low-code Connector Builder as an option as a response, so this should also be enabled for the source-gcs Source as well.

Proposed Enhancement

Add support for compression formats (gzip, zip, bzip2) in the file format settings, with the ability to specify the nested file format within the compressed archive.

Example Use Case

Many organizations store CSV files compressed as .csv.gz or .csv.zip to reduce storage costs and transfer times. The connector should support configurations like:

• File Format: gzip
• Nested Format: CSV
• File Pattern: *.csv.gz

This would allow the connector to:

1. Decompress the gzip/zip file

2. Parse the inner content using the specified format parser (CSV, JSON, Avro, Parquet, etc.)