Google Cloud Storage (GCS)
Edge IQ supports reading from and writing to Google Cloud Storage (GCS). By leveraging Edge IQ’s secure connectors, schema-less enrichment, and real-time streaming, your team gains comprehensive visibility—seamlessly integrating with GCS for efficient data storage, retrieval, and analysis while maintaining optimal performance and scalability.
Configure Edge IQ to read data from GCS
Section titled “Configure Edge IQ to read data from GCS”Add Edge IQ input gcs to a job and configure:
- Bucket Name: The storage service container.
- Object Name: The objects names.
- Application Credentials:
- Service Account:
Configure Edge IQ to write data to GCS
Section titled “Configure Edge IQ to write data to GCS”Add Edge IQ output gcs to a job and configure:
- Bucket Name: The storage service container.
- Object Name: The objects names.
- Application Credentials:
- Service Account:
Recommendations for files and folders
Section titled “Recommendations for files and folders”- each file should not be larger than 100MB-150MB (compressed gzip or parquet)
- Y/M/ or Y/M/D/ or Y/M/D/H/ folders