BigQuery loads from Google Cloud Storage and exports back to it. Files.com is the governed front door on the GCS bucket: it collects partner files over the protocols partners actually use, reshapes them, lands them where the load reads, and delivers exports back out.
No credit card required · 7-day free trial · Live in minutes
Real companies. Real file flows. Real results.
BigQuery’s loading model is clean: put files in Google Cloud Storage, and load jobs, scheduled transfers, and external tables read them from there. The mess lives upstream — counterparties on SFTP, feeds arriving PGP-encrypted, formats the load won’t accept, and the gsutil scripts and Cloud Functions somebody wrote to hold it all together.
Files.com owns everything between the sender and the bucket. Partners deliver over their own scoped credentials, TransformScript reshapes what needs reshaping, the GCS connection lands files where BigQuery loads, and Pub/Sub events tell the rest of your Google stack the moment data is ready.
Intake to the bucket, events to the pipeline, and exports delivered outward. Each runs on Files.com in production.
GCS is BigQuery’s loading dock. Files.com connects to your GCS bucket and an Automation writes each inbound partner file into it the moment it arrives, so the load job or scheduled transfer finds the data already in place.
Mount the GCS bucket and its folders appear as Files.com folders: a partner upload lands directly in GCS, and a BigQuery export dropped in the bucket is immediately reachable over every Files.com protocol and share surface.
Files.com publishes file events to Google Pub/Sub, so an arriving feed triggers the Dataflow job or BigQuery load the moment the file lands. Analytics stay current instead of waiting on a timer.
BigQuery loads CSV, JSON, Avro, Parquet, and ORC — not whatever a counterparty happened to send. TransformScript converts formats in the flow, and Automations split and rename, so what reaches the bucket is what the load accepts.
BigQuery exports land in GCS; Automations pick them up, encrypt under a recipient’s PGP key where mandated, and deliver over SFTP or whatever protocol each counterparty runs, with every delivery logged.
A scheduled load over a bucket nobody fed succeeds at loading nothing. Delivery monitoring knows when each upstream feed is due and raises an alert when the window closes without a file, before the dashboard shows yesterday’s numbers as today’s.
How Files.com attaches to the bucket, and why nothing on the BigQuery side changes.
Files.com connects to Google Cloud Storage with a service account key (JSON), HMAC keys over Google’s S3-compatible XML API, or OAuth. One connection covers mounts, syncs, and automation targets against the bucket.
A Remote Server Mount presents the bucket as live Files.com folders with nothing copied; a scheduled Sync pushes or pulls in batches. Inbound partner data and outbound BigQuery exports each get whichever shape fits.
BigQuery load jobs, scheduled Data Transfer Service runs, and external tables all read the bucket exactly as they do today. Files.com feeds and drains the bucket; nothing about the BigQuery side changes.
Each partner or system delivering data gets its own scoped credential and folder, so no sender ever sees another’s files, and the audit log records every arrival, transformation, and write to the bucket.
Retail & Consumer
The migration had to add vendor isolation, tighter payroll access, and auditability while leaving existing SFTP paths and automations intact.
Read story →
Health & Life Sciences
A branded portal, scripted provisioning, and automated validation gave the finance team control of auditable vendor intake at scale.
Read story →
“Files.com's strengths are simplicity, ease of use, and the cloud connectors. We don't have to invent custom infrastructure for every partner.”
“Files.com is versatile — it can manage many different situations from a single platform. We've consolidated multiple tools onto it.”
“Files.com is robust and scales to a large enterprise. We get multiple files per minute, per second — and we're a 24/7 organization, so everything has to always be up.”
What data teams ask most when wiring partner file intake to BigQuery.
Receive, transform, and land every file your warehouse loads, with events firing the moment data is ready.
No credit card required • Free for 7 days • Live in minutes