Skip to main content

Snowflake

SnowflakeExternal LinkThis link leads to an external website and will open in a new tab is a cloud-based data platform that provides data warehousing, analytics, and data sharing capabilities across multiple cloud providers.

Files.com integrates directly with Snowflake via the Files.com S3-Compatible Endpoint, which allows Snowflake to connect to Files.com just as it would to any Amazon S3 bucket, enabling direct data loading from Files.com into Snowflake.

Integration Overview

Snowflake supports working with S3-compatible storageExternal LinkThis link leads to an external website and will open in a new tab which allows your Files.com site's S3 endpoint to be used as a Snowflake external stage.

The Files.com S3-Compatible Endpoint exposes your Files.com site as an S3-compatible storage target. Snowflake can load and unload data files directly from Files.com folders using the same approach it uses with any S3-compatible bucket.

Configuring Files.com

Your Files.com site includes an S3-Compatible Endpoint. Generate an S3 compatible API Key to create the access key ID, and secret access key, which are required when setting up Snowflake. The API Key must be associated with a user account of your site.

Configure the Files.com permissions for the folder you want Snowflake to access to allow access for the user associated with the access key.

Verify that the user can access files in the folder and that those files appear as expected before proceeding to configure Snowflake.

Configuring Snowflake

Refer to the Snowflake documentation about working with S3-compatible storageExternal LinkThis link leads to an external website and will open in a new tab for details on how to access your Files.com site from Snowflake.

The bucket name of your Files.com site will always be default.

The endpoint for your Files.com site is s3-<my site>.files.com where "<my site>" is replaced with your custom subdomain.

Use your Files.com S3-Compatible Endpoint credentials when configuring your Snowflake stage. For example:

CREATE STAGE my_files_dot_com_stage
  URL = 's3compat://default/path/to/folder/'
  ENDPOINT = 's3-<my site>.files.com'
  CREDENTIALS = (AWS_KEY_ID = 'your_access_key_id' AWS_SECRET_KEY = 'your_secret_access_key')

Verify that Snowflake can successfully load and unload data filesExternal LinkThis link leads to an external website and will open in a new tab from your Files.com folder before putting the integration into production.

Troubleshooting

Most issues are caused by incorrect access permissions. Make sure that the S3-Compatible Endpoint access key being used by Snowflake, and its associated user, has the correct permissions to the target folder, including "Read" permissions at a minimum.

Make sure that the folder path specified in the URL of your Snowflake CREATE STAGE command exactly matches the path in your Files.com site and is prefixed with the bucket name (default) of your Files.com site.