Cloud Storage Data Transfer

1. Introduction

You can use Google Cloud Storage Transfer Service (STS) to move large datasets into our Cloud Storage environment efficiently.. STS supports transferring data from Amazon S3, on-premises storage, or other Cloud Storage buckets—even if they reside in a separate organization.

Key Benefits for Cross-Organization Transfers

• Secure: Control access through IAM roles and permissions.

• Scalable: Handles large datasets with minimal downtime.

• Automated: Schedule transfers to run periodically or on-demand.

---

2. Documentation References

For complete instructions, please see the official Google Cloud documentation. Below is a quick overview of the most relevant links:

• Storage Transfer Service Overview

  A high-level explanation of STS features and use cases, plus an introduction to cross-organization capabilities.

• Sources and Sinks

  The types of data locations you can use as sources (Amazon S3, on-premises) and the destinations STS can write to (Cloud Storage).

• Create Transfers

  Step-by-step instructions on how to configure a transfer, including selecting your source bucket, specifying our destination bucket, and configuring file filters.

• Manage Transfers

  Guidance on monitoring transfer status, troubleshooting, and updating or canceling existing transfer jobs.

• Schedule Transfer Jobs

  Instructions on setting up recurring or scheduled transfers—especially useful for regularly updated datasets.

• IAM for Cloud Transfers

  Detailed information on the roles and permissions needed to securely transfer data between different organizations.

---

Quick Tips for Cross-Organization Transfers

1. Set Up IAM Roles:

   • Ensure that both your source bucket and our destination bucket have the correct permissions for STS to read and write data.

2. Create a Transfer Job:

   • Use the Create Transfers guide to define your source (your bucket) and our destination bucket.

3. Monitor & Schedule:

   • Monitor transfer progress and logs to confirm successful data ingestion.

   • If you’ll be sending data regularly, schedule recurring transfer jobs to keep your data in sync.

---

Need More Info?

For detailed steps and troubleshooting, please refer to the Google Cloud documentation linked above. If you have any additional questions, feel free to reach out to our team.