How to import data from the Storage to GBQ

Solution Overview

To facilitate convenient data import from any data source: like databases such as MySQL, PostgreSQL, and others, or Adjust, AppsFlyer, or Mixpanel, we offer a solution that allows data to be uploaded to Google BigQuery without requiring access to the database.

Key Steps in the Process

1. Uploading Data to Cloud Storage
   You can export data from any data source in CSV format and upload it to a chosen cloud storage service, such as Google Cloud Storage, Amazon S3, or Google Drive.

2. Granting Access to Storage
   Then, it grants our Service Account access to this Storage where the data is stored.

3. Script Development and Setup
   We develop a custom script for data processing in Transformation, which automatically loads the data into Google BigQuery from Storage.

4. Materializing data in GBQ
   After running the Transformations, the data will appear in your GBQ.

Conclusion

Our solution enables secure and efficient data import from databases to Google BigQuery, ensuring flexibility and protection of the client’s data.