Google Analytics Real-Time Data → Google BigQuery: Create a streaming pipeline

Video: How to set up hit and session data streaming from Google Analytics to BigQuery

What you need before creating a pipeline

To use Google BigQuery and create a streaming pipeline in OWOX BI, you need a Google Cloud Platform project with activated billing.

To use the OWOX BI streaming service, you need to be subscribed to the plan Basic, Business, or Enterprise.

How to create a pipeline

To create a Google Analytics Real-Time Data → Google BigQuery pipeline, go to the Create a pipeline page and take the following steps:

Step 1: Select data source: Google Analytics


Step 2: Select type of data: User behavior data


Step 3: Provide access to Google Analytics


Step 4: Select Google Analytics property and view as the data source

Here, specify the Google Analytics view you want to gather data to. You need to have the Edit permission for this Google Analytics view.

Note that you can set up only one streaming pipeline per property.


Step 5: Provide access to Google BigQuery

Provide access to the BigQuery project where you want to gather Google Analytics data to.


Step 6: Select Google BigQuery dataset

First, select the Google BigQuery project that contains the dataset you want to gather data to. Then, select the dataset.

If needed, you can create a new dataset right here.

You can set up only one OWOX BI streaming pipeline for each BigQuery dataset. Creating several pipelines for one dataset may cause the hit data to be overwritten.



Step 7: Implement tracking code

After completing all the steps, don't forget to implement the tracking code. Find it on the created pipeline's page: Settings > JavaScript code for hit data collection.


The method of implementing the tracking code depends on your project. Here is the full list of the tracking code implementation methods.

Done. The Google Analytics Real-Time Data → Google BigQuery streaming pipeline is all set. An OWOX BI dataset with the streaming tables will appear in your BigQuery project in the first minute of the next hour. 

Please note: In OWOX BI pipeline, the maximum hit payload size is 16 KB. The hits exceeding this limit won't be processed and sent to BigQuery.
In Google Analytics, the maximum hit payload size is 8 KB (Google Analytics Docs).

Was this article helpful?
1 out of 1 found this helpful
Have more questions? Submit a request


Please sign in to leave a comment.