ÃÛ¶¹ÊÓƵ

[Ultimate]{class="badge positive"}

Create a Google BigQuery source connection in the UI

IMPORTANT
The Google BigQuery source is available in the sources catalog to users who have purchased Real-Time Customer Data Platform Ultimate.

Read this tutorial to learn how to connect your Google BigQuery account to ÃÛ¶¹ÊÓƵ Experience Platform using the user interface.

Get started

This tutorial requires a working understanding of the following components of Experience Platform:

If you already have a valid Google BigQuery connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow.

Gather required credentials

Read the Google BigQuery authentication guide for detailed steps on gathering your required credentials.

Connect your Google BigQuery account

In the Platform UI, select Sources from the left navigation to access the Sources workspace. The Catalog screen displays a variety of sources that you can create an account with. You can select the appropriate category from the catalog on the left-hand side of your screen. Alternatively, you can find the specific source you wish to work with using the search bar.

Under the Databases category, select Google BigQuery and then select Add data.

TIP
Sources in the sources catalog display the Set up option when a given source does not yet have an authenticated account. Once an authenticated account exists, this option changes to Add data.

The sources catalog with Google BigQuery selected.

The Connect to Google Big Query page appears. On this page, you can either use new credentials or existing credentials.

Existing account

To connect an existing account, select the Google BigQuery account you want to connect with, then select Next to proceed.

The existing account page where a list of existing accounts is presented.

New account

If you are creating a new account, select New account, and then provide a name and an optional description for your new Google BigQuery account.

The new account interface in the sources workflow.

Use basic authentication

To use basic authentication, select Basic Authentication and provide values for your project, client ID, client secret, refresh token, and (optional) large results dataset ID. When finished, select Connect to source and allow for a few moments for the connection to establish.

The new account interface where basic authentication is selected.

Use service authentication

To use service authentication, select Service Authentication and provide values for your project ID, key file content, and (optional) large results dataset ID. When finished, select Connect to source and allow for a few moments for the connection to establish.

The new account interface where service authentication is selected.

Skip preview of sample data skip-preview-of-sample-data

During the data selection step, you may encounter a timeout when ingesting large tables or files of data. You can skip data preview to circumvent the timeout and still view your schema, albeit without sample data. To skip data preview, enable the Skip previewing sample data toggle.

The rest of the workflow will remain the same. The only caveat is that skipping data preview may prevent calculated and required fields from being auto-validated during the mapping step, and you will then have to manually validate those fields during mapping.

Next steps

By following this tutorial, you have established a connection to your Google BigQuery account. You can now continue on to the next tutorial and configure a dataflow to bring data into Platform.

recommendation-more-help
337b99bb-92fb-42ae-b6b7-c7042161d089