Cloud Portal ONE Desktop ONE DQ&C ONE MDM ONE RDM ONE Runtime Server
User Community Service Desk Downloads

BigQuery Connection

Create a source

To connect to BigQuery:

  1. Navigate to Catalog > Sources.

  2. Select Create.

  3. Provide the following:

    • Name: The source name.

    • Description: A description of the source.

    • Deployment (Optional): Choose the deployment type.

      You can add new values if needed.

    • Stewardship: The source owner and roles. For more information, see Stewardship.

  4. Save your changes to proceed.

You do not always need to create a new data source. You can also add connections to existing sources.

Add a connection

  1. Select the Connections tab of your source.

  2. Select Add Connection.

  3. In Select connection type, choose Relational Database > BigQuery.

  4. Provide the following:

    • Name: A meaningful name for your connection. This is used to indicate the location of catalog items.

    • Description (Optional): A short description of the connection.

    • JDBC: A JDBC connection string pointing to the IP address or the URL where the data source can be reached.

      The connection string should take the form:

      `jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=<project_name>;OAuthType=0;OAuthServiceAcctEmail=<account_id>.iam.gserviceaccount.com;Timeout=3600;EnableSession=1`.

Add credentials

Only Google services account key authentication is supported.

  1. Select Add Credentials.

    • Name (Optional): A name for this set of credentials.

    • Description (Optional): A description for this set of credentials.

    • Service account key: Upload the service account key (in JSON file format) associated with the project where the Google Cloud Storage bucket you want to connect to is located.

      To learn how to create a service account and obtain the service account key from your Google Cloud project, see the official Google documentation:

  2. . If you want to use this set of credentials by default when connecting to the data source, select Set as default.

    One set of credentials must be set as default for each connection. Otherwise, DQ evaluation fails and previewing data in the catalog is not possible.

  3. Proceed with Test the connection.

Add write credentials

Write credentials are required if you want to export data to this source.

To configure these, in Write credentials, select Add Credentials and follow the corresponding step depending on the chosen authentication method (see Add credentials).

Make sure to set one set of write credentials as default. Otherwise, this connection isn’t shown when configuring data export.

Test the connection

To test and verify whether the data source connection has been correctly configured, select Test Connection.

If the connection is successful, continue with the following step. Otherwise, verify that your configuration is correct and that the data source is running.

Save and publish

Once you have configured your connection, save and publish your changes. If you provided all the required information, the connection is now available for other users in the application.

In case your configuration is missing required fields, you can view a list of detected errors instead. Review your configuration and resolve the issues before continuing.

Next steps

You can now browse and profile assets from your connection.

In Catalog > Sources, find and open the source you just configured. Switch to the Connections tab and select Import or run Term detection.

Or, to import or profile only some assets, select Browse on the Connections tab. Choose the assets you want to analyze and then the appropriate profiling option.

Was this page useful?