Connecting to Google BigQuery
  • 31 May 2022
  • 2 Minutes to read
  • Dark
    Light

Connecting to Google BigQuery

  • Dark
    Light

Article Summary

Note
This documentation is prior to May 2022.

Google BigQuery is a multi-cloud data warehouse that is used to store all data and analyze it. 

Google BigQuery is a fully-managed, serverless data warehouse that enables scalable analysis over petabytes of data. It is a Platform as a Service that supports querying using ANSI SQL. It also has built-in machine learning capabilities. 

The Service Account requires storage and BigQuery permissions. The bucket should provide storage permissions to the Service account, under the bucket’s permissions.

There are three options to connect to Google BigQuery:

  • Create a new project
  • Edit an existing project connection
  • Export data from the Export tab>Schedule run button

 Connecting to Google BigQuery when Creating a New Project

  1. Click Enrich. The Enrich page is displayed.gg
  2. Click . The Create a new project window is displayed.
  3. Type in a new project name. The project name needs to be unique.
  4. Select a use case from the drop-down. 
  5. Click Create project. The Upload a dataset window appears.
  6. Select Google BigQuery.
  7. Choose a connection name.
  8. Type in the Bucket Name
  9. Upload the service account key JSON.
  10. Click Upload. Your data is uploaded.
  11. Click Test Connection to make sure the connection is successful. A message is displayed informing you if the connection was successfully created or not. If the test connection failed, then you are unable to create a connection.
    Before creating a new connection, a Test Connection must be run. If the test failed, or a parameter was changed, the Create button will be disabled, and you need to create a new connection.


  12. After the test connection has succeeded, click Create in order to create the connection.

 Connecting to Google BigQuery When Editing a Dataset

  1. Click Enrich. The Enrich page is displayed.
  2. Create or search for a project.
  3. Click .
  4.  The Change data and edit dataset window is displayed.
  5. Click Continue. The Upload a dataset window appears.
  6. Select Google BigQuery.
  7. Choose a connection name.
  8. Type in the Bucket Name.
  9. Upload the Service Account Key JSON.
  10. Click Upload. Your data is uploaded.
  11. Click Test Connection to make sure the connection is successful. A message is displayed informing you if the connection was successfully created or not. If the test connection failed, then you are unable to create a connection.
     Before creating a new connection, a Test Connection must be run. If the test failed, or a parameter was changed, the Create button will be disabled, and you need to create a new connection.
  12. After the test connection has succeeded, click Create in order to create the connection.

Exporting Data

  1. Click Enrich. The Enrich page is displayed. 
  2. Create, search or edit a project.
  3. Click the Export >Run Recipe.
  4. The Schedule Recipe Run window is displayed.
  5. Select the input connection (optional).
  6. Select the output connection.