Google BigQuery
Last updated
Was this helpful?
Last updated
Was this helpful?
To connect BigQuery to Gravity, you need the following:
A BigQuery account or a Google Apps account
Gravity account owner permission to add destinations
Go to your Google Cloud Console's .
Create a Service Account - See and save the Private key (JSON) for your service account.
Find your Project ID and make a note of it. Go back to the IAM & admin tab, and go to the .
Select + Add.
In the New Members field, enter the name of the Service Account you created in Step 2, which is the entire email address.
Click Select a role > BigQuery > BigQuery User.
Set bucket access control
In the GCP console, set the for the bucket to Fine-grained
Assign permissions to service account
You must give the service account Storage Object Admin permission for the bucket, so that it can read and write the data from the bucket.
Select the bucket you want to use.
Go to Permissions and then click Add Members.
In the Add members window, enter the Service Account name
From the Select a role dropdown, select Storage Object Admin.
Set the life cycle of objects in the bucket
You must set a lifecycle rule so that data older than one day is deleted from your bucket.
In the list, find the bucket you are using for Gravity, and in the Lifecycle rules column, select its rules.
Click Add rule. A detail view will open.
In Select object conditions, select Age and enter 1.
Click Continue.
In Select action, select Delete.
Click Continue and then click Save.
Choose Service Account Key file
Insert Service Account Email
Insert Project Name
Set Timeout
Click Save, Test, and Publish
Test checks connectivity to BigQuery and permission to create datasets and tables on your BigQuery warehouse.
create a dataset to check if we have bigquery.datasets.create
permissions on your data warehouse.
create a table in the dataset (bigquery.tables.create
permissions)
In your Google Cloud Console, go to see the list of buckets in your current project.
In your Google Cloud Console, go to see the list of buckets in your current project.