Gravity
Search…
Gravity
What is Gravity?
Orchestration
Job Modes
Metadata
Logs
Allowing Gravity access to data behind a firewall
Core Concepts
Sources
Files Sources
Amazon Aurora MySQL
Adobe
Airtable
Amazon Aurora PostgreSQL
Amazon DynamoDB
Amazon RDS for MySQL
Amazon RDS for PostgresSQL
Amazon RDS for SQL Server
Amazon S3
AOL
Apache Kafka
AWIN
Azure Database for MySQL
Azure Database for PostgreSQL
Azure SQL
Azure Synapse
Big Commerce
BigQuery
Bing Ads
Branch
Bugsnag
ClickUp
CSV
Derby
Elastic Search
Eventbrite
Exasol
Facebook Ads
Firebird
FreshDesk
FullStory
Github
Gmail
Google Ads
Google Analytics
Google Analytics 360
Google Campaign Manager
Google Campaign Manager (DoubleClickCM)
Google Cloud for MySQL
Google Cloud for PostgreSQL
Google Cloud for SQL Server
Google Display & Video 360
Google Doubleclick for Advertisers
Google Doubleclick for Publishers
Google Sheets
HubSpot
ICloud
Intercom
JIRA
Klaviyo
Linkedin
Magento
MailChimp
Marin
Microsoft SQL
MongoDB
MySQL
Navisite - SQL Server
Office 365
Open Exchange Rates
Oracle Database
Outlook
PostgreSQL
QuickBooks (Online)
Rakuten
Redshift
Salesforce
SAP ERP (Netweaver)
Search Ads 360
SendGrid
SharePoint
Shopify
Snapchat
SQL Server
Snowflake
Stripe
The Trade Desk
Tiktok
TSV
Twilio
Twitter Ads
Twitter Social
Vertica
Xero
Yahoo
YouTube Analytics
Zoho CRM
Setting up an E-mail Data Source
Zendesk
Amazon DocumentDB
Destinations
AWS Redshift
Azure Storage
Azure SQL
Azure Synapse Analytics
Google BigQuery
Microsoft SQL Server
PostgreSQL
Snowflake Database
About Google BigQuery
Files
Integrations
Slack
Microsoft Teams
Security
Gravity IP Addresses - Whitelisting
SSH Tunnel
Audit Log
Gravity Subprocessors
Billing
Billing
Community
Changelog
Roadmap
HAR file for troubleshooting
Powered By
GitBook
Google BigQuery
Prerequisites
To connect BigQuery to Gravity, you need the following:
A BigQuery account or a Google Apps account
Gravity account owner permission to add destinations
Setup instructions
Grant Access
1.
Go to your Google Cloud Console's
projects list
.
2.
Create a Service Account - See
Google's Creating a service account documentation
and save the Private key (JSON) for your service account.
3.
Find your
Project ID
and make a note of it. Go back to the
IAM & admin
tab, and go to the
project members list
.
4.
Select
+ Add
.
5.
In the
New Members
field, enter the name of the Service Account you created in Step 2, which is the entire email address.
6.
Click
Select a role > BigQuery > BigQuery User
.
Set bucket access control
In the GCP console, set the
access control
for the bucket to
Fine-grained
Assign permissions to service account
You must give the service account
Storage Object Admin
permission for the bucket, so that it can read and write the data from the bucket.
1.
In your Google Cloud Console, go
Storage > Browser
to see the list of buckets in your current project.
2.
Select the bucket you want to use.
3.
Go to
Permissions
and then click
Add Members
.
4.
In the
Add members
window, enter the Service Account name
5.
From the
Select a role
dropdown, select
Storage Object Admin
.
Set the life cycle of objects in the bucket
You must set a lifecycle rule so that data older than one day is deleted from your bucket.
1.
In your Google Cloud Console, go
Storage > Browser
to see the list of buckets in your current project.
2.
In the list, find the bucket you are using for Gravity, and in the
Lifecycle rules
column, select its rules.
3.
Click
Add rule
. A detail view will open.
4.
In
Select object conditions
, select
Age
and enter
1
.
5.
Click
Continue
.
6.
In
Select action
, select
Delete
.
7.
Click
Continue
and then click
Save
.
Complete Gravity setup
1.
Choose Service Account Key file
2.
Insert Service Account Email
3.
Insert Project Name
4.
Set Timeout
5.
Click
Save, Test,
and
Publish
Test checks connectivity to BigQuery and permission to create datasets and tables on your BigQuery warehouse.
create a dataset to check if we have
bigquery.datasets.create
permissions on your data warehouse.
create a table in the dataset (
bigquery.tables.create
permissions)
Destinations - Previous
Azure Synapse Analytics
Next - Destinations
Microsoft SQL Server
Last modified
2mo ago
Copy link
Outline
Prerequisites
Setup instructions