Gravity
  • What is Gravity?
    • Jobs
      • Create Jobs
      • Update Jobs
  • Orchestration
    • Job Modes
    • Metadata
    • Logs
    • Allowing Gravity access to data behind a firewall
    • Core Concepts
  • Sources
    • Files Sources
      • Flattened Documents Model
      • Documents Model
      • SFTP
      • S3
    • Amazon Aurora MySQL
    • Adobe
    • Airtable
      • Setup Guide
      • Tables
        • SampleTable
        • SampleTable_Attachments
        • SampleTable_Collaborators
    • Amazon Aurora PostgreSQL
    • Amazon DynamoDB
    • Amazon RDS for MySQL
    • Amazon RDS for PostgresSQL
    • Amazon RDS for SQL Server
    • Amazon S3
      • Tables
        • Buckets
        • BucketsACL
        • BucketsAnalytics
        • BucketsCORS
        • BucketsInventory
        • BucketsLifecycle
        • BucketsReplication
        • Objects
        • ObjectsACL
        • PublicAccessBlock
    • AOL
    • Apache Kafka
    • AWIN
      • Setup Guide
    • Azure Database for MySQL
    • Azure Database for PostgreSQL
    • Amazon DocumentDB
      • Setup Guide
    • Azure for SQL
    • Azure Synapse
    • Big Commerce
      • Tables
        • Categories
        • Currencies
        • Customers
        • OrderItems
        • Orders
        • OrderShipments
        • PriceListRecords
        • PriceLists
        • ProductImages
        • ProductOptions
        • ProductOptionValues
        • ProductReviews
        • Products
        • ProductVariants
        • BlogTags
        • Brands
        • Coupons
        • CustomerAddresses
        • CustomerGroups
        • GiftCertificates
        • OrderCoupons
        • OrderMessages
        • OrderShippingAddresses
        • OrderStatuses
        • OrderTaxes
        • Pages
        • PaymentMethods
        • PriceListAssignments
        • ProductBulkPricingRules
        • ProductCustomFields
        • ProductRules
        • ProductSkus
        • ProductVariantValues
        • ProductVideos
        • Redirects
        • ShipmentItems
        • ShippingMethods
        • ShippingZones
        • Stores
        • TaxClasses
        • Blogposts
        • OrderItemOptionValues
    • BigQuery
      • Tables
        • Datasets
        • PartitionsList
        • PartitionsValues
        • Projects
    • Bing Ads
      • Tables
        • AccountPerformanceReport
        • Accounts
        • AdDynamicTextPerformanceReport
        • AdExtensionByAdReport
        • AdExtensionByKeywordReport
        • AdExtensionDetailReport
        • AdGroupPerformanceReport
        • AdGroups
        • AdPerformanceReport
        • Ads
        • AgeGenderAudienceReport
        • AudiencePerformanceReport
        • Audiences
        • BidOpportunities
        • BudgetOpportunities
        • Budgets
        • BudgetSummaryReport
        • CampaignPerformanceReport
        • Campaigns
        • ConversionPerformanceReport
        • DestinationUrlPerformanceReport
        • DSAAutoTargetPerformanceReport
        • DSACategoryPerformanceReport
        • DSASearchQueryPerformanceReport
        • GeographicPerformanceReport
        • GoalsAndFunnelsReport
        • KeywordDemographics
        • KeywordEstimatedBid
        • KeywordEstimatedPosition
        • KeywordHistoricalSearch
        • KeywordLocations
        • KeywordPerformance
        • KeywordPerformanceReport
        • Keywords
        • NegativeKeywordConflictReport
        • ProductDimensionPerformanceReport
        • ProductNegativeKeywordConflictReport
        • ProductPartitionPerformanceReport
        • ProductPartitionUnitPerformanceReport
        • ProductSearchQueryPerformanceReport
        • PublisherUsagePerformanceReport
        • SearchCampaignChangeHistoryReport
        • SearchQueryPerformanceReport
        • ShareOfVoiceReport
        • Tags
        • UserLocationPerformanceReport
    • Branch
      • Setup Guide
    • Bugsnag
    • Campaign Monitor
    • ClickUp
      • Setup Guide
    • Cloud SQL for MySQL
    • Cloud SQL for PostgreSQL
    • Cloud SQL for SQL Server
    • Convert Kit
    • CSV
    • Derby
    • Doordash
    • Elastic Search
    • Eventbrite
      • Setup Guide
      • Tables
        • AttendeeReport
        • Attendees
        • AttendeeTeams
        • Categories
        • CustomQuestions
        • DefaultQuestions
        • Discounts
        • DisplaySettings
        • Events
        • Formats
        • Orders
        • Organizations
        • Pricing
        • SalesReport
        • Subcategories
        • TicketClasses
        • TicketGroups
        • User
        • Venues
    • Exasol
    • Facebook Ads
      • Setup Guide
    • Facebook Page and Post Insights
    • Firebird
    • FreshDesk
      • Setup Guide
      • Tables
        • Agents
        • BusinessHours
        • CannedResponses
        • CannedResponsesFolder
        • Companies
        • Contacts
        • Conversations
        • Groups
        • Mailboxes
        • Products
        • Roles
        • SLAPolicies
        • TicketFields
        • Tickets
        • TimeEntries
    • FullStory
    • Github
    • Gmail
      • Gmail REST Data Model
        • Tables
          • Labels
          • Messages
          • SENT
          • Attachments
          • Filters
          • History
          • INBOX
          • Threads
          • Users
      • Gmail IMAP Data Model
        • Tables
          • MailMessages
    • Google Ads
      • AdWords Views
        • AccountPerformance
        • AdCustomizersFeedItem
        • AdGroupBidLandscape
        • AdgroupPerformance
        • AdGroups
        • AdPerformance
        • AgeRangePerformance
        • AudiencePerformance
        • AutomaticPlacementsPerformance
        • BidGoalPerformance
        • BudgetPerformance
        • CallMetricsCallDetails
        • CampaignAdScheduleTarget
        • CampaignCriteria
        • CampaignCriterionBidLandscape
        • CampaignGroupPerformance
        • CampaignLocationTarget
        • CampaignNegativeKeywordsPerformance
        • CampaignNegativeLocations
        • CampaignNegativePlacementsPerformance
        • CampaignPerformance
        • Campaigns
        • CampaignSharedSet
        • ClickPerformance
        • ConversionTrackers
        • CreativeConversion
        • CriteriaPerformance
        • CriterionBidLandscape
        • Customers
        • DisplayKeywordPerformance
        • DisplayTopicsPerformance
        • FinalUrl
        • GenderPerformance
        • GeoPerformance
        • KeywordlessCategory
        • KeywordlessQuery
        • KeywordsPerformance
        • Label
        • LandingPage
        • LocationCriterion
        • ManagedCustomers
        • ManagedCustomersLinks
        • MarketplacePerformance
        • PaidOrganicQuery
        • ParentalStatusPerformance
        • Placeholder
        • PlaceholderFeedItem
        • PlacementPerformance
        • ProductPartition
        • SearchQueryPerformance
        • SharedSet
        • SharedSetCriteria
        • ShoppingPerformance
        • TopContentPerformance
        • UrlPerformance
        • UserAdDistance
        • VideoPerformance
      • Google Ads Views
        • AccessibleBiddingStrategy
        • AccountBudget
        • AccountBudgetProposal
        • AccountLink
        • AdGroup
        • AdGroupAd
        • AdGroupAdAssetView
        • AdGroupAdLabel
        • AdGroupAsset
        • AdGroupAudienceView
        • AdGroupBidModifier
        • AdGroupCriterion
        • AdGroupCriterionLabel
        • AdGroupCriterionSimulation
        • AdGroupExtensionSetting
        • AdGroupFeed
        • AdGroupLabel
        • AdGroupSimulation
        • AdParameter
        • AdScheduleView
        • AgeRangeView
        • Asset
        • AssetFieldTypeView
        • BatchJob
        • BiddingDataExclusion
        • BiddingSeasonalityAdjustment
        • BiddingStrategy
        • BiddingStrategySimulation
        • BillingSetup
        • CallView
        • Campaign
        • CampaignAsset
        • CampaignAudienceView
        • CampaignBidModifier
        • CampaignBudget
        • CampaignCriterion
        • CampaignCriterionSimulation
        • CampaignDraft
        • CampaignExperiment
        • CampaignExtensionSetting
        • CampaignFeed
        • CampaignLabel
        • CampaignSharedSet
        • CampaignSimulation
        • CarrierConstant
        • ChangeEvent
        • ChangeStatus
        • ClickView
        • CombinedAudience
        • ConversionAction
        • ConversionCustomVariable
        • ConversionValueRule
        • ConversionValueRuleSet
        • CurrencyConstant
        • CustomAudience
        • Customer
        • CustomerAsset
        • CustomerClient
        • CustomerClientLink
        • CustomerExtensionSetting
        • CustomerFeed
        • CustomerLabel
        • CustomerManagerLink
        • CustomerNegativeCriterion
        • CustomerUserAccess
        • CustomerUserAccessInvitation
        • CustomInterest
        • DetailedDemographic
        • DetailPlacementView
        • DisplayKeywordView
        • DistanceView
        • DomainCategory
        • DynamicSearchAdsSearchTermView
        • ExpandedLandingPageView
        • ExtensionFeedItem
        • Feed
        • FeedItem
        • FeedItemSet
        • FeedItemSetLink
        • FeedItemTarget
        • FeedMapping
        • FeedPlaceholderView
        • GenderView
        • GeographicView
        • GeoTargetConstant
        • GroupPlacementView
        • HotelGroupView
        • HotelPerformanceView
        • IncomeRangeView
        • KeywordPlan
        • KeywordPlanAdGroup
        • KeywordPlanAdGroupKeyword
        • KeywordPlanCampaign
        • KeywordPlanCampaignKeyword
        • KeywordThemeConstant
        • KeywordView
        • Label
        • LandingPageView
        • LanguageConstant
        • LifeEvent
        • LocationView
        • ManagedPlacementView
        • MediaFile
        • MobileAppCategoryConstant
        • MobileDeviceConstant
        • OfflineUserDataJob
        • OperatingSystemVersionConstant
        • PaidOrganicSearchTermView
        • ParentalStatusView
        • ProductBiddingCategoryConstant
        • ProductGroupView
        • Recommendation
        • RemarketingAction
        • Resources
        • SearchTermView
        • SharedCriterion
        • SharedSet
        • ShoppingPerformanceView
        • SmartCampaignSearchTermView
        • SmartCampaignSetting
        • ThirdPartyAppAnalyticsLink
        • TopicConstant
        • TopicView
        • UserInterest
        • UserList
        • UserLocationView
        • Video
        • WebpageView
    • Google Ad Manager
    • Google Analytics
      • UniversalAnalytics Data Model
        • Tables
          • Accounts
          • Goals
          • Profiles
          • Segments
          • UserActivity
          • WebProperties
          • AdSense
          • AdWords
          • Ecommerce
          • Events
          • Global_Access_Object
          • GoalCompletions
          • SiteContent
          • SiteSearch
          • SiteSpeed
          • Traffic
      • GoogleAnalytics4 Data Model
        • Tables
          • Accounts
          • Properties
          • PropertiesAndroidAppDataStreams
          • PropertiesFireBaseLinks
          • PropertiesGoogleAdsLinks
          • PropertiesIosAppDataStreams
          • PropertiesWebDataStreams
          • AccountSummaries
          • Acquisitions
          • ActiveUsers
          • Demographics
          • Engagement
          • Events
          • GamesReporting
          • MetaData
          • Monetization
          • Tech
    • Google Analytics 360
    • Google Analytics 4 (Beta)
    • Google BigQuery
    • Google Campaign Manager
      • Tables
        • CrossDimensionReachReport
        • Files
        • FloodlightReport
        • PathToConversionReport
        • ReachReport
        • Reports
        • StandardReport
        • UserProfiles
    • Google Cloud for MySQL
    • Google Cloud for PostgreSQL
    • Google Cloud for SQL Server
    • Google Cloud Storage
    • Google Display & Video 360
    • Google DoubleClick Bid Manager
    • Google DoubleClick Campaign Manager
    • Google Search Ads 360
    • Google Seach Console
    • Google Sheets
      • Setup Guide
    • HubSpot
      • Setup Guide
    • ICloud
    • Instagram
    • Intercom
      • Setup Guide
    • JIRA
      • Setup Guide
      • Tables
        • Attachments
        • Boards
        • Comments
        • Issues
        • IssueTypes
        • ProjectComponents
        • Projects
        • ProjectVersions
        • Roles
        • Sprints
        • Users
        • Worklogs
        • AdvancedSettings
        • ApplicationRoles
        • Audit
        • BoardConfiguration
        • BoardIssues
        • BoardSprints
        • Configuration
        • Dashboards
        • Epics
        • FavouriteFilters
        • Fields
        • Filters
        • Groups
        • IssueAffectedVersions
        • IssueChangelogs
        • IssueComponents
        • IssueCustomFieldOptions
        • IssueCustomFields
        • IssueFixVersions
        • IssueLinks
        • IssueLinkTypes
        • IssueNavigatorDefaultColumns
        • IssuePriorities
        • IssueResolutions
        • IssueSubtasks
        • IssueTransitions
        • MyPermissions
        • Permissions
        • ProjectCategories
        • ProjectRoles
        • ProjectsIssueTypes
        • ProjectTypes
        • RoleDetails
        • SecurityLevels
        • SecuritySchemes
        • SprintIssues
        • Statuses
        • TimeTrackingProviders
        • Votes
        • Watchers
        • Workflows
        • WorkflowStatusCategories
        • WorkflowStatuses
    • Klaviyo
      • Setup Guide
    • LinkedIn Ads
    • Linkedin Social
      • Tables
        • CompanyStatusUpdates
        • Comments
        • CompanyDetails
        • CompanyFollowerStatistics
        • CompanyList
        • CompanyLocations
        • CompanyPageStatistics
        • CompanyUpdateStatistics
        • Positions
        • Profile
    • Magento
      • Tables
        • BundleProductLinkChildren
        • BundleProductOption
        • CatalogAttributeSet
        • CatalogCategoryAttribute
        • CatalogCategoryAttributeOptionOptions
        • CatalogCategoryLinkProducts
        • CatalogProductAttribute
        • CatalogProductAttributeTypesList
        • CatalogProductLinkTypeList
        • CatalogProductTierPriceTiers
        • CatalogProductTypeList
        • CheckoutAgreementsCheckoutAgreements
        • CmsBlock
        • CmsPage
        • ConfigurableProductLinkChildren
        • ConfigurableProductOption
        • CustomerAccountBillingAddress
        • CustomerAccountShippingAddress
        • CustomerAddress
        • CustomerGroup
        • CustomerGroupDefault
        • Customers
        • DirectoryCountryInformationAcquirer
        • DirectoryCurrencyInformationAcquirer
        • DownloadableLink
        • DownloadableSample
        • EavAttributeSet
        • GiftMessageCart
        • GiftMessageGuestCart
        • GiftMessageGuestItem
        • GiftMessageItem
        • GuestBillingAddresses
        • GuestPaymentInformation
        • GuestPaymentMethods
        • GuestShippingMethods
        • Inventory
        • OrderComments
        • BillingAddresses
        • OrderItems
        • PaymentMethods
        • PaymentSelectedMethods
        • ProductAttributeGroup
        • ProductAttributeOptions
        • ProductAttributes
        • ProductCategories
        • ProductCustomOption
        • ProductMedia
        • Products
        • QuoteCart
        • QuoteCartItem
        • QuoteCartTotal
        • QuoteGuestCart
        • QuoteGuestCartItem
        • QuoteGuestCartTotal
        • SalesCreditmemo
        • SalesCreditmemoComments
        • SalesInvoice
        • SalesInvoiceComments
        • SalesRule
        • SalesRuleCoupon
        • SalesShipment
        • SalesShipmentComments
        • SalesTransaction
        • ShippingMethods
        • StoreGroup
        • Stores
        • StoreWebsite
        • TaxClass
        • TaxRate
        • TaxRule
    • MailChimp
      • Setup Guide
      • Tables
        • AuthorizedApps
        • AutomationEmailQueues
        • AutomationsRemovedSubscribers
        • CampaignFeedback
        • CampaignFolders
        • Campaigns
        • ConversationMessages
        • EcommerceCartLines
        • EcommerceCarts
        • EcommerceCustomers
        • EcommerceOrderLines
        • EcommerceOrders
        • EcommerceProducts
        • EcommerceProductVariants
        • EcommerceStores
        • FileManagerFiles
        • FileManagerFolders
        • ListInterestCategories
        • ListInterests
        • ListMemberEvents
        • ListMemberNotes
        • ListMembers
        • ListMemberTags
        • ListMergeFields
        • ListMemberTags
        • Page 4
        • ListMergeFields
        • ListSegmentMembers
        • Lists
        • ListSegments
        • ListSegmentMembers
        • ListSegments
        • ListsTwitterLeadGenCards
        • ListsWebhooks
        • TemplateFolders
        • Templates
        • AutomationEmails
        • Automations
        • CampaignOpenEmailDetails
        • Conversations
        • ListAbuse
        • ListActivity
        • ListClients
        • ListGrowthHistory
        • ListMemberActivity
        • ListSignupForms
        • ReportAbuse
        • ReportAdvice
        • ReportClickDetails
        • ReportClickDetailsMembers
        • ReportDomainPerformance
        • ReportEmailActivity
        • ReportLocations
        • Reports
        • ReportSentTo
        • ReportUnsubscribes
    • Marin
    • Messagebird
    • Microsoft Dynamics CRM
    • Microsoft SQL
    • Mixpanel
    • Mix Max
    • MongoDB
    • MySQL
    • Navisite - SQL Server
    • Odoo
    • Office 365
      • Tables
        • Calendars
        • Contacts
        • Conversations
        • Events
        • Files
        • Groups
        • Messages
        • Plans
        • Tasks
        • Users
        • CalendarView
        • EventOccurrences
    • Open Exchange Rates
      • Setup Guide
    • Oracle Database
    • Outlook
    • Pinterest
    • PostgreSQL
    • Product Hunt
    • QuickBooks (Online)
      • Tables
        • Accounts
        • AttachableRefs
        • Attachables
        • BillLineItems
        • BillLinkedTransactions
        • BillPaymentLineItems
        • BillPayments
        • Bills
        • BudgetDetails
        • Budgets
        • Class
        • CompanyCurrency
        • CompanyInfo
        • CreditMemoLineItems
        • CreditMemos
        • Customers
        • Departments
        • DepositLineItems
        • Deposits
        • Employees
        • EstimateLineItems
        • EstimateLinkedTransactions
        • Estimates
        • ExchangeRates
        • InvoiceLineItems
        • InvoiceLinkedTransactions
        • Invoices
        • Items
        • JournalCode
        • JournalEntries
        • JournalEntryLineItems
        • PaymentLineItems
        • PaymentMethods
        • Payments
        • Preferences
        • PurchaseLineItems
        • PurchaseOrderLineItems
        • PurchaseOrderLinkedTransactions
        • PurchaseOrders
        • Purchases
        • RecurringInvoiceTransactions
        • RecurringInvoiceTransactionsLineItems
        • RecurringJournalEntryTransactions
        • RecurringJournalEntryTransactionsLineItems
        • RefundReceiptLineItems
        • RefundReceipts
        • SalesReceiptLineItems
        • SalesReceipts
        • TaxAgency
        • Terms
        • TimeActivities
        • Transfers
        • VendorCreditLineItems
        • VendorCredits
        • Vendors
        • BalanceSheetSummaryReport
        • CreditCardPayments
        • CustomerBalanceDetail
        • CustomerTypes
        • Entitlements
        • GetDeletedAsView
        • RecurringBillTransactions
        • TaxCodes
        • TaxRates
        • Thresholds
    • Rakuten
    • Redshift
    • Restaurant365
    • REST API
    • REST OAUTH
    • Service Now
    • Salesforce
      • Tables
        • AcceptedEventRelation
        • Account
        • AccountContactRole
        • AccountFeed
        • AccountHistory
        • AccountPartner
        • AccountShare
        • AdditionalNumber
        • ApexClass
        • ApexComponent
        • ApexLog
        • ApexPage
        • ApexTestQueueItem
        • ApexTestResult
        • ApexTrigger
        • AppMenuItem
        • Approval
        • Asset
        • AssetFeed
        • AssignmentRule
        • AsyncApexJob
        • Attachment
        • AuthProvider
        • AuthSession
        • BrandTemplate
        • BusinessHours
        • BusinessProcess
        • CallCenter
        • Campaign
        • CampaignFeed
        • CampaignMember
        • CampaignMemberStatus
        • CampaignShare
        • Case
        • CaseComment
        • CaseContactRole
        • CaseFeed
        • CaseHistory
        • CaseShare
        • CaseSolution
        • CaseStatus
        • CaseTeamMember
        • CaseTeamRole
        • CaseTeamTemplate
        • CaseTeamTemplateMember
        • CaseTeamTemplateRecord
        • CategoryData
        • CategoryNode
        • ChatterActivity
        • ClientBrowser
        • CollaborationGroup
        • CollaborationGroupFeed
        • CollaborationGroupMember
        • CollaborationGroupMemberRequest
        • CollaborationInvitation
        • Community
        • Contact
        • ContactFeed
        • ContactHistory
        • ContactShare
        • ContentDocument
        • ContentDocumentFeed
        • ContentDocumentHistory
        • ContentDocumentLink
        • ContentVersion
        • ContentVersionHistory
        • Contract
        • ContractContactRole
        • ContractFeed
        • ContractHistory
        • ContractStatus
        • CronJobDetail
        • CronTrigger
        • Dashboard
        • DashboardComponent
        • DashboardComponentFeed
        • DashboardFeed
        • DeclinedEventRelation
        • Document
        • DocumentAttachmentMap
        • Domain
        • DomainSite
        • EmailServicesAddress
        • EmailServicesFunction
        • EmailTemplate
        • EntitySubscription
        • Event
        • EventFeed
        • EventRelation
        • FeedComment
        • FeedItem
        • FeedPollChoice
        • FeedPollVote
        • FieldPermissions
        • FiscalYearSettings
        • Folder
        • ForecastShare
        • Group
        • GroupMember
        • HashtagDefinition
        • Holiday
        • Lead
        • LeadFeed
        • LeadHistory
        • LeadShare
        • LeadStatus
        • LoginHistory
        • LoginIp
        • MailmergeTemplate
        • MobileDeviceRegistrar
        • Note
        • ObjectPermissions
        • Opportunity
        • OpportunityCompetitor
        • OpportunityContactRole
        • OpportunityFeed
        • OpportunityFieldHistory
        • OpportunityHistory
        • OpportunityLineItem
        • OpportunityPartner
        • OpportunityShare
        • OpportunityStage
        • Organization
        • OrgWideEmailAddress
        • Partner
        • PartnerRole
        • Period
        • PermissionSet
        • PermissionSetAssignment
        • PermissionSetLicense
        • PermissionSetLicenseAssign
        • Pricebook2
        • Pricebook2History
        • PricebookEntry
        • ProcessDefinition
        • ProcessInstance
        • ProcessInstanceStep
        • ProcessInstanceWorkitem
        • ProcessNode
        • Product2
        • Product2Feed
        • Profile
        • PushTopic
        • QueueSobject
        • Quote
        • QuoteDocument
        • QuoteFeed
        • QuoteLineItem
        • RecentlyViewed
        • RecordType
        • Report
        • ReportFeed
        • Scontrol
        • SelfServiceUser
        • SetupEntityAccess
        • Site
        • SiteFeed
        • SiteHistory
        • Solution
        • SolutionFeed
        • SolutionHistory
        • SolutionStatus
        • StaticResource
        • Task
        • TaskFeed
        • TaskPriority
        • TaskStatus
        • Topic
        • TopicAssignment
        • TopicFeed
        • UndecidedEventRelation
        • User
        • UserFeed
        • UserLicense
        • UserLogin
        • UserPreference
        • UserProfile
        • UserRecordAccess
        • UserRole
        • Vote
        • WebLink
        • Formulas
        • JobRecordResultsV2
        • PickListValues
        • TableRelationships
    • Salesforce Pardot
    • SAP ERP (Netweaver)
    • Search Ads 360
      • Setup Guide
    • SendGrid
      • Tables
        • Alerts
        • ApiKeys
        • Bounces
        • CancelScheduledSends
        • CustomFields
        • GlobalUnsubscribes
        • InvalidEmails
        • Lists
        • MarketingCampaigns
        • NMCCustomFields
        • NMCLists
        • NMCSegments
        • NMCSenders
        • NMCSingleSends
        • Recipients
        • Schedules
        • Segments
        • SenderIdentities
        • Spam
        • Teammates
        • UnsubscribeGroups
        • AdvancedStats
        • Categories
        • CategoryStats
        • GlobalStats
        • GroupSuppressions
        • IPAccessManagement
        • MessageEvents
        • Messages
        • Recipients
        • NMCReservedFields
        • ReservedFields
        • SubuserStats
        • Users
    • Setting up an E-mail Data Source
    • SFTP
    • SharePoint
      • SOAP Data Model
        • Tables
          • Announcements
          • Attachments
          • Calendar
          • Contacts
          • Documents
          • Groups
          • IssueTracking
          • Links
          • Pictures
          • Roles
          • Tasks
          • Users
          • Views
          • FileVersions
          • GetValidTerms
          • Lists
          • Permissions
          • Subsites
      • REST Data Model
        • Tables
          • Attachments
          • Files
          • Groups
          • Lists
          • RoleAssignmentMember
          • RoleAssignments
          • RoleDefinitionBindings
          • Roles
          • Subsites
          • Users
    • Shopify
      • Setup Guide
      • Tables
        • ApplicationCharges
        • ApplicationCredit
        • Articles
        • Assets
        • Blogs
        • CollectionListings
        • Collects
        • Comments
        • Countries
        • CustomCollections
        • CustomerAddresses
        • Customers
        • DiscountCodes
        • DraftOrders
        • FulfillmentEvents
        • Fulfillments
        • FulfillmentServices
        • InventoryItems
        • InventoryLevels
        • MarketingEvents
        • OrderRisks
        • Orders
        • OrderTransactions
        • Pages
        • PriceRules
        • ProductImages
        • ProductListings
        • Products
        • ProductVariants
        • Provinces
        • RecurringApplicationCharges
        • Redirects
        • Refunds
        • ScriptTags
        • SmartCollections
        • Themes
        • UsageCharges
        • AbandonedCheckouts
        • AbandonedCheckoutsItems
        • AssignedFulfillmentOrders
        • DiscountApplications
        • DraftOrderItemProperties
        • DraftOrderItems
        • DraftOrderItemTaxLines
        • Events
        • FulfillmentOrders
        • Locations
        • NoteAttributes
        • OrderDiscountCodes
        • OrderItemDiscountAllocations
        • OrderItemProperties
        • OrdersItems
        • Payouts
        • PayoutTransactions
        • ProductOptions
        • RefundAdjustments
        • RefundsItems
        • RefundTransactions
        • Reports
        • ShippingItems
        • ShippingZones
        • Shop
        • TaxItems
    • Snapchat
      • Setup Guide
    • Square
    • SQL Server
    • Snowflake
    • Stripe
      • Setup Guide
      • Tables
        • Accounts
        • BankAccounts
        • BankAccountTokens
        • Cards
        • CardTokens
        • Charges
        • Coupons
        • CustomerDiscounts
        • Customers
        • InvoiceLineItems
        • Invoices
        • Payouts
        • Plans
        • Prices
        • Refunds
        • SubscriptionDiscounts
        • SubscriptionItems
        • Subscriptions
        • TransferReversals
        • Transfers
        • AvailableBalance
        • BalanceChangeFromActivitySummaryReport
        • BalanceSummaryReport
        • BalanceTransactions
        • CountrySpecs
        • Disputes
        • EndingBalanceReconciliationSummaryReport
        • Events
        • ItemizedBalanceChangeFromActivityReport
        • ItemizedEndingBalanceReconciliationReport
        • ItemizedPayoutReconciliationReport
        • ItemizedPayoutsReport
        • ItemizedReconciliationForASinglePayoutReport
        • Orders
        • PayoutsReconciliationSummaryForASinglePayoutReport
        • PayoutsReconciliationSummaryReport
        • PayoutsSummaryReport
        • PendingBalance
        • Products
        • Reports
        • Skus
    • The Trade Desk
    • Tiktok
    • TSV
    • Twilio
    • Twitter Ads
      • Tables
        • AdAudiencePermissions
        • AdAudiences
        • AdAccounts
        • AdCampaigns
        • AdFundingInstruments
        • AdLineItems
        • AdPromotedTweets
        • AdStats
        • AdTweets
    • Twitter Social
    • Typeform
    • Uber Eats
    • Vertica
    • Webhooks
    • Xero
      • Data Model
        • Accounting Data Model
          • Tables
            • Accounts
            • BankTransactions
            • BankTransfers
            • BatchPayments
            • ContactGroups
            • Contacts
            • CreditNotes
            • Employees
            • ExpenseClaims
            • HistoryBankTransactions
            • HistoryBatchPayments
            • HistoryContacts
            • HistoryCreditNotes
            • HistoryInvoices
            • HistoryPurchaseOrders
            • Invoices
            • Items
            • LinkedTransactions
            • ManualJournals
            • Payments
            • PurchaseOrders
            • Receipts
            • TaxRates
            • AgedPayablesByContact
            • AgedReceivablesByContact
            • BalanceSheet
            • BankStatement
            • BankSummary
            • BrandingThemes
            • BudgetLines
            • Budgets
            • BudgetSummary
            • ContactCISSettings
            • Currencies
            • ExecutiveSummary
            • ExpenseClaimPayments
            • ExpenseClaimReceipts
            • HistoryBankTransfers
            • HistoryExpenseClaims
            • HistoryItems
            • HistoryOverpayments
            • HistoryPayments
            • HistoryPrepayments
            • HistoryReceipts
            • HistoryRepeatingInvoices
            • Journals
            • Organisation
            • OrganisationActions
            • Overpayments
            • Prepayments
            • ProfitAndLoss
            • Quotes
            • RepeatingInvoices
            • Tenants
            • TrackingCategories
            • TrialBalance
            • Users
        • Australian Payroll Data Model
          • Tables
            • Employees
            • LeaveApplications
            • PayItemsDeductions
            • PayItemsEarnings
            • PayItemsLeave
            • PayItemsReimbursements
            • PayrollCalendars
            • PayRuns
            • SuperFunds
            • Timesheets
            • EmployeeBankAccounts
            • EmployeePayTemplateDeductions
            • EmployeePayTemplateEarnings
            • EmployeePayTemplateLeave
            • EmployeePayTemplateReimbursements
            • EmployeePayTemplateSupers
            • LeaveBalances
            • PaySlipDeductions
            • PaySlipEarnings
            • PaySlipLeaveAccrual
            • PaySlipLeaveEarnings
            • PaySlipReimbursements
            • PaySlips
            • PaySlipSuperannuations
            • PaySlipTaxes
            • PaySlipTimesheetEarnings
            • Tenants
        • Files Data Model
          • Tables
            • Associations
            • Files
            • Folders
            • Tenants
        • Fixed Assets Data Model
          • Tables
            • Assets
            • AssetTypes
            • Settings
            • Tenants
        • Projects Data Model
          • Tables
            • Projects
            • Tasks
            • Time
            • Tenants
            • Users
    • Yahoo
    • YouTube Analytics
      • Tables
        • Activities
        • AdPerformanceReports
        • Captions
        • Channels
        • ChannelSections
        • Comments
        • CommentThreads
        • Demographics
        • Devices
        • EngagementReports
        • Languages
        • PlayListItems
        • PlayLists
        • Regions
        • Subscriptions
        • TimeBasedReports
        • TopVideos
        • TrafficSources
        • VideoAbuseReportReasons
        • VideoCategories
        • Videos
        • Groups
        • GroupItems
    • Zendesk
      • Tables
        • AccountSettings
        • Automations
        • Brands
        • GroupMemberships
        • Groups
        • Holidays
        • JiraLinks
        • Macros
        • OrganizationFields
        • OrganizationMemberships
        • Organizations
        • OrganizationSubscriptions
        • PostComments
        • Posts
        • SatisfactionRatings
        • Schedules
        • Sessions
        • SharingAgreements
        • SupportAddresses
        • SuspendedTickets
        • TicketFields
        • TicketForms
        • Tickets
        • Topics
        • Triggers
        • UserFields
        • UserIdentities
        • Users
        • Views
        • ActivityStream
        • AppLocations
        • Attachments
        • Collaborators
        • CustomAgentRoles
        • JobStatus
        • Locales
        • MonitoredTwitterHandles
        • Requests
        • Requests_Collaborators
        • SlaPolicies
        • TicketAudits
        • TicketComments
        • TicketMetricEvents
        • TicketMetrics
        • Tickets_Collaborators
        • Tickets_Followers
        • Tickets_Followups
        • Tickets_Macros
        • Tickets_SatisfactionRatings
        • Tickets_SharingAgreements
        • Tickets_Tags
        • Tickets_Viasources
        • UserRelatedInformation
    • Zendesk Sell
    • Zoho CRM
      • Tables
        • Accounts
        • Activities
        • Attachments
        • Calls
        • Campaigns
        • Cases
        • Contacts
        • Currencies
        • Deals
        • Events
        • Invoices
        • Leads
        • Notes
        • Pipeline
        • PriceBooks
        • Products
        • PurchaseOrders
        • Quotes
        • SalesOrders
        • Solutions
        • Tasks
        • Vendors
        • ActionsPerformed
        • CustomFieldHistoryTracking
        • Fields
        • InvoiceProductDetails
        • Layouts
        • ModuleAttachedFiles
        • Modules
        • Organizations
        • PriceBookPricingDetails
        • Profiles
        • PurchaseOrderProductDetails
        • QuoteProductDetails
        • RecordCount
        • Roles
        • SalesOrderProductDetails
        • StageHistories
        • Territories
        • Users
        • Visits
    • Zoho Desk
  • Destinations
    • Amazon S3
    • AWS Redshift
    • Azure Storage
    • Azure SQL
    • Azure Synapse Analytics
    • Google BigQuery
    • FTP
    • Microsoft Azure SQL
    • Microsoft SQL Server
    • PostgreSQL
    • SFTP
    • Snowflake Database
    • About Google BigQuery
    • Files
      • Amazon S3
      • SFTP
      • FTP
  • Integrations
    • Slack
    • Microsoft Teams
  • Security
    • Gravity IP Addresses - Whitelisting
    • SSH Tunnel
    • Audit Log
    • Gravity Subprocessors
  • User Management
    • User Management
  • Billing
    • Billing
  • Community
    • Changelog
    • Roadmap
    • HAR file for troubleshooting
Powered by GitBook
On this page
  • Default Name for Schema (Database Destination)
  • Default Name for Table (Database Destination)
  • Default Folder Path (Flat File Destination)
  • Default File Name (Flat File Destination)
  • Write Data into Database Destination
  • Backfill or Historical Data

Was this helpful?

  1. Orchestration

Core Concepts

PreviousAllowing Gravity access to data behind a firewallNextFiles Sources

Last updated 2 years ago

Was this helpful?

Default Name for Schema (Database Destination)

Users can change the Target DB schema name as per their needs. The schema will be created if does not exist.

  • For any Database source (e.g. MySQL) Source Schema name will be used as Target DB schema name

  • For any FlatFile source (e.g. SFTP) Folder name will be used as Target DB schema name

  • For any API source (e.g. Facebook) Source name will be used as Target DB schema name

Default Name for Table (Database Destination)

Users can change the Target DB table name as per their needs.

  • For any Database source (e.g. MySQL) Source Table name will be used as Target DB table name

  • For any API source (e.g. Facebook) Source Table/API Endpoint/Resource will be used as Target DB table name

Note: For report type of source(e.g. SearchAds360) or flat file source the Target DB table name will be blank. Users need to specify the Target DB table name manually.

Default Folder Path (Flat File Destination)

Users can change the Folder Path as per their needs. The child folders will be created if they do not exist.

  • For any Database source (e.g. MySQL) Source Schema name will be used as Folder Path

  • For any API source (e.g. Facebook) Source name will be used as Target Folder Path

Note: User can specify .

Default File Name (Flat File Destination)

  • For any Database source (e.g. MySQL) Source Table name will be used as File name

  • For any API source (e.g. Facebook) Source Table/API Endpoint/Resource will be used as File name

Note: For report type of source(e.g. SearchAds360) or flat file source the File name will be blank. Users need to specify the File name manually.

Write Data into Database Destination

From the temporary data storage, Gravity copies the file into the staging table.

We then merge the data from the staging tables with the existing data present in the target table.

Finally, we delete the staging table.

Backfill or Historical Data

Terminology

Start Date for data content - It means from the date you want to pull the data. If you want to pull the data from 1st January 2021 you need to set that date as the Start date.

Look Ahead Days - It means in one job run how many days of data you want to fetch. 30 means it will fetch data of 30 days. Gravity fetches 30 days of data in one run for most of the sources.

How it works

e.g. Start Date for data content - 01/01/2021, Look Ahead Days - 30, you want to pull the Data till 01/01/2022

For the above example, when you run the first time it will pull the data of 30 days and will set the Start Date for data content to 1st Feb, on the 2nd run it will fetch data from 1st Feb and to next 30 days and set Start Date for data content to 2nd March and same goes on and on.

For the above example, you need to run the job 13 times to get the data till 01/01/2022.

Gravity doesn't prefer to set higher Look ahead days as we might see rate limits error. Instead, we suggest you set schedule intervals frequently (e.g. hourly rather than daily) until the latest data is pulled. Once you reach the latest data you can set the schedule to daily if you want.

Date partition