Job Modes

The job mode controls two key components:
Whether the job requests all historical data or moves forward incrementally
How the records are inserted or merged into the destination
The Gravity app will set a default job mode based for the nature of the job. The user can override this default if there is a more appropriate job mode for their use case. There are three available job modes which are detailed below, including their function and purpose.
Merge by key
Available for all source types; and
Available for database destinations only.
Merge by key mode extracts the latest data from a source and merges the new records into a database destination.
When to use this mode?
How is the data fetched?
How is the data merged?
Delete and Replace
Available for all source types except for large API data tables; and
Available for all destination types
Delete and replace mode completely refreshes the replicated data from source to destination.
When to use this mode?
How is the data fetched?
How is the data merged?
Append
Available for file type sources; or
Available for file type destinations
Append mode continuously adds new data to the destination without attempting to merge the records by key.
Append mode is available for file type sources because they can be less structured than API and database sources and they often do not contain a composite key. Append mode is available for file type destinations because merging records into files is not a supported operation.
When to use this mode?
How is the data fetched?
How is the data merged?

Update Jobs

Next - Orchestration

Metadata

Last modified 2mo ago

Copy link

Outline

Merge by key

Delete and Replace

Append