Job Modes
The job mode controls two key components:
- Whether the job requests all historical data or moves forward incrementally
- How the records are inserted or merged into the destination
The Gravity app will set a default job mode based for the nature of the job. The user can override this default if there is a more appropriate job mode for their use case. There are three available job modes which are detailed below, including their function and purpose.
- Available for all source types; and
- Available for database destinations only.
Merge by key mode extracts the latest data from a source and merges the new records into a database destination.
- Available for all source types except for large API data tables; and
- Available for all destination types
Delete and replace mode completely refreshes the replicated data from source to destination.
- Available for file type sources; or
- Available for file type destinations
Append mode continuously adds new data to the destination without attempting to merge the records by key.
Append mode is available for file type sources because they can be less structured than API and database sources and they often do not contain a composite key. Append mode is available for file type destinations because merging records into files is not a supported operation.
Last modified 6mo ago