Capture changed records

Include only records that have changed since the last time you ran the job. This filter assumes a field containing the timestamp or a number field of the latest change for each record, and stores the greatest encountered value in order to update the filter's future state.

Filter Query optimizer Concurrent


  • Capture state file

    A file used to persist and load the latest state of this data capture component.

    Resource Required
  • Capture state identifier

    A custom identifier for this captured state. If omitted, the name of the 'Last modified column' will be used.

    String Optional
  • Last modified column

    Column containing the last modification timestamp or date or number.

    InputColumn<Object> Required