1. Component library
  2. Transform
  3. Date and time
  4. Filter
  5. Capture changed records

Capture changed records

Include only records that have changed since the last time you ran the job. This filter assumes a field containing the timestamp or a number field of the latest change for each record, and stores the greatest encountered value in order to update the filter's future state.

Filter Query optimizer Concurrent

Filter outcomes

  • VALID

  • INVALID

Configured properties

  • Capture state file

    A file used to persist and load the latest state of this data capture component.

    Resource Required

  • Capture state identifier

    A custom identifier for this captured state. If omitted, the name of the 'Last modified column' will be used.

    String Optional

  • Last modified column

    Column containing the last modification timestamp or date or number.

    InputColumn<Object> Required