The 'Unique key check' analyzer provides an easy way to verify that keys/IDs are unique - as it is usually expected.
The properties of 'Unique key check' are:
Table 5.4. Unique key check properties
Property | Description |
---|---|
Column | Pick the column that this analyzer should perform the uniqueness check on. |
Buffer size | The buffer represents the internal resource for sorting and comparison of keys. Having a large buffer makes the analyzer run faster and take up fewer resources on disk, but at the expense of using memory. If your job is not already memory intensive, we recommend increasing the buffer size up to 1M. |