1. Component library
  2. Transform
  3. Text
  4. Tokenizer

Tokenizer

Tokenizes a String value (splits into substrings).

Transformer Concurrent Distributed execution possible

Configured properties

  • Column

    InputColumn<String> Required

  • Delimiters

    Characters to tokenize by

    List of char Required

  • Number of tokens

    Defines the max amount of tokens to expect

    Integer Required

  • Token target

    Add tokens as columns or as separate rows?

    Choice: Columns Rows Required