Interface BaseToken

Base token properties shared by all token types.

This is the common structure for unified field tokens. The delimiter property indicates what delimiter follows this field.

interface BaseToken {
    delimiter: Delimiter;
    delimiterLength: number;
    value: string;
}

Properties

delimiter: Delimiter

What delimiter follows this field

delimiterLength: number

Length of the delimiter in characters (1 for comma/LF/CR, 2 for CRLF, 0 for EOF)

value: string

The field value