the bytes that compose the source code that will be lexed.
the lexer configuration to use.
the string interning cache for de-duplicating identifiers and other token text.
See Implementation