Reads a sequence of modifiers (including #\- to reverse their
meaning) and returns a corresponding list of “flag” tokens. The
“x” modifier is treated specially in that it dynamically modifies
the behaviour of the lexer itself via the special variable
EXTENDED-MODE-P.