Lexer now has simple look() method.

Completely rewrote the lexer, so that the whole
input is tokenized right away.  This enables us
to easily look ahead for several tokens.