The following program works in Unix.
There is a very simple symbol table installation program.
s04.l is the lex program (only flex compiles properly).
flex s04.l; gcc lex.yy.c -ll -ly -o tokenizer
tokenizer < test gives the set of tokens