Now that we have finished our tokenizer, we will look at the second task: building the parse tree. Once we have that, we can ask the tree if a set of strings are a valid match or not. More precisely,…
Project 1: Tokenization
Our tokenizer will perform one task – it will take a sequence of characters and emit a sequence of tokens. We will build it using an input stream from which the source characters are fetched, and then implement specific methods…
First project: parsing
In this first project, we will look at two concepts that are vital to e.g. the compiler you use for writing programs; tokenizing and parsing. Let’s assume you work in an organization that keeps track of e.g. a large number…