If you want analysis a source code, the first step is to split source code to seperate words, operators and other special chars/strings.

1. if char is ' ' or '\t', skip it
2. if char is alphanumeric character(a-z,A-Z,0-9), record it, until not, save this word
3. other is special char