Tokenizer functions implemented