June 2022

Here’s a sample code of how to load huggingface tokenizer, add some custom tokens and save it.