Where did tokenizer.json get it from?
#2
by
tianyuzhou
- opened
Can you tell me where did tokenizer.json get it from? I can't find the download links from paddle's github repository but in your hugging face repository. Did you generate it yourself?
thank you