Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
TokenMonster: Ungreedy tokenizer, outperforming tiktoken by 35%
github.com/alasdairforsythe
10 points
tosh
3 years ago
No comment yet
TokenMonster: Ungreedy tokenizer, outperforming tiktoken by 35% | Heykuki News