Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
1.
▲
TokenMonster: Ungreedy tokenizer, outperforming tiktoken by 35%
(github.com/alasdairforsythe)
10 points
tosh
3 years ago
discuss
2.
▲
Tokenmonster: Determine tokens to optimally represents a dataset
(github.com/alasdairforsythe)
1 point
anotherpaulg
3 years ago
discuss