Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
Exllamav2: Inference library for running LLMs locally on consumer-class GPUs
github.com/turboderp
322 points
Palmik
3 years ago
125 comments
Loading...
Exllamav2: Inference library for running LLMs locally on consumer-class GPUs | Heykuki News