Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
M2 Ultra can run 128 streams of Llama 2 7B in parallel
github.com/ggerganov
268 points
behnamoh
3 years ago
173 comments
Loading...
M2 Ultra can run 128 streams of Llama 2 7B in parallel | Heykuki News