Serving 70B-scale LLMs efficiently on low-resource edge devices [pdf]

Heykuki News

248 points

2 years ago

58 comments

Serving 70B-scale LLMs efficiently on low-resource edge devices [pdf] | Heykuki News