MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPU

Heykuki News

326 points

2 months ago

57 comments

MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPU | Heykuki News