According to this government-commissioned report, AI at its current SOTA frontier represents an unprecedented existential risk to humanity. The best course of action, according to its authors, is for the United States to restrict compute on training models and punish open-sourcing weights with jail time.
> The new AI agency should require AI companies on the “frontier” of the industry to obtain government permission to train and deploy new models above a certain lower threshold, the report adds.
> Authorities should also “urgently” consider outlawing the publication of the “weights,” or inner workings, of powerful AI models, for example under open-source licenses, with violations possibly punishable by jail time, the report says.
> And the government should further tighten controls on the manufacture and export of AI chips, and channel federal funding toward “alignment” research that seeks to make advanced AI safer, it recommends
Do you believe, if the risks of AI are true, that this is the best course of action? Would this still allow AI development to reach a state of usefulness that has been promised for years, or will it completely destroy the momentum and lead to an AI winter?