Currently, a 42U rack with A100s has roughly 20 PFLOPS of compute.[1]

If we continue with Moores Law, doubling every 18 months, we could theoretically reach 1.7 x 10^22 PFLOPS of compute in the same 42U rack in 100 years.

This equates to the power of 850 quintillion human brains.

A single rack could hypothetically hold the equivalent of 100 billion humanities' computational power in a century.

[0] https://en.wikipedia.org/wiki/Computer_performance_by_orders_of_magnitude#Petascale_computing_(1015)

[1] https://en.wikipedia.org/wiki/Nvidia_DGX#DGX_Station_A100