Arguably, since OpenAI released the o1 models, LLMs are now 'smarter' than the average human when measured by IQ (I'm going by this study [0] which sets o1 at a 120 IQ).

What I am trying to wrap my head around is why has this not changed our entire world much? Sure, if you live on Twitter, a lot of people made a big deal about it. But in my day to day, specially when offline, nothing seems to have changed. In fact, I don't think most people are even aware that a computer is now smarter and cheaper than them and it's widely available via API.

Am I exaggerating things here? It almost feels like the world has not caught up to the latest technology. Does this happen with every new tech? Is this period basically a huge opportunity for early adopters? Perhaps we are missing ways to connect the o1 brain to the real world so it can have real world applications?

For context, I am deep in LLMs stuff daily as it is part of my work. I am keenly aware of the improvements that have been made in coding for example, I just don't believe this is on the same magnitude as 'AI is now smarter than the average human'.

The other side of this argument is that the LLMs are not that good, and they just test high because the questions are part of the training data, and in fact they cannot adapt and learn on the spot the way humans can (which I believe is the point of the ARC prize [1]). Another counter-argument might be that it's just too early?

Would love to hear what you have to say. Tell me how I'm wrong, or tell me how you think AI has already materially changed our world in a big way.

[0] - https://trackingai.org/IQ

[1] - https://arcprize.org/