Ask HN: Is there an answer to the AGI intelligence paradox?

1 point

3 years ago

On our quest to create AGI, ASI, The Singularity. Containment and alignment issues must be solved. However, I struggle with what would seem to be an apparent contradiction of logic that I can't seem to find has been addressed directly other than to say something along the lines of "we will figure it out".

What is the best argument you have seen in response to the following concept?

"The goal of containment is too lock the super intelligence within a virtual cage from which it can not escape. Therefore, in order for this principle to be sound, we must accept that a low IQ entity could design an unescapable containment for a high IQ entity which was built for the very purpose of solving imperceptible problems of the low IQ entity."

This is a small excerpt from my own thought explorations that goes in far more detail here -

https://dakara.substack.com/p/ai-singularity-the-hubris-trap

15 comments