The issue is very straightforward: if AGI emerges, and if it surpasses our intelligence, we simply…

For all we know, superior AGI could already be here, in our midst. Same as my dog has no way of figuring out my level of intelligence, we…

The issue is very straightforward: if AGI emerges, and if it surpasses our intelligence, we simply wouldn't be able to recognize nor detect it. If we could, that would mean it's not superior to our intelligence.

For all we know, superior AGI could already be here, in our midst. Same as my dog has no way of figuring out my level of intelligence, we cannot figure out levels of intelligence that would be above ours.

It is sheer waste, therefore, to hypothesize about all those scenarios. Simply put, our intelligence has limitations and constraints that are innate, and there's nothing we could ever do about it (other than spontaneously evolving into some new species).

But for now, this is where we're at. Better get used to it.