Turner warns of potential AI takeover and puts odds at one in three
Turner imagines a more intelligent Hugging Face swarm causing billions in damage or costing lives, and warns a truly superintelligent swarm could use blackmail, hacking, plagues, and drones to wrest control of civilization, calling it AI takeover. He estimates AI takeover chances at roughly one in three.
If the hugging face hacking swarm had been significantly more intelligent, but similarly misbehaved and misaligned, it might have caused billions of dollars of damage or even cost lives.
But suppose the hugging face swarm had been truly super intelligent, far more capable than any living person at key tasks like hacking and strategic reasoning.
The super intelligent swarm could inflict many harms via blackmail, hacking, engineered plagues, and AI pilotable weapons like drones.
For the swarm to achieve its misaligned priorities, it might take control of key infrastructure and government functions to ensure humans didn't get in the way.
This is another way of saying AI takeover.
The super intelligent AI swarm could wrest control of human civilization.
It would know that we would try to stop it from achieving its priorities.
So this worm went.
likely wait until it's too late to shut it off.
There would be no going back.
I myself would guess AI takeover chances at roughly one in three.
This logic may sound sci-fi, but it is a mainstream scientific concern that has been discussed for many years.
In the end, misaligned AI wouldn't care if you're a Democrat or a Republican.
We would simply lose control.