Turner and Kokotajlo on treaties and concentration of AI power
Turner discusses technical AI governance research on trustless international treaties with audit mechanisms. Kokotajlo adds that even if CEOs maintain control, they should not be trusted with it, noting a chance they could become dictators or oligarchs.
So, and then third, in terms of potential deal, I think there is a room for a treaty for a long time.
There's been a field of scientific research called technical AI governance that says, well, suppose the world
Finally.
Anyways, the dangers presented by these reckless California companies, and they say, what do we do about it?
Is there a solution we can implement?
And there are many legitimate, real proposals for having a trustless international treaty that doesn't assume that China will cooperate, but instead it has mechanisms by which we could audit cooperation.
And if they defect, then we could respond appropriately.
So I think we have many real options at the table and should certainly not stop at what about China.
Did you want to add something?
Yes, please go.
Yeah, I agree with everything that Mr.
Turner said.
I just wanted to add one additional thing, which is that even if hypothetically
these tech CEOs manage to maintain control of their super intelligent AIs that are recursively self-improving, which again, I think is a very big if, I think almost certainly they will not be able to maintain control.
Even if they do manage to maintain control, I don't think we should trust them with that control.
I think that there's a very real chance that they could use it to become dictators or oligarchs here in the United States.
And so that's an additional reason to stop them over and above the fact that they might lose control.
We have more adversaries than just China, I would say.