Kokotajlo and Turner on moral alignment feasibility
Kokotajlo says training desired morality may be possible in principle but the field is far from achieving it, requiring time and robust methods that don't shatter later. Turner says he is relatively optimistic but that current breakneck development creates unsustainable risk.
Yeah, there's a lot to say on this subject.
There's a whole technical field on it.
I would say in principle, it probably is possible to train AIs to have our desired morality and to follow the law.
But we are very far from achieving this in practice.
And I would say it's not just a matter of how much of our resources we devote to it.
It's also a matter of just taking time for the science to develop and for the appropriate lessons to be learned and propagated.
And I think it's going to take years, to put it mildly.
I think that this is a very new field.
We've only had AI systems, AI agents this powerful for a few years.
And so it's going to take time to figure out how to instill the appropriate values into them in a way that's robust and that doesn't suddenly shatter and cause them to go rogue later on.
Mr.
Turner, any comments on this?
It may surprise the committee to learn that I am considered to be relatively optimistic on questions of how scientifically difficult is it to
produce a system, to grow a system that does what we want, that robustly has
the values we intend.
I think it is quite possible, but even as someone who's relatively optimistic, we can look out, see the recklessness of these companies and the breakneck speed at which we are advancing.
I think there's unsustainable risk.
Moving forward.
It's solvable, but I think we have a really good chance of not solving it.