David Krueger warns of imminent catastrophe and immature AI safety science

Hi.

Yeah.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

Thanks so much for having this hearing and thanks for inviting me.

So my name is David Kruger.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

I'm a machine learning professor at the University of Montreal in Mila.

And I was previously an intern on the DeepMind AI safety team and a founding research director at the UK AI Security Institute.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

It was great hearing all of your questioning of the representatives of the AI companies.

I think there are a lot of really important questions that are being asked here about the ability to actually provide meaningful assurances for these systems.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

So I think we're quite probably on the verge of a catastrophe at this moment, and we should not proceed building more powerful AI systems.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

Even if there was only a 10% risk within the next 10 years of losing control, there would be more than enough reasons to stop building these systems, but I believe the risk is significantly...

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

higher and sooner.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

I've been doing deep learning and AI safety for over a dozen years, and I've seen these concerns go from fringe to mainstream.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

So we're now at a watershed moment where society is finally facing up to this problem.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

As a result, I'm more optimistic than I've been since I started worrying about AI risk over 15 years ago.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

But we still need more awareness and understanding of the situation we're in, how bad the situation is.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And the discussion is currently not where it needs to be around this.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

So people really need to have an understanding of the scope, the depth, and the urgency of the problem.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

We are talking about things up to and including human extinction or unseen levels of unemployment, concentration of power.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

We are talking about recursive self-improvement that companies say they are beginning to do right now, which could at virtually any moment lead to the creation of AI systems much smarter than people, which we have no plan for how to control or knowledge of how to.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And most importantly, these problems go deep.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

The science of AI is extremely immature.

All of the technical approaches to understanding AI systems, controlling them, and telling if they're safe are not where they need to be.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

They're far from where they need to be, despite over a decade of research that I and other, like many other researchers, have spent a long time on this.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

So, you know, we are having discussions about policy and including some more substantive policy.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

Sorry?

Your time is up.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

Thank you so much for coming in virtually.

And if you could just submit the rest of your testimony, we'd really appreciate it.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

And thank you.

to this panel for being on.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

We're going to call one more time Gary Marcus.

If Gary's on Zoom, unmute.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

All right, we're gonna move on to the next panel.

And you actually heard the deputy commissioner say that, that they can't find somebody inside of New York City to say that.

Thank you all for being here.