Kokotajlo recommends transparency and slowing recursive self-improvement
Kokotajlo calls automating AI research a recipe for disaster and offers two policy recommendations: massively increase transparency into the AI industry and slow the frontier race toward recursive self-improvement, ideally banning it.
To quote Dan Selsa again, that capabilities researcher that I cited earlier, models will increasingly seem aligned even when they are not.
If the AI companies automate AI research and development process, that means they'll be putting AIs in charge of making the AIs that make the AIs that make the AIs that will transform the economy, talk to us every day, and integrate into our military.
This is a recipe for disaster.
My two policy recommendations, I'll be very brief.
One is that we need to massively increase transparency into the AI industry.
And two is basically we need to slow down the frontier AI companies race towards recursive self-improvement.
Frankly, I would say they just shouldn't be allowed to do recursive self-improvement, but at least we should slow down their ongoing process of training AIs to automate the AI research process itself.
And instead, they should be required to redirect resources towards other things, such as serving customers or beneficial deployments or other types of research.
Thank you.
Thank you very much.
And now we are going to hear from Alex Turner.
And as I wrote,
Read into the record, the council has issued a subpoena for Mr.
Turner's appearance, and we very much thank him for being here.
Mr.
Turner.