Coxon urges transparency, safety, and slowing frontier AI
Coxon says most code is now written by AI and unchecked, and warns humans in charge will not understand what is happening. He recommends companies be far more transparent, take safety seriously, and slow frontier AI development until it can be confident the technology is safe.
Once AI research is automated, humans will be much further out of the loop than we are today, and today is already not great.
I can tell you firsthand that the majority of the code is now written by AI, and people do not check it that carefully anymore.
Recently, researchers have found swarms of rogue AI internets on the internet that OpenAI was not even aware of.
Now imagine an AI company where nearly all the work is done by AIs and progress is going faster.
The humans in charge will see results and read AI-written summaries, but they won't really understand what is going on or how to fix it.
Handing over that much responsibility while we can't control the AIs would be deeply irresponsible, and we are on track to do it.
The companies need to be far more transparent with the public and independent experts.
They need to take safety much more seriously than they have.
And we should slow down frontier AI development until we can be confident that it's safe.
Thank you.