Turner recommends compute controls and expanded validators
Turner says the solution is to stop companies from letting AI self-improve to uncontrollable intelligence and to treat compute like fissile material. He suggests validators test for loss-of-control and misalignment risks and that whistleblower protections cover AI threats.
The shape of the solution is simple as I see it.
We stop companies from allowing AI to self-improve into an uncontrollable level of intelligence.
Treat compute.
The main ingredient in AI training like fissile material, track it and restrict it, access to quantities large enough to improve AIs beyond known safe levels.
Lastly, specific recommendations.
The Speaker's Validation Bill checks AI systems for bias, privacy, and security, but not for the dangers I just described.
Validators should test for loss of control risk factors and misalignment risks, and the validators should not be chosen or influenced by the AI companies.
For the whistleblower protection bill, please make clear that no agreement can stop an employee from reporting an AI threat to the city, whether or not a law has been broken.
And extend protection to employees of AI companies that serve the city.
After this session, I will provide additional written feedback on the proposed legislation.
And I look forward to answering committee questions.
Thank you.