Menin pushes Graham on exponential safety scaling
Menin presses on whether safety protocols can scale exponentially with model capability. Graham says Anthropic has publicly called for pacing the frontier and continues to strengthen responsible scaling policies.
But on that note, as the models increase exponentially, how can you ensure the public that the safety protocols are increasing exponentially as well?
We share the same concern.
I think there are a number of really important things to do here.
The first thing is transparency about what we think about safety, the evidence that we have, being transparent about disclosure of incidents.
But in addition, you've seen us publicly call for pacing the frontier.
If the models are moving very, very fast, we think that we might benefit from slowing down to have more time for safety processes.
I think these two together, as well as continuing to what we call race to the top and ever strengthen our approaches like responsible scaling policies, are the most important things to do right now.
So, I mean, you say that you want to be more transparent, but you're not really addressing the question.
I mean, the question is, can you quantify the risk of something cataclysmic happening?
And I do want to say for all four companies, and I know you're not in the chambers, but we do have a chart.
For each of your companies had instances where agents went rogue, and in each of those instances, it is not as if any of you
notified the public when those occurred.
In some instances, it was months after the fact when the public was even notified.
And in one instance, for the government of Australia, a general email was sent to them.
So this doesn't exactly increase transparency.