Graham on Anthropic's public benefit structure and held-back model
Graham says Anthropic is a public benefit corporation legally obligated to weigh safe AI, not just profit. He says Anthropic held back a model exceptionally good at exploiting software vulnerabilities and gave vetted critical infrastructure defenders access instead.
We are a public benefit corporation, which means that our board is legally obligated to weigh our mission of safe AI, not just for profit.
We take that obligation very seriously and we put it into practice.
We were among the first AI companies to publish a framework that ties how capable the model is to the safeguards it must have before release.
When one of our models proved exceptionally good at exploiting software vulnerabilities for the first time just this year, we held it back from public release.
Instead, we gave vetted critical infrastructure organizations and other defenders control to access to use it defensively.
patching flaws before attackers could exploit them.
We have stopped and redone work when something looked wrong, even if that meant conducting additional testing and training on our models before they were released.
And we've consistently called for outside oversight.
For example, we support New York's RAISE Act, and we believe strongly in the Act's transparency and reporting requirements.