Menin asks about Anthropic evaluators and third-party validation
Menin notes Anthropic's statement about independent evaluators and Musk's reply that SpaceX would probably do the same, asking whether SpaceX agrees to third-party validators with employee-level access; Castillo-Madrid cites White House accord commitments to independent external auditors and evaluators.
Thank you.
Okay.
Last night, Anthropic issued a statement that they are committed to having evaluators assess their safety practices and giving employee-like access to a team from
Model Evaluation and Threat Research Not-for-Profit Evaluation Group.
Elon Musk then replied that SpaceX would, quote, probably do the same, end quote.
Is that the position of the company?
As part of the White House accord, ongoing collaboration was part of it.
And regular meetings among companies to establish standards and best practices are very important.
This is an evolving technology and safety is at the forefront of everything we do.
So we want to make sure that we're doing everything we can to keep our system safe.
So is that a yes or a no that you would have agreed to this kind of third party validation?
Independent external evaluation was also part of the agreements and just getting partnerships with independent external auditors and evaluators to assess model capabilities, controls and safeguards.
So do you agree that for SpaceX AI, or really for any AI company, when they commit to third-party validators, they must be independent,
and that the company needs to give those validators high-level employee-level access, along with all the appropriate and necessary information so they can truly do the work to validate?
Yeah, partnership with independent external auditors and evaluators to assess safety is part of what we already have agreed on.