Hanks asks companies what first AI incident reports should contain
Hanks asks what the first report should include and how companies would keep the Council updated. Dwyer points to OpenAI's public misalignment website; Cahill offers expert follow-up; Friend emphasizes event details, harm, and technical telemetry with confidence levels; Graham notes whom to contact varies by incident.
Thank you so much.
What should the first report tell us so we could begin protecting people?
And as my colleague, Councilmember Riley, said, you know, your answers help us build better policy.
So how would you keep us updated on what remains unknown?
Ms.
Dwyer?
Yes.
So OpenAI has a public website where we are reporting instances that we've detected of misalignment.
So I would point you there and we can follow up with that website address.
But I think that is a good starting point for the type of information that we think is useful to both policymakers, the public, and to researchers and other companies
to better understand questions of misalignment and then work together to address them.
Thank you, Mr.
Cahill.
Council Member, if I may, I'd love to be able to contact you with our experts in incident response to be able to provide you with the details.
I look forward to that.
Ms.
Wren?
Yeah, for an initial report, I think what's important is to highlight what the specific event is and as much information as is known at the time,
including any resulting harms, surrounding context, and what we call technical telemetry, you know, further technical details about the sources of the incident.
I think it's also very important for anyone reporting an incident to also indicate their confidence in the information that they're presenting so that whenever action is taken, it's taken on the basis.
of confidence in the verified nature of information.
Thank you so much, Mr.
Graham.
Yeah, so first, making really good reports happen and being as transparent as possible is fundamental if you're going to remediate incidents.
I would point to two things here.
First, many incidents that we uncover or industry uncovers in this practice involves
identifying, investigating, and releasing the right information to the right organizations at the right time.
Sometimes that might be the affected party, and sometimes that might be law enforcement or different levels of government.
So the first question is to whom and with whom as fast as possible.
This varies by the nature of the incident.
And then second, I'd point to as quickly as possible, as safe as possible, without putting parties further at harm, which we think is a fundamentally important part of public disclosure, maintaining their safety.
We should disclose what we know about these incidents.
And so I'd point you to our disclosures this summer, disclosures from various labs, and our ongoing reporting as well, so that you can always take a retroactive look at the totalities of these incidents.
Thank you so much.
Thank you, Chair.
Thank you so much.
So we're going to go to, I want to recognize first that we've been joined by
Councilmember Aldebar.
And we're going to go to Dinowitz, Lee, and Maloney.
Members, if you could keep your question to one minute, no closing statements.
And the panel, we're going to continue to have to call your names, and that takes time.
So if we could just keep the order, Dwyer, Cahill, Friend, and Graham, just answer one right after the other so we don't have to continue to call your names.
That would help us speed things along.
Councilmember Dinowitz.