Hanif questions administration on HRA bias and DCWP complaint resources

Okay, no worries.

I have a question first for Deputy Commissioner Milstein.

How does OTI ensure that the automated pre-screening tools and fraud detection algorithms used by the HRA do not create disparate impacts or algorithmic bias against low-income applicants?

And then a question I have for Commissioner Levine.

The testimony indicated that DCWP supports a complaint process, but you all raised concerns about staffing and expertise.

What specific resources would you need to investigate AI complaints effectively, and what protections can New Yorkers rely on while that capacity is being built?

Sure, well thank you, Councilmember.

I can start.

And I want to be clear, AI complaints can take many different flavors.

If we hear from a worker who tells us they believe their pay was incorrect, maybe they didn't hit the minimum pay rate because of an algorithm, that is something we can fully address.

If we have someone like Jacob Coxon come to us and say that Anthropic is developing models that could

lead to catastrophic consequences, that is not something we have the capacity to do.

So what we said in our testimony is the New York Attorney General already has an internet bureau set up.

They've already put out a call for whistleblowers.

I believe they already have staff capable of processing these complaints.

We'd be very happy to work with the council to make sure complaints get to the AG.

As the speaker has said, thousands of these AI employees work right here in the five boroughs.

They know that these companies are making reckless decisions in pursuit of profits.

We do want to make sure that these employees have a place to go.

And if they come to us and it's not something we can handle, we'd want to work with the state to make sure those complaints can be addressed adequately.

But right now, is the city working with the AG's office, or is that a relationship that's not formalized?

We have a very close relationship with the AG's office.

We speak constantly.

I ask you to repeat the question about HRA.

Yes, absolutely.

So it's basically trying to understand our automated pre-screening tools, because I understand that humans are not checking all of the applications.

There's some level of automated algorithmic...

Formula that is determining how applicants get pooled when it comes to public benefits.

So I'm curious if how OTI ensures that automated pre-screening tools, fraud detection algorithms used by HRA are not creating disparate impacts or bias.

Thank you for the question.

We really share a concern about the bias and impacts on not only workers, but on New Yorkers.

Because this is really detailed and specific, though, I do want to make sure to check back with HRA and make sure I've got the details of this one correct.

So we'll come back to you on that for sure.

Appreciate it.

Thank you so much.

Councilman, I just wanted to follow up on one point you had about potential resource impacts.

I think on that particular issue, we had identified very preliminarily of 14 lines for approximately 1.2 million.

Wait, could you repeat that one more time?

14 lines for approximately 1.2 million.

But again, that's a very preliminary estimate, and we work on the council with the bill for a final version.

Thank you.