Brewer asks administration about AI adoption, testing, and consultants

Up next, we have Brewer, followed by Osei.

Thank you very much.

I know you talked about the Microsoft and the Adobe, but if an agency wants to begin using a new AI model, A, how do they go about it?

Number two, does the city run these models on its own data centers or only on the ones that are under control of vendor clouds?

And then if you have a problem, like there's a criteria, what is it for testing?

to identify the malicious, misaligned AI product?

And then how much does the city spend each year on outside AI consultants?

I could go on, but those are three, four questions.

I have 10 pages here.

Okay.

Thank you for the questions.

Let's see.

So...

The process.

Yeah.

Typically, when agencies want to buy software, part of the process is discussing with OTI

what they are buying and what they will be using it for, and we have a cybersecurity review process that is part of that to ensure that the

software that is either going to be bought or built will be safe.

And as my colleague has said, that would include, cybersecurity includes the typical AI concerns.

So that's process.

You had...

The next question, the clouds.

Whose clouds are they on?

Whose data centers?

Where are they?

Are you running them or is it outside vendors?

So to the best of my knowledge, there are no city agencies running their own models.

But I would like to...

It's vendor clouds, basically.

Vendor clouds, vendor clouds.

Yes, so for example, Microsoft...

Host software that agencies use.

But I'd like to follow up after the hearing to make sure I've got the exact right information for you.

Okay, and if there's something unexpected, misaligned AI product behavior, what do you do?

That is a question for my colleague, CJ Dixon.

Councilwoman, that depends on what the misaligned behavior is.

If that misaligned behavior is specifically a cyber incident, we take appropriate action based on what any cyber professional may do.

There are novel misalignments that are born of this technology that do have to be unpacked, and we look forward to working with the council as well as our partners across New York City to understand.

When those misalignments do arise unrelated to existing risks that the city already deals with, how do we actually engage with those particular novel risks?

Have you had some in the last, since you started your job?

None related to what cyber commands purview is.

And that is primarily cybersecurity issues.

We've had no misalignments related to cybersecurity that have resulted in negative consequences for the city.

from an AI model very specifically.

That sounds very, I don't know what it sounds.

How much outside AI consultant dollars are being spent?

Council member, could you clarify what you mean by AI consultants?

Yeah, how many people are you paying?

I mean, I've been doing this work a long time, so I know sort of the answer, but how much outside consultants are being paid on terms of AI?

In other words, how many people are you paying to work with you on AI issues outside vendors?

Consultants.

None that I'm aware of, but I would like to follow up with you to make sure that we have the accurate information.

So everything to do with AI is in-house, is that what you're saying?

Everything to do in terms of strategy, thought process, future, it's all in-house?

Yes.

Okay, thank you.

Thank you.