Skip to content
Council Discourse

NYC Council meetings, chaptered and linked by time.

Independent project. Not affiliated with the New York City Council.

Created by Uzair Qadir

Inspired by Vikram Oberoi's City Meetings

Q&A

Narcisse asks about medical data from X-rays and MRIs uploaded to Grok

New York City Council · Oct 16, 2026 · starts 0:48:22 · 2 min 11 sec

Council Member Mercedes Narcisse asks where medical data goes when X publicly encourages users to upload X-rays and MRIs to Grok, whether it trains models, and whether HIPAA applies; Castillo-Madrid says Grok is not a clinician and users control whether conversations train models, with private chat deleted in 30 days.

Carmen N. De La Rosa

Thank you, Councilmember Narcisse.

Mercedes Narcisse

Thank you.

Mercedes Narcisse

X publicly encouraged people to upload their X-rays and MRIs to CROC for analysis.

Mercedes Narcisse

Where does that medical data go?

Mercedes Narcisse

And if it's used to train your models, and does any HIPAA-level protection apply?

Mercedes Narcisse

You said that you didn't release models you don't believe are safe, right?

Mercedes Narcisse

Crack was promoting for reading x-rays, MRIs, and I believe when NYU radiologists tested it on the breast imaging, it did not get any single diagnosis right.

Mercedes Narcisse

Did that pass your safe, whatever the safety test we're talking about, thinking is it safe?

Mercedes Narcisse

Is it a standard we use for medicine?

Mercedes Narcisse

A drug does not go to our market, right?

Mercedes Narcisse

DA will not approve it, right?

Mercedes Narcisse

So,

Mercedes Narcisse

Because of the company, if it's not

Mercedes Narcisse

safe for us, why should AI that gives medical advice be any different?

Mercedes Narcisse

I don't understand it.

Member of the Public - Gabriela Castillo Madrid

To be clear, Grok or any of our models or SpaceX SI tools are that, are tools for the public to be able to understand the world that they live in better.

Member of the Public - Gabriela Castillo Madrid

It's not meant to be a clinician, a doctor.

Member of the Public - Gabriela Castillo Madrid

It's never going to replace the important relationships you build in person with the people that are meant to take care of your health.

Member of the Public - Gabriela Castillo Madrid

And in terms of privacy, users decide whether their raw conversations are used to train our models or not.

Member of the Public - Gabriela Castillo Madrid

So we leave that to make sure that they have a say into that.

Member of the Public - Gabriela Castillo Madrid

And they can turn it off at any times in their settings or use private chat, which is also available.

Member of the Public - Gabriela Castillo Madrid

And it's deleted from our systems within 30 days.