De La Rosa asks panel about open weight model risks
De La Rosa asks whether the panel has concerns about open weight models and how to defend against bad actors. Nathan Sheard says open models let researchers evaluate tools, and the city should use existing laws to pursue harmful actors rather than relying on incumbents.
Thank you.
Thank you so much.
I have two questions.
The first one is for anyone in the panel who wants to take it.
Do you have concerns related to open weight models being available?
And if safety features can be eliminated from open weight models, how do you defend against bad actors who use them?
I can start.
I think one of the things I think about when we're thinking about open weight models is that we do want the ability for researchers and startups and potential future competitors to be able to
develop tools and resources and also so that we can be able to evaluate these tools and see how they really work, which is difficult with the closed models.
But then it certainly does lend the question then of how do we make sure that the proper protections are in place and I think
We have some of the tools to do that already.
When an act takes place that is potentially harmful or threatening to New Yorkers, their freedoms or physical safety,
pursue, use the laws that we have now to pursue the people who are engaging in those activities, right?
So rather than try to create, look to the incumbents, the powerful corporations to put in the protections that will keep us safe,
use the existing laws that we have to be able to keep people safe and really look at who are the people that are creating the harm and use the things that we have in place to pursue justice and protection and security there.