Joseph questions companies on student data and early-career impact
Councilmember Rita Joseph asks whether student data is used for training, who can access chatbot conversations, and how AI impacts early-career workers. Dwyer and colleagues describe privacy defaults, opt-outs, and defer to education teams; Friend cites NYU's use of Gemini Notebook; Graham cites learning mode.
Up next, we have Councilmember Joseph, followed by P.
Sanchez, followed by Wong, Phil Wong, and then Shuang.
Thank you, Chair.
Two questions.
Several of you sell AI products directly to colleges and universities.
When students use those products, is anything they enter used to train your models?
And beyond training, who can access those conversations?
And what limit do you place on how colleges can use them, for example, for discipline, academic integrity, investigation, or student profiling?
The next one is, given that AI is already reshaping entry-level work, as we know, as is shown in this new Center for Urban Future report, what responsibility do you have to ensure these tools help students build useful
AI augmentative skills rather than automated, away the very tasks through which young people learn?
What responsibility do your companies have addressing these early career impacts and how can government help?
So to your first question on privacy, we believe that privacy is central to our mission.
We give users control over their data.
That includes the decision to opt out of training.
But all users have their data protected and private by default.
So it is separated from their names.
And again, they have the option to opt out of training and to request that their data is deleted.
On the particular question of colleges and how ChatGPT is used in colleges and education, I would like to get back to you on that.
I don't have an accurate, I don't know the answer.
And so I'd like to be able to follow up because we do believe that education is critical.
AI literacy is critical.
We've supported numerous bills at both the state and federal level supporting AI literacy.
That is both training for teachers to ensure that they can lead adoption in schools, as well as.
Improvements in curricula to make sure that students learn how to use AI safely, as well as learn core subjects that are critical to being able to use AI safely and responsibly.
To your question about jobs, we think one of the most important things that we and policymakers can do right now is to continue to collect data on the question of AI impacts to jobs
and make that data public.
We make our assessments of how people are using ChatGPT at work public.
We share that.
And we also have worked with policymakers, including supporting the Bipartisan Workforce Transparency Act
to make or to create voluntary pathways for employers to report on job impacts.
Council member, thank you very much for these questions.
In relation to colleges and universities, I would like to have the specialists at Meta who work in that area connect with you on the details.
But specifically in relation to privacy and data, this is absolutely core to everything that we do at Meta.
For example, our Muse product, you can opt out of the use of data for training and you can ask Muse to forget any information that you provide to it.
And of course, all of the data is within your control in terms of what you provide to it.
I am on the AI literacy point.
It's so important.
I actually came across a really great example from New York City and I wanted to call it out because I thought it was great.
It was called Building Minds, Building Communities, the digital empowerment by design work.
And I thought it was a really, really great example of the use of AI technologies for AI literacy and kind of a flywheel in terms of benefits there.
In terms of the entry level point, I absolutely understand the concern in relation to that.
At Meta, we believe in placing personal superintelligence into the hands of everyone and for invention, not automation.
And for.
augmentation, not replacement.
And we really believe that this will have a transformative impact in terms of enabling and empowering people to pursue their own values and direct AI towards those.
Yes, ma'am.
Similar to my colleagues, we believe users should have control over their own data.
We're not going to have outbursts from the chamber or you will be removed.
You decide.
Sorry.
Go ahead.
As I was saying, users have control over their own data across our AI surfaces
and can opt in or opt out of their data being used to train our models.
In terms of AI use in colleges, as I said earlier, we have tools for educators and administrators to take the lead in how AI is used in the classroom and used for students.
We think that colleges should be able to adapt to the needs of their student populations.
I, like Shane, was looking into how different colleges and universities in New York City
use AI and saw that NYU, for example, has a very helpful page where they go through all of the AI tools they make available to students and give them resources.
for learning both how to use the tools and then also training them in the kinds of things they can do with those tools to further their education.
I would flag that they use Gemini Notebook, which is a study guide creation tool.
So NYU is a good example, I think, of a college thinking carefully about how AI can benefit their student population.
And as to the impact on early careers, we think this is also an incredibly important area of research.
It's part of understanding the broader impacts on the economy and labor.
We recently released our own AI and Economy Atlas, which also releases data about real-world uses of AI in the economy and at jobs.
And we're hoping that continuing to add to that data set will help economists study and then develop policy recommendations for managing the labor transitions of AI.
And at Anthropic, maintaining user privacy is very core to our commitment on safety and security.
Users can choose whether or not they want their data to be used or contribute to training a model, for example.
But in addition to that, we've tried to pioneer the science of privacy-preserving safety maintenance when you need to ensure that users stay safe on the platform.
To the point of education, while it's not my area, here's what I understand.
We partner with universities.
We're very interested in this question.
There's a nifty feature in part of our partnership called Learning Mode, which allows a user or student user to interact with the model in a more discursive way that can help them think.
But in addition to this, the impacts are really important.
I think we are relatively well known for our work on studying the economic and other behavioral impacts of models.
We have a comprehensive, and I think we were the first to release this economic index, which details this.
But in addition, we've done research into how students are using models because we want to figure out how to encourage the use of models to complement the development and skill development of students.
Thank you.
Up next is Councilmember P.