De La Rosa on AI bias, discrimination, and need for safeguards
De La Rosa warns that AI tools may profile students, surveil behavior, or make biased assumptions about abilities. She notes she joined colleagues in calling for a two-year moratorium and expresses disappointment that the Chief Privacy Officer and Office of Algorithmic Accountability are absent from the hearing.
While AI may offer potential benefits in education, its ethical use must be carefully considered.
Many tools may have bias and, as a result, discriminate against certain students or communities.
From the Technology Committee's perspective, safeguards against bias in AI, algorithms, and protecting student privacy are fundamental issues that must be addressed.
Today, we wish to discuss both how AI should fit into the curriculum and how the Department of Education
uses AI in its operations.
We need to make sure that AI supports students and teachers rather than undermining the quality of education.
We must ensure that we are preparing the next generation to thrive in this technological era while also protecting the rights and future opportunities.
Like Chair Dinowitz, I also joined my colleagues in signing on to a letter from our school communities, and we've heard from our CECs calling on a two-year moratorium.
We look forward to hearing testimonies from the Department of Education and OTI to gain insight and clarity around the many questions about AI in the classroom and the use of AI in the education system.
We also look forward to hearing from members of the public, students, families, educators, and advocates.
Unfortunately, neither the Chief Privacy Officer nor the representatives of the newly established Office of Algorithmic Accountability are here today.
However, we look forward to receiving their testimony, which we've received, and responses in writing.
As the school year is ending, I also wish to congratulate every student and teacher on completing another academic year.