Hanif on Amira's reading comprehension evaluation data

I also want to know on the reading comprehension piece, has there been a sort of evaluation to understand if reading comprehension is improving?

I mean, I know that if I was using this in the fourth and fifth grades, I would be a much stronger reader.

I struggled with reading, and I think voices...

like hearing someone else speak to me and it would be so helpful.

So I'm also curious, how are you evaluating how this technology

Is delivering?

So currently, due to the new nature of Gen AI Empowered Tools like Amira, we don't have that longitudinal data.

As of right now, we have it in lower grades that we can share the current impact in NYC public schools.

But part of this tool evaluation framework and part of our research approach moving forward and understanding how tools are being used within our local communities, within our urban school district and the rich cultural

diversity of New York City public schools, we need to do that work.

Again, we need to see what the vendor says.

This particular vendor does have a very large research base.

They've done their own RCTs.

And what are they?

what's their kind of, like, what do they say that a student can learn reading by?

You mean like a grade level?

Yeah, like for anybody who's, for the students who are using this tool to strengthen their reading comprehension, like by what stage of the school year

are they meeting that threshold?

I can follow up with the exact data, but I'm going to tell you what I remember off the top of my head.

In terms of students, it was students using it up to three times a week for 10 minutes a day, showed about a four to five month acceleration in reading comprehension improvement compared to students who are not using it.

And that's for last school year.

So we can share that exact.

That would be great.

So you can see that.

Again, that's in the earlier, that's K-2, where, you know, we're looking at screen time, we're looking at what use, but Amir is not a student sitting in front of a computer and just interacting.

It's within the instructional program of a class.

It's within the instructional program and high-quality instructional materials at grade level of our New York City Reads program, and it's a supplemental tool.

That's not the core instruction.

The teacher is the core instruction.

When I've visited schools that are using it, it's in small group.

It's extremely limited, and it's not just one-to-one for an entire class period.

So I do want to clarify that.

I think that's fantastic.

And if there are other data sets that you all have, which I hope you're keeping track of in terms of curriculum

and information retention or improvement of a specific skill, I would love to get a hold of that.

Okay, we'll follow up with what we have.