Wednesday, August 26, 2026

Evidence For the Generative AI Learning Penalty

 Here’s the abstract of a study just released June, 2026:

DP21577 The Generative AI Learning Penalty: Evidence from Chinese Secondary Education

     

Using 30 months of panel data on 26,811 Chinese students in grades 7--12, we study how generative AI affects homework productivity and learning. The data combine monthly closed-book exams, high-school and college entrance exams, and homework scores and completion time across nine subjects. We exploit staggered AI adoption in a difference-in-differences design. AI adoption raises homework scores by 18% and reduces completion time by 30%, but lowers monthly exam scores by 20% within six months. High-stakes entrance-exam scores fall by 18 and 24%, with the full penalty emerging only after about two years. The losses are largest in social science subjects, followed by STEM and languages, and are especially large for junior students, high-achieving students, and boys. The learning losses are concentrated among roughly 80% of AI users whose behavior is consistent with homework outsourcing, as indicated by exceptionally short homework completion time coupled with high homework scores. AI users who maintain similar homework completion time as non-AI users experience small learning losses.

1 comment:

  1. Anonymous8:55 AM

    The homework-score jump alongside lower closed-book exam performance is a useful reminder that faster output is not the same as retained understanding. The split between likely outsourcing users and students who kept normal completion times makes the mechanism much clearer than a blanket claim about AI. For anyone tracing the underlying study or comparing related education research, https://www.ieeecitationgenerator.space/ can help keep IEEE-style references consistent. The two-year lag on high-stakes exam effects is especially important because short pilots could easily miss it. Schools need measures that reward the reasoning process, not just polished homework submissions.

    ReplyDelete