The Effects of Course-Integrated AI Tutoring on Student Performance and Engagement: A Randomized University Trial
Published date:
Publication: EdWorkingPapers.com
We evaluate access to a course-integrated generative AI (GenAI) tutor in a randomized controlled trial involving 2,379 undergraduate students and 30 instructors across multiple disciplines in a large U.S. public university. Among sections of the same course, tutor access reduced final grades by 0.37 standard deviations and learning management system participation by 0.90 standard deviations. Participation declines were similarly large in the full sample, and estimated academic losses were greater among first-generation students. These findings suggest that introducing an AI tutor may displace engagement with existing
Download
(4.1 MB)
More Publications
. Paiheng Xu, Jing Liu, Wei Ai. arXiv
Discipline Beyond Suspensions: Racial/Ethnic Disparities Across the Spectrum of Disciplinary Actions
. Michael L. Chrzan, Francis A. Pearman. EdWorkingPapers.com
. Heather Hill, James Malamut, Dora Demszky, Jing Liu, Samantha Booth, Hannah Rosenstein. The Learning Professional
. Francisco Lagos, Jason Saltmarsh, Jing Liu. EdWorkingPapers.com