Skip to main content
Center for Educational Data Science and Innovation
About Projects Public Goods Publications News Events Get Involved
About
People Funders/Partners Resources
Projects Public Goods Publications News Events Get Involved
People Funders/Partners Resources

The Effects of Course-Integrated AI Tutoring on Student Performance and Engagement: A Randomized University Trial

Home Publications The Effects of Course-Integrated AI Tutoring on Student Performance and Engagement: A Randomized University Trial
Authors: Jing Liu, Tracy Sweet, Marty Haoyuan Chen, Jonathan Engelberg, Martyn Clark, Axel Persaud, Alia Lancaster, Jeffrey Hollingsworth, Jennifer King Rice, Megan Masters
Published date:
Publication: EdWorkingPapers.com
Abstract

We evaluate access to a course-integrated generative AI (GenAI) tutor in a randomized controlled trial involving 2,379 undergraduate students and 30 instructors across multiple disciplines in a large U.S. public university. Among sections of the same course, tutor access reduced final grades by 0.37 standard deviations and learning management system participation by 0.90 standard deviations. Participation declines were similarly large in the full sample, and estimated academic losses were greater among first-generation students. These findings suggest that introducing an AI tutor may displace engagement with existing

Download
Download (4.1 MB)

More Publications

. Heather Hill, James Malamut, Dora Demszky, Jing Liu, Samantha Booth, Hannah Rosenstein. The Learning Professional

Center for Educational Data Science and Innovation
0102 Benjamin Building, University of Maryland, College Park, MD 20742
edsi@umd.edu