StudentSimEval

Headlines · 1

1. 7d
   Microsoft Research unveils StudentSim student simulators for AI tutoring

   Microsoft Research introduced StudentSim, a research system that trains personalized AI student simulators from public, de-identified learner records, with each simulator adapted to one student's data, to evaluate and improve AI tutors before testing with real learners. Alongside it, the team released StudentSimEval, an evaluation protocol that measures behavioral fidelity (whether a simulator matches a specific student's responses) and guidance responsiveness (whether it updates after tutor guidance) across chess, second-language English writing and mathematics. Microsoft Research reports that a tutor trained with StudentSim as its reward source reached 90.5% accuracy in a blind human chess-expert evaluation, versus 75.7% for a no-reinforcement-learning baseline and 71.6% for a GPT-5.4 reward condition; the paper and code are public, but StudentSim is not a product, is not deployed in classrooms and does not replace studies with real learners.

   Microsoft Research Blog · 🔥 0

Experience and discussion from the community

Share my StudentSimEval experienceAsk about StudentSimEval