AI Can Raise Scores. Education Asks for More.
What a 133-study meta-analysis says about LLMs, skills, participation, and learner agency.
What the researchers combined
The authors synthesized 133 experimental and quasi-experimental studies representing 188 effect sizes. Qualification means knowledge and skills; socialisation means participation with others; subjectification means developing autonomous judgment and responsibility.
Positive, but uneven
The clearest gains were in qualification, especially for sustained tutor-like uses. Socialisation outcomes were more variable. Subjectification gains were fragile and concentrated in small-scale, longer-term studies. Role, duration, scaffolding, and purpose shaped the results.
Limits
The studies varied substantially in age, subject, duration, LLM role, outcome, and quality. Short interventions and academic performance measures were much more common than measures of participation or agency.
The Knobee connection
Curriculum grounding supports relevant knowledge; flashcards, quizzes, and Daily Boost support repeated retrieval; Socratic tutoring asks students to reason and is intended to preserve learner agency. The meta-analysis did not test Knobee.
Knobee’s social features support motivation around individual practice; they are not a substitute for in-person or in-class collaboration. In a student survey, students responded positively to seeing classmates’ study actions in their feed and tracking progress on leaderboards. They reported being more likely to study when those signals created a positive social aura around studying.