Journal of Educational and Behavioral Statistics · 2022 · 55 citations · 30 references
ComputingComputer ScienceEducational TechnologyArtificial IntelligenceMachine LearningMarkov Decision ProcessesAdaptive LearningDeep LearningLearner ModelingReinforcement LearningDeep Reinforcement LearningIndividualized Learning PlansMarkov Decision ModelsModel-free Reinforcement LearningQ-learningReinforcement Learning Theory
The adaptive learning problem concerns how to create an individualized learning plan (also referred to as a learning policy) that chooses the most appropriate learning materials based on a learner’s latent traits. In this article, we study an important yet less-addressed adaptive learning problem—one that assumes continuous latent traits. Specifically, we formulate the adaptive learning problem as a Markov decision process. We assume latent traits to be continuous with an unknown transition model and apply a model-free deep reinforcement learning algorithm—the deep Q-learning algorithm—that can effectively find the optimal learning policy from data on learners’ learning process without knowing the actual transition model of the learners’ continuous latent traits. To efficiently utilize available data, we also develop a transition model estimator that emulates the learner’s learning process using neural networks. The transition model estimator can be used in the deep Q-learning algorithm so that it can more efficiently discover the optimal learning policy for a learner. Numerical simulation studies verify that the proposed algorithm is very efficient in finding a good learning policy. Especially with the aid of a transition model estimator, it can find the optimal learning policy after training using a small number of learners.
30
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Statistical Theories of Mental Test Scores
William W. Rozeboom, Frederic M. Lord, Melvin R. Novick et al. · American Educational Research Journal · 1969 · 8.1K citations
Bias reduction of maximum likelihood estimates
David Firth · Biometrika · 1993 · 4.4K citations
A Rasch Model for Partial Credit Scoring
Geoff N Masters · Psychometrika · 1982 · 3.8K citations