ACM Transactions on Information Systems · 2024 · 15 citations · 31 references
ComputingComputer ScienceEducational TechnologyKnowledge CaptureKnowledge RepresentationMachine LearningDeep LearningKnowledge AcquisitionKnowledge TracingAttentionAttention MechanismsFine-grained Knowledge State ModelingLocality ConstraintsPredictive Model PerformancePredictive PerformancePredictive Performance EvaluationTransformer-based Knowledge Tracing
Knowledge tracing models based on deep learning can achieve impressive predictive performance by leveraging attention mechanisms. However, there still exist two challenges in attentive knowledge tracing (AKT): First, the mechanism of classical models of AKT demonstrates relatively low attention when processing exercise sequences with shifting knowledge concepts (KC), making it difficult to capture the comprehensive state of knowledge across sequences. Second, classical models do not consider stochastic behaviors, which negatively affects models of AKT in terms of capturing anomalous knowledge states. This article proposes a model of AKT, called Enhancing Locality for Attentive Knowledge Tracing (ELAKT), that is a variant of the deep KT model. The proposed model leverages the encoder module of the transformer to aggregate knowledge embedding generated by both exercises and responses over all timesteps. In addition, it uses causal convolutions to aggregate and smooth the states of local knowledge. The ELAKT model uses the states of comprehensive KCs to introduce a prediction correction module to forecast the future responses of students to deal with noise caused by stochastic behaviors. The results of experiments demonstrated that the ELAKT model consistently outperforms state-of-the-art baseline KT models.
31
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
WaveNet: A Generative Model for Raw Audio
Aäron van den Oord, Sander Dieleman, Heiga Zen et al. · arXiv (Cornell University) · 2016 · 3.6K citations · Full text
Computing, Musicology, Acoustics +16
A Decomposable Attention Model for Natural Language Inference
Ankur P. Parikh, Oscar Täckström, Dipanjan Das et al. · 2016 · 1.4K citations · Full text