[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]
Information Science and Engineering

Knowledge tracing model with integrating exercise feature information cross-attention mechanism

  • Yifei ZHANG ,
  • Kaijun GUAN ,
  • Jiajin ZHANG
Expand
  • College of Computer Science,Shenyang Aerospace University,Shenyang 110136,China

Received date: 2024-01-04

  Online published: 2024-05-29

Abstract

Tracing learners’mastery of knowledge is a pivotal research direction in the realm of wisdom education.Traditional deep knowledge tracing methods predominantly focus on recurrent neural networks,facing challenges such as the lack of interpretability and handling long sequence dependencies.Additionally,many methods overlook the influence of learner characteristics and exercise feature on experimental results.Addressing these issues,a cross-attention mechanism knowledge tracing model was proposed.The model integrated knowledge points and exercise feature information to obtain a question feature embedding module.Subsequently,improvements were made to the attention mechanism based on learner responses,resulting in a dual attention mechanism module.To account for real exercise-solving situations,a guess-error module based on attention mechanism was introduced.firstly,the model took in exercise features information,obtaining a learner response with integrating exercise information through the exercise features embedding module.Following processing by the guess-error module,authentic learner responses were derived.Finally,the prediction module yielded the probability of a learner answering correctly in the next instance.Experimental results demonstrate that the cross-attention knowledge tracing model,incorporating exercise features,outperform the traditional deep knowledge tracing (DKT) model,with 3.13% increase in AUC and 3.44% increase in ACC.This model proves effective in handling long sequence dependencies while exhibiting enhanced interpretability and predictive performance.

Cite this article

Yifei ZHANG , Kaijun GUAN , Jiajin ZHANG . Knowledge tracing model with integrating exercise feature information cross-attention mechanism[J]. Journal of Shenyang Aerospace University, 2024 , 41(2) : 47 -56 . DOI: 10.3969/j.issn.2095-1248.2024.02.006

[an error occurred while processing this directive]
1
Boltz L O Yadav A Dillman B,et al.Transitioning to remote learning:lessons from supporting K‐12 teachers through a MOOC[J].British Journal of Educational Technology202152(4):1377-1393.

2
Corbett A T Anderson J R.Knowledge tracing:modeling the acquisition of procedural knowledge[J].User Modeling and User-adapted Interaction19944(4):253-278.

3
Shen S G Chen E Liu Q,et al.Monitoring student progress for learning process-consistent knowledge tracing[C]//Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining.Singapore:ACM,2021:1452-1460.

4
Yudelson M V Koedinger K R Gordon G J.Individualized Bayesian knowledge tracing models[C]// /International Conference on Artificial Inte-

lligence in Education.Heidelberg:Springer,2013:171-180.

5
Cai L Choi K Hansen M,et al.Item response theory[J].Annual Review of Statistics and Its App-lication2016(3):297-321.

6
Cen H Koedinger K Junker B.Learning factors analysis:a general method for cognitive model evaluation and improvement[C]//International Conference on Intelligent Tutoring Systems.Heidelberg:Springer,2006:164-175.

7
Pavlik Jr P I Cen H Koedinger K R.Performance factors analysis:a new alternative to knowledge tracing[C]//Proceedings of the 2009 Conference on Artificial Intelligence in Education.Heidelberg:IOS Press,2009:531-538.

8
Lindsey R V Shroyer J D Pashler H,et al.Improving students’long-term knowledge retention through personalized review[J].Psychological Science201425(3):639-647.

9
Vie J J Kashima H.Knowledge tracing machines:factorization machines for knowledge tracing[C]//Proceedings of the AAAI Conference on Artificial Intelligence.Hawaii:AAAI,2019:750-757.

10
Choffin B Popineau F Bourda Y,et al.DAS3H:modeling student learning and forgetting for optimally scheduling distributed practice of skills[EB/OL].(2019-05-14)[2023-08-23].

11
Piech C Bassen J Huang J,et al.Deep knowledge tracing[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems:Volume 1.Montreal:ACM,2015:505-513.

12
Zhang J Shi X King I,et al.Dynamic key-value memory networks for knowledge tracing[C]//Proceedings of the 26th International Conference on World Wide Web.Perth:ACM,2017:765-774.

13
Pandey S Karypis G.A self-attentive model for knowledge tracing[EB/OL].(2019-07-16) [2023-08-27].

14
Xiao Y Xiao R Huang N,et al.Knowledge tracing based on multi-feature fusion[J].Neural Computing and Applications202335(2):1819-1833.

15
Liu Q Huang Z Yin Y,et al.Ekt:exercise-aware knowledge tracing for student performance prediction[J].IEEE Transactions on Knowledge and Data Engineering201933(1):100-115.

16
Yeung C K Yeung D Y.Addressing two problems in deep knowledge tracing via prediction-consistent regularization[C]//Proceedings of the Fifth Annual ACM Conference on Learning at Scale.London:ACM,2018:1-10.

17
Minn S Yu Y Desmarais M C,et al.Deep know-ledge tracing and dynamic student classification for knowledge tracing[C]//2018 IEEE International Conference on Data Mining (ICDM).Singapore:IEEE,2018:1182-1187.

18
Nagatani K Zhang Q Sato M,et al.Augmenting knowledge tracing by considering forgetting behavior[C]//The World Wide Web Conference.San Francisco:ACM,2019:3101-3107.

19
Oya T Morishima S.LSTM-SAKT:LSTM-en-coded SAKT-like transformer for knowledge tra-cing[EB/OL].(2021-01-28)[2023-09-07].

20
Liu Y Yang Y Chen X,et al.Improving know-ledge tracing via pre-training question embeddings[EB/OL].(2020-12-09)[2023-09-13].

21
Nakagawa H Iwasawa Y Matsuo Y.Graph-based knowledge tracing:modeling student proficiency using graph neural network[C]//IEEE/WIC/ACM International Conference on Web Intelligence.Thessaloniki:ACM,2019:156-163.

22
Ding X Y Larson E C.Automatic RNN cell design for knowledge tracing using reinforcement learning[C]//Proceedings of the Seventh ACM Conference on Learning@ Scale.Dallas:ACM,2020:285-288.

Outlines

/

[an error occurred while processing this directive]