南京大学学报(自然科学版) ›› 2024, Vol. 60 ›› Issue (1): 76–86.doi: 10.13232/j.cnki.jnju.2024.01.008

• • 上一篇    下一篇

知识情境感知的深度知识追踪模型

蒲杰, 张所娟(), 陈卫卫   

  1. 陆军工程大学指挥控制工程学院,南京,210023
  • 收稿日期:2023-09-27 出版日期:2024-01-30 发布日期:2024-01-29
  • 通讯作者: 张所娟 E-mail:suojuanzhang@aeu.edu.cn
  • 基金资助:
    国家自然科学基金(62207031);全国教育科学国防军事教育学科“十四五”规划研究课题(JYKY?D2022013)

Knowledge context⁃aware deep knowledge tracing model

Jie Pu, Suojuan Zhang(), Weiwei Chen   

  1. College of Command & Control Engineering,Army Engineering University of PLA,Nanjing,210023,China
  • Received:2023-09-27 Online:2024-01-30 Published:2024-01-29
  • Contact: Suojuan Zhang E-mail:suojuanzhang@aeu.edu.cn

摘要:

知识追踪通过学习者历史作答数据动态追踪学习者的认知状态并预测他们未来的答题表现,然而,现有的知识追踪模型通常只利用试题中考查的知识点来表征,没有考虑试题本身蕴含的重要知识情境特征,这限制了模型的效果.此外,和融合教育先验的认知诊断方法相比,知识追踪模型的可解释性略有不足.为了解决上述问题,提出一种知识情境感知的深度知识追踪模型,通过知识情境表征模块来获取试题深层次的知识权重、试题难度等知识情境特征.在知识聚合模块中,模型将知识权重嵌入学习者面向试题的作答能力的计算,最后,在学习预测模型中引入猜测和失误因素,通过认知诊断模型来优化实际场景中的预测表现,进一步提高模型的预测性能.和现有方法相比,提出的模型在试题层级上取得了更好的预测结果,同时体现了模型可解释性方面的优势.

关键词: 知识追踪, 知识情境感知, 知识权重, 试题难度, 认知状态

Abstract:

Knowledge tracing aims to track learners' cognitive states dynamically and predict their future performance based on their historical response data. However,existing knowledge tracking models usually only utilize the knowledge concepts representing the test without considering the critical knowledge contextual features contained in the test itself,which limits the effect of the model. Moreover,compared to cognitive diagnosis methods that incorporate educational priors,the interpretability of knowledge?tracing models is inadequate. This paper proposes a knowledge context?aware deep knowledge tracing model to address these issues. The model includes a knowledge context representation module to capture deep?level knowledge weights,question difficulty,and other contextual features. In the knowledge aggregation module,the model embeds the knowledge weights into the computation of learners' abilities toward specific questions. Lastly,in the learning prediction model,the factors of guess and error are introduced,and the predictive performance in real?world scenarios is optimized through a cognitive diagnosis model to further improve the model's predictive performance. Compared to existing methods,the model proposed in this paper achieves better prediction results at the question level and demonstrates advantages in model interpretability.

Key words: knowledge tracing, knowledge context?aware, knowledge weight, question difficulty, cognitive state

中图分类号: 

  • TP18

图1

融合知识权重的知识追踪示意图"

图2

知识情境感知的深度知识追踪模型框架图"

表1

预处理后的数据集的统计信息"

统计信息ASSIST2009Algebra2006Program
学习者数307995719165
试题数1767112924070
知识数12356481
作答记录2714681816860212684

表2

各模型在学习者学习表现预测上的性能对比"

模型ASSIST2009Algebra2006
AUCACCAUCACC
KCA⁃DKT0.81800.77380.83370.8624
BKT0.70610.70450.73530.8351
DKVMN0.74830.72930.79130.8440
DKT_Q0.69600.68070.74840.8249
DKT_KC0.76480.74010.79180.8478
DIRT_40.74870.72980.75400.8375
DNeuralCDM0.78380.74710.81140.8525
AKT0.80470.75680.80220.8519
SAINT0.76490.71790.78340.8359

表3

KCA?DKT和DIRT_4模型在Program数据集上的预测性能对比"

AUCACC
DIRT_40.85800.8747
KCA⁃DKT0.89880.9106

表4

KCA?DKT及各变体模型的相关设置"

模型知识情境

猜测和失误

因子

知识权重试题难度
KCA⁃DKT
KCA⁃DKT_1
KCA⁃DKT_2
KCA⁃DKT_3
KCA⁃DKT_4
KCA⁃DKT_5

图3

KCA?DKT及其变体模型在消融实验中的预测性能"

图4

不同学习序列长度的预测性能"

图5

ASSIST2009数据集知识追踪过程示例"

表5

学习者的学习表现预测过程"

理想作答的预测值失误因子猜测因子实际作答的预测值作答反应
0.5780.2250.0980.4890
1 Aguilera?Hermida A P. College students' use and acceptance of emergency online learning due to COVID?19. International Journal of Educational Research Open2020,1:100011.
2 Corbett A T, Anderson J R. Knowledge tracing:Modeling the acquisition of procedural knowledge. User Modeling and User?Adapted Interaction19944(4):253-278.
3 Abdelrahman G, Wang Q, Nunes B. Knowledge tracing:A survey. ACM Computing Surveys202355(11):224.
4 Piech C, Bassen J, Huang J,et al. Deep knowledge tracing. 2015,arXiv:.
5 Wang F, Liu Q, Chen E H,et al. Neural cognitive diagnosis for intelligent education systems. Proceedings of the AAAI Conference on Artificial Intelligence,202034(4):6153-6161.
6 Liang C, Ye J B, Wu Z H,et al. Recovering concept prerequisite relations from university course dependencies∥Proceedings of the 31st AAAI Conference on Artificial Intelligence. San Francisco,CA,USA:AAAI Press,2017:4786-4791.
7 Liu Y F, Yang Y, Chen X Y,et al. Improving knowledge tracing via pre?training question embeddings∥Proceedings of the 29th International Joint Conference on Artificial Intelligence. Virtual Event:International Joint Conferences on Artificial Intelligence Organization,2020:1577-1583.
8 Tatsuoka K K. Architecture of knowledge structures and cognitive diagnosis:A statistical pattern recognition and classification approach∥Nichols P D,Chipman S F,Brennan R L. Cognitively diagnostic assessment. New York,NY,USA:Routledge,1995:327-359.
9 De La Torre J. The generalized DINA model framework. Psychometrika201176(2):179-199.
10 Guo L, Bao Y, Wang Z R,et al. Cognitive diagnostic assessment with different weight for attribute:Based on the DINA model. Psychological Reports2014114(3):802-822.
11 Yang Y M, Liu H X, Carbonell J,et al. Concept graph learning from educational data∥Proceedings of the 8th ACM International Conference on Web Search and Data Mining. Shanghai,China:Association for Computing Machinery,2015:159-168.
12 Pandey S, Srivastava J. RKT:Relation?aware self?attention for knowledge tracing∥Proceedings of the 29th ACM International Conference on Information & Knowledge Management. Virtual Event:Association for Computing Machinery,2020:1205-1214.
13 Ghosh A, Heffernan N, Lan A S. Context?aware attentive knowledge tracing∥Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Virtual Event:Association for Computing Machinery,2020:2330-2339.
14 Fan X T. Item response theory and classical test theory:An empirical comparison of their item/person statistics. Educational and Psychological Measure?ment199858(3):357-381.
15 Koller D, Friedman N. Probabilistic graphical models:Principles and techniques:Adaptive computation and machine learning. Cambridge,MA,USA:The MIT Press,2009:697-716.
16 K?ser T, Klingler S, Schwing A G,et al. Dynamic Bayesian networks for student modeling. IEEE Transactions on Learning Technologies201710(4):450-462.
17 Khajah M M, Wing R M, Lindsey R V,et al. Integrating latent?factor and knowledge?tracing models to predict individual differences in learning∥Proceedings of the 7th International Conference on Educational Data Mining. London,UK:International Educational Data Mining Society,2014:99-106.
18 Yudelson M V, Koedinger K R, Gordon G J. Individualized Bayesian knowledge tracing models∥The 16th International Conference on Artificial Intelligence in Education. Springer Berlin Heidel?berg,2013:171-180.
19 Pavlik P I, Cen H, Koedinger K R. Performance factors analysis:A new alternative to knowledge tracing∥Proceedings of 2009 Conference on Artificial Intelligence in Education:Building Learning Systems that Care:From Knowledge Representation to Affective Modelling. Brighton,UK:IOS Press,2009:531-538.
20 Vie J J, Kashima H. Knowledge tracing machines:Factorization machines for knowledge tracing. 2018,arXiv:.
21 Nakagawa H, Iwasawa Y, Matsuo Y. Graph?based knowledge tracing:Modeling student proficiency using graph neural network∥2019 IEEE/WIC/ACM International Conference on Web Intelligence. Thessaloniki,Greece:Association for Computing Machinery,2019:156-163.
22 Zhang J N, Shi X J, King I,et al. Dynamic key?value memory networks for knowledge tracing∥Proceedings of the 26th International Conference on World Wide Web. Perth,Australia:International World Wide Web Conferences Steering Committee,2017:765-774.
23 魏思,沈双宏,黄振亚,等. 融合通用题目表征学习的神经知识追踪方法研究. 中文信息学报202236(4):146-155.
Wei S, Shen S H, Huang Z Y,et al. Integrating general exercises representation learning into neural knowledge tracing. Journal of Chinese Information Processing202236(4):146-155.
24 Feng M Y, Heffernan N, Koedinger K. Addressing the assessment challenge with an online system that tutors as it assesses. User Modeling and User?Adapted Interaction200919(3):243-266.
25 Stamper J, Niculescu?Mizil A, Ritter S,et al. Algebra 2006?2007. Development data set from KDD cup 2010 educational data mining challenge. http://pslcdatashop.web.cmu.edu/KDDCup,2010.
26 Liu Q, Huang Z Y, Yin Y,et al. EKT:Exercise?aware knowledge tracing for student performance prediction. IEEE Transactions on Knowledge and Data Engineering202133(1):100-115.
27 Wang F, Huang Z Y, Liu Q,et al. Dynamic cognitive diagnosis:An educational priors?enhanced deep knowledge tracing perspective. IEEE Transactions on Learning Technologies202316(3):306-323.
28 Choi Y, Lee Y, Cho J,et al. Towards an appropriate query,key,and value computation for knowledge tracing∥Proceedings of the 7th ACM Conference on Learning @ Scale. Virtual Event:Association for Computing Machinery,2020:341-344.
[1] 段建设, 崔超然, 宋广乐, 马乐乐, 马玉玲, 尹义龙. 基于多尺度注意力融合的知识追踪方法[J]. 南京大学学报(自然科学版), 2021, 57(4): 591-598.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!