English
Related papers

Related papers: From Prediction to Application: Language Model-bas…

200 papers

Knowledge tracing (KT) is a crucial task in intelligent education, focusing on predicting students' performance on given questions to trace their evolving knowledge. The advancement of deep learning in this field has led to deep-learning…

Artificial Intelligence · Computer Science 2024-06-21 Jiajun Cui , Hong Qian , Bo Jiang , Wei Zhang

Knowledge Tracing (KT) aims to determine whether students will respond correctly to the next question, which is a crucial task in intelligent tutoring systems (ITS). In educational KT scenarios, transductive ID-based methods often face…

Artificial Intelligence · Computer Science 2024-11-05 Lingyue Fu , Hao Guan , Kounianhua Du , Jianghao Lin , Wei Xia , Weinan Zhang , Ruiming Tang , Yasheng Wang , Yong Yu

In education applications, knowledge tracing refers to the problem of estimating students' time-varying concept/skill mastery level from their past responses to questions and predicting their future performance. One key limitation of most…

Computers and Society · Computer Science 2023-03-22 Naiming Liu , Zichao Wang , Richard G. Baraniuk , Andrew Lan

Knowledge Tracing (KT) diagnoses students' concept mastery through continuous learning state monitoring in education.Existing methods primarily focus on studying behavioral sequences based on ID or textual information.While existing methods…

Artificial Intelligence · Computer Science 2026-02-27 Xingcheng Fu , Shengpeng Wang , Yisen Gao , Xianxian Li , Chunpei Li , Qingyun Sun , Dongran Yu

Data-to-text generation has recently attracted substantial interests due to its wide applications. Existing methods have shown impressive performance on an array of tasks. However, they rely on a significant amount of labeled data for each…

Computation and Language · Computer Science 2020-10-13 Wenhu Chen , Yu Su , Xifeng Yan , William Yang Wang

Knowledge tracing (KT) aims to predict students' responses to practices based on their historical question-answering behaviors. However, most current KT methods focus on improving overall AUC, leaving ample room for optimization in modeling…

Artificial Intelligence · Computer Science 2023-09-06 Moyu Zhang , Xinning Zhu , Chunhong Zhang , Feng Pan , Wenchen Qian , Hui Zhao

Adapting language models to the clinical domain through continued pretraining and instruction tuning requires costly retraining for each new model generation. We propose Cross-Architecture Proxy Tuning (CAPT), a model-ensembling approach…

Computation and Language · Computer Science 2026-04-30 Sasha Ronaghi , Chloe Stanwyck , Asad Aali , Amir Ronaghi , Miguel Fuentes , Tina Hernandez-Boussard , Emily Alsentzer

Knowledge Tracing (KT) is a fundamental component of Intelligent Tutoring Systems (ITS), enabling the modeling of students' knowledge states to predict future performance. The introduction of Deep Knowledge Tracing (DKT), the first deep…

Machine Learning · Computer Science 2025-06-17 Yiyun Zhou , Wenkang Han , Jingyuan Chen

Pre-trained models for Natural Languages (NL) like BERT and GPT have been recently shown to transfer well to Programming Languages (PL) and largely benefit a broad set of code-related tasks. Despite their success, most current methods…

Computation and Language · Computer Science 2021-09-03 Yue Wang , Weishi Wang , Shafiq Joty , Steven C. H. Hoi

Knowledge Tracing (KT) involves monitoring the changes in a student's knowledge over time by analyzing their past responses, with the goal of predicting future performance. However, most existing methods primarily focus on feature…

Artificial Intelligence · Computer Science 2025-11-18 Lixiang Xu , Xianwei Ding , Xin Yuan , Richang Hong , Feiping Nie , Enhong Chen , Philip S. Yu

Knowledge Tracing (KT) is a critical task in online education systems, aiming to monitor students' knowledge states throughout a learning period. Common KT approaches involve predicting the probability of a student correctly answering the…

Artificial Intelligence · Computer Science 2025-06-09 Yuquan Xie , Shengtao Peng , Wanqi Yang , Ming Yang , Yang Gao

Knowledge Tracing (KT) aims to predict a student's future performance based on their sequence of interactions with learning content. Many KT models rely on knowledge concepts (KCs), which represent the skills required for each item.…

Computers and Society · Computer Science 2025-08-26 Yahya Badran , Christine Preisach

With the recent surge in personalized learning, Intelligent Tutoring Systems (ITS) that can accurately track students' individual knowledge states and provide tailored learning paths based on this information are in demand as an essential…

Artificial Intelligence · Computer Science 2025-12-09 Wonbeen Lee , Channyoung Lee , Junho Sohn , Hansam Cho

The Transformer architecture and transfer learning have marked a quantum leap in natural language processing, improving the state of the art across a range of text-based tasks. This paper examines how these advancements can be applied to…

Software Engineering · Computer Science 2022-08-29 Pasquale Salza , Christoph Schwizer , Jian Gu , Harald C. Gall

Deep learning (DL) techniques are gaining more and more attention in the software engineering community. They have been used to support several code-related tasks, such as automatic bug fixing and code comments generation. Recent studies in…

Code pre-trained models (CodePTMs) have recently demonstrated significant success in code intelligence. To interpret these models, some probing methods have been applied. However, these methods fail to consider the inherent characteristics…

Software Engineering · Computer Science 2022-12-13 Nuo Chen , Qiushi Sun , Renyu Zhu , Xiang Li , Xuesong Lu , Ming Gao

Knowledge Tracing (KT) aims to estimate a learner's evolving mastery based on interaction histories. Recent studies have explored Large Language Models (LLMs) for KT via autoregressive nature, but such approaches typically require…

Computation and Language · Computer Science 2026-01-06 Unggi Lee , Joo Young Kim , Ran Ju , Minyoung Jung , Jeyeon Eo

Researchers have investigated the potential of leveraging pre-trained language models, such as CodeBERT, to enhance source code-related tasks. Previous methodologies have relied on CodeBERT's '[CLS]' token as the embedding representation of…

Computation and Language · Computer Science 2024-09-04 Yong Ma , Senlin Luo , Yu-Ming Shang , Yifei Zhang , Zhengjun Li

The growing use of artificial intelligence (AI) in education, particularly large language models (LLMs), has increased interest in intelligent tutoring systems. However, LLMs often show limited adaptivity and struggle to model learners'…

Software Engineering (SE) Pre-trained Language Models (PLMs), such as CodeBERT, are pre-trained on large code corpora, and their learned knowledge has shown success in transferring into downstream tasks (e.g., code clone detection) through…

Software Engineering · Computer Science 2024-02-07 Iman Saberi , Fatemeh Fard , Fuxiang Chen