English
Related papers

Related papers: Dynamic Programming Techniques for Enhancing Cogni…

200 papers

Knowledge tracing has been widely used in online learning systems to guide the students' future learning. However, most existing KT models primarily focus on extracting abundant information from the question sets and explore the…

Machine Learning · Computer Science 2024-05-28 Shanshan Wang , Fangzheng Yuan , Keyang Wang , Xun Yang , Xingyi Zhang , Meng Wang

Despite deep neural networks have demonstrated extraordinary power in various applications, their superior performances are at expense of high storage and computational costs. Consequently, the acceleration and compression of neural…

Computer Vision and Pattern Recognition · Computer Science 2017-12-20 Zehao Huang , Naiyan Wang

We propose a generalization of modern representation learning objectives by reframing them as recursive divergence alignment processes over localized conditional distributions While recent frameworks like Information Contrastive Learning…

Machine Learning · Computer Science 2025-05-02 Anthony D Martin

Despite the recent works on knowledge distillation (KD) have achieved a further improvement through elaborately modeling the decision boundary as the posterior knowledge, their performance is still dependent on the hypothesis that the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Junjie Liu , Dongchao Wen , Hongxing Gao , Wei Tao , Tse-Wei Chen , Kinya Osa , Masami Kato

The knowledge distillation uses a high-performance teacher network to guide the student network. However, the performance gap between the teacher and student networks can affect the student's training. This paper proposes a novel knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Songling Zhu , Ronghua Shang , Bo Yuan , Weitong Zhang , Yangyang Li , Licheng Jiao

Knowledge tracing is the task of predicting a learner's future performance based on the history of the learner's performance. Current knowledge tracing models are built based on an extensive set of data that are collected from multiple…

Computers and Society · Computer Science 2022-01-19 Sujanya Suresh , Savitha Ramasamy , P. N. Suganthan , Cheryl Sze Yin Wong

Knowledge distillation (KD) is widely used for training a compact model with the supervision of another large model, which could effectively improve the performance. Previous methods mainly focus on two aspects: 1) training the student to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Tiancheng Wen , Shenqi Lai , Xueming Qian

Knowledge distillation (KD) is commonly deemed as an effective model compression technique in which a compact model (student) is trained under the supervision of a larger pretrained model or an ensemble of models (teacher). Various…

Machine Learning · Computer Science 2020-07-08 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Knowledge tracing (KT) models are a crucial basis for pedagogical decision-making, namely which task to select next for a learner and when to stop teaching a particular skill. Given the high stakes of pedagogical decisions, KT models are…

Machine Learning · Computer Science 2025-11-05 Adia Khalid , Alina Deriyeva , Benjamin Paassen

Knowledge tracing (KT) supports personalized learning by modeling how students' knowledge states evolve over time. However, most KT models emphasize mastery of discrete knowledge components, limiting their ability to characterize broader…

Computers and Society · Computer Science 2025-10-28 Zhifeng Wang , Yaowei Dong , Chunyan Zeng

Knowledge Tracing (KT) aims to mine students' evolving knowledge states and predict their future question-answering performance. Existing methods based on heterogeneous information networks (HINs) are prone to introducing noises due to…

Artificial Intelligence · Computer Science 2025-11-20 Zhiyi Duan , Zixing Shi , Hongyu Yuan , Qi Wang

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Knowledge Tracing (KT) is a fundamental task in Intelligent Tutoring Systems (ITS), which aims to model the dynamic knowledge states of students based on their interaction histories. However, existing KT models often rely on a global…

Computers and Society · Computer Science 2025-05-09 Han Liao , Shuaishuai Zu

Knowledge distillation is a popular approach for enhancing the performance of ''student'' models, with lower representational capacity, by taking advantage of more powerful ''teacher'' models. Despite its apparent simplicity and widespread…

Machine Learning · Computer Science 2023-12-12 Mher Safaryan , Alexandra Peste , Dan Alistarh

Recent advancements in large language models (LLMs) have raised concerns about inference costs, increasing the need for research into model compression. While knowledge distillation (KD) is a prominent method for this, research on KD for…

Computation and Language · Computer Science 2024-09-30 Gyeongman Kim , Doohyuk Jang , Eunho Yang

Real Time Dynamic Programming (RTDP) is an online algorithm based on Dynamic Programming (DP) that acts by 1-step greedy planning. Unlike DP, RTDP does not require access to the entire state space, i.e., it explicitly handles the…

Machine Learning · Computer Science 2020-10-13 Yonathan Efroni , Mohammad Ghavamzadeh , Shie Mannor

Knowledge tracing is a sequence prediction problem where the goal is to predict the outcomes of students over questions as they are interacting with a learning platform. By tracking the evolution of the knowledge of some student, one can…

Information Retrieval · Computer Science 2018-11-16 Jill-Jênn Vie , Hisashi Kashima

Knowledge Tracing (KT) serves as a fundamental component of Intelligent Tutoring Systems (ITS), enabling these systems to monitor and understand learners' progress by modeling their knowledge state. However, many existing KT models…

Artificial Intelligence · Computer Science 2025-09-16 Jing Xiao , Chang You , Zhiyu Chen

The field of Knowledge Tracing aims to understand how students learn and master knowledge over time by analyzing their historical behaviour data. To achieve this goal, many researchers have proposed Knowledge Tracing models that use data…

Computers and Society · Computer Science 2024-05-09 Zhaoxing Li , Jujie Yang , Jindi Wang , Lei Shi , Sebastian Stein

Many aspects of human learning have been proposed as a process of constructing mental programs: from acquiring symbolic number representations to intuitive theories about the world. In parallel, there is a long-tradition of using…

Human-Computer Interaction · Computer Science 2024-05-12 Hanqi Zhou , David G. Nagy , Charley M. Wu