English
Related papers

Related papers: Forgetting-aware Linear Bias for Attentive Knowled…

200 papers

As the rapid development of Intelligent Tutoring Systems (ITS) in the past decade, tracing the students' knowledge state has become more and more important in order to provide individualized learning guidance. This is the main idea of…

Computers and Society · Computer Science 2023-05-18 Zhongfeng Jia , Wei Su , Jiamin Liu , Wenli Yue

Intelligent Tutoring Systems have become critically important in future learning environments. Knowledge Tracing (KT) is a crucial part of that system. It is about inferring the skill mastery of students and predicting their performance to…

Computers and Society · Computer Science 2021-12-22 Sein Minn , Jill-Jenn Vie , Koh Takeuchi , Hisashi Kashima , Feida Zhu

In Federated Learning (FL), forgetting, or the loss of knowledge across rounds, hampers algorithm convergence, particularly in the presence of severe data heterogeneity among clients. This study explores the nuances of this issue,…

Machine Learning · Computer Science 2024-02-09 Mohammed Aljahdali , Ahmed M. Abdelmoniem , Marco Canini , Samuel Horváth

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

We study the problem of knowledge tracing (KT) where the goal is to trace the students' knowledge mastery over time so as to make predictions on their future performance. Owing to the good representation capacity of deep neural networks…

Computers and Society · Computer Science 2021-08-11 Xiaopeng Guo , Zhijie Huang , Jie Gao , Mingyu Shang , Maojing Shu , Jun Sun

In the realm of Intelligent Tutoring System (ITS), the accurate assessment of students' knowledge states through Knowledge Tracing (KT) is crucial for personalized learning. However, due to data bias, $\textit{i.e.}$, the unbalanced…

Machine Learning · Computer Science 2025-03-05 Yiyun Zhou , Zheqi Lv , Shengyu Zhang , Jingyuan Chen

Knowledge tracing is the task of modeling each student's mastery of knowledge concepts (KCs) as (s)he engages with a sequence of learning activities. Each student's knowledge is modeled by estimating the performance of the student on the…

Machine Learning · Computer Science 2019-07-17 Shalini Pandey , George Karypis

Given the ability to model more realistic and dynamic problems, Federated Continual Learning (FCL) has been increasingly investigated recently. A well-known problem encountered in this setting is the so-called catastrophic forgetting, for…

Machine Learning · Computer Science 2025-10-07 Giuseppe Serra , Florian Buettner

Knowledge tracing (KT) aims to assess individuals' evolving knowledge states according to their learning interactions with different exercises in online learning systems (OIS), which is critical in supporting decision-making for subsequent…

Artificial Intelligence · Computer Science 2023-04-07 Shuanghong Shen , Enhong Chen , Bihan Xu , Qi Liu , Zhenya Huang , Linbo Zhu , Yu Su

The Knowledge Tracing (KT) task focuses on predicting a learner's future performance based on the historical interactions. The knowledge state plays a key role in learning process. However, considering that the knowledge state is influenced…

Artificial Intelligence · Computer Science 2024-12-30 Shanshan Wang , Xueying Zhang , Keyang Wang , Xun Yang , Xingyi Zhang

This paper presents novel techniques for enhancing the performance of knowledge tracing (KT) models by focusing on the crucial factor of question and concept difficulty level. Despite the acknowledged significance of difficulty, previous KT…

Computation and Language · Computer Science 2023-12-20 Unggi Lee , Sungjun Yoon , Joon Seo Yun , Kyoungsoo Park , YoungHoon Jung , Damji Stratton , Hyeoncheol Kim

Knowledge tracing (KT) supports personalized learning by modeling how students' knowledge states evolve over time. However, most KT models emphasize mastery of discrete knowledge components, limiting their ability to characterize broader…

Computers and Society · Computer Science 2025-10-28 Zhifeng Wang , Yaowei Dong , Chunyan Zeng

Custom Diffusion Models (CDMs) have gained significant attention due to their remarkable ability to personalize generative processes. However, existing CDMs suffer from catastrophic forgetting when continuously learning new concepts. Most…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Arjun Ramesh Kaushik , Naresh Kumar Devulapally , Vishnu Suresh Lokhande , Nalini Ratha , Venu Govindaraju

Since the introduction of the transformer model by Vaswani et al. (2017), a fundamental question has yet to be answered: how does a model achieve extrapolation at inference time for sequences that are longer than it saw during training? We…

Computation and Language · Computer Science 2022-04-26 Ofir Press , Noah A. Smith , Mike Lewis

In category learning, a growing body of literature has increasingly focused on exploring the impacts of interleaving in contrast to blocking. The sequential attention hypothesis posits that interleaving draws attention to the differences…

Computers and Society · Computer Science 2024-07-23 Meng Cao , Philip I. Pavlik , Wei Chu , Liang Zhang

Knowledge Tracing (KT) aims to model a student's learning state over time and predict their future performance. However, traditional KT methods often face challenges in explainability, scalability, and effective modeling of complex…

Artificial Intelligence · Computer Science 2025-05-26 Runze Li , Siyu Wu , Jun Wang , Wei Zhang

Existing research on continual learning (CL) of a sequence of tasks focuses mainly on dealing with catastrophic forgetting (CF) to balance the learning plasticity of new tasks and the memory stability of old tasks. However, an ideal CL…

Machine Learning · Computer Science 2026-01-12 Zhi Wang , Zhongbin Wu , Yanni Li , Bing Liu , Guangxi Li , Yuping Wang

Modelling student knowledge is a key challenge when leveraging AI in education, with major implications for personalised learning. The Knowledge Tracing (KT) task aims to predict how students will respond to educational questions in…

Computation and Language · Computer Science 2026-01-27 Max Norris , Kobi Gal , Sahan Bulathwela

Linear-attention models that compress the entire input sequence into a fixed-size recurrent state offer an efficient alternative to Transformers, but their finite memory induces forgetfulness that harms retrieval-intensive tasks. To…

Computation and Language · Computer Science 2025-10-27 Mutian He , Philip N. Garner

Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Nianzu Ma , Hu Xu , Lei Shu