English
Related papers

Related papers: A Complementary Learning Systems Approach to Tempo…

200 papers

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

Machine Learning · Computer Science 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

Universal time series representation learning is challenging but valuable in real-world applications such as classification, anomaly detection, and forecasting. Recently, contrastive learning (CL) has been actively explored to tackle time…

Machine Learning · Computer Science 2025-02-06 Namwoo Kim , Hyungryul Baik , Yoonjin Yoon

Attempt to fully discover the temporal diversity and chronological characteristics for self-supervised video representation learning, this work takes advantage of the temporal dependencies within videos and further proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yang Liu , Keze Wang , Haoyuan Lan , Liang Lin

Although deep neural networks perform extremely well in controlled environments, they fail in real-world scenarios where data isn't available all at once, and the model must adapt to a new data distribution that may or may not follow the…

Machine Learning · Computer Science 2026-03-17 Vaishnavi Nagabhushana , Kartikay Agrawal , Ayon Borthakur

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Class-Incremental Learning (CIL) is a critical capability for real-world applications, enabling learning systems to adapt to new tasks while retaining knowledge from previous ones. Recent advancements in pre-trained models (PTMs) have…

Machine Learning · Computer Science 2025-04-28 Kun He , Zijian Song , Shuoxi Zhang , John E. Hopcroft

Recently, convolutional neural networks (CNNs)-based facial landmark detection methods have achieved great success. However, most of existing CNN-based facial landmark detection methods have not attempted to activate multiple correlated…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jun Wan , Zhihui Lai , Linlin Shen , Jie Zhou , Can Gao , Gang Xiao , Xianxu Hou

Causal Temporal Representation Learning (Ctrl) methods aim to identify the temporal causal dynamics of complex nonstationary temporal sequences. Despite the success of existing Ctrl methods, they require either directly observing the domain…

Machine Learning · Computer Science 2024-09-06 Xiangchen Song , Zijian Li , Guangyi Chen , Yujia Zheng , Yewen Fan , Xinshuai Dong , Kun Zhang

Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine learning where the usual assumption of stationary data distribution is relaxed or omitted. When naively applying, e.g., DNNs in CL problems, changes…

Machine Learning · Computer Science 2022-08-31 Benedikt Bagus , Alexander Gepperth , Timothée Lesort

Continual learning (CL) has two main objectives: preventing catastrophic forgetting (CF) and encouraging knowledge transfer (KT). The existing literature mainly focused on overcoming CF. Some work has also been done on KT when the tasks are…

Computation and Language · Computer Science 2023-10-17 Zixuan Ke , Bing Liu , Wenhan Xiong , Asli Celikyilmaz , Haoran Li

Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL settings, class incremental learning (CIL) and task incremental learning (TIL). A major challenge of CL is catastrophic forgetting (CF). While a…

Machine Learning · Computer Science 2022-11-07 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Zixuan Ke , Bing Liu

Spectrum prediction is considered to be a promising technology that enhances spectrum efficiency by assisting dynamic spectrum access (DSA) in cognitive radio networks (CRN). Nonetheless, the highly nonlinear nature of spectrum data across…

Signal Processing · Electrical Eng. & Systems 2024-12-16 Guangliang Pan , David K. Y. Yau , Bo Zhou , Qihui Wu

Collaborative edge computing uses edge nodes in different locations to execute tasks, necessitating dynamic task offloading decisions to maintain low latency and high reliability, especially under unpredictable node failures. Although deep…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Hao Guo , Kaixiang Xv , Ziwu Ge , Lei Yang

Continual learning (CL) - the ability to progressively acquire and integrate new concepts - is essential to intelligent systems to adapt to dynamic environments. However, deep neural networks struggle with catastrophic forgetting (CF) when…

Machine Learning · Computer Science 2025-07-08 Marco Paul E. Apolinario , Sakshi Choudhary , Kaushik Roy

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

Artificial Intelligence · Computer Science 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

Continual learning approaches help deep neural network models adapt and learn incrementally by trying to solve catastrophic forgetting. However, whether these existing approaches, applied traditionally to image-based tasks, work with the…

Machine Learning · Computer Science 2022-06-27 Young D. Kwon , Jagmohan Chauhan , Abhishek Kumar , Pan Hui , Cecilia Mascolo

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Both the Dictionary Learning (DL) and Convolutional Neural Networks (CNN) are powerful image representation learning systems based on different mechanisms and principles, however whether we can seamlessly integrate them to improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zhao Zhang , Yulin Sun , Yang Wang , Zhengjun Zha , Shuicheng Yan , Meng Wang

Advanced life forms, sustained by the synergistic interaction of neural cognitive mechanisms, continually acquire and transfer knowledge throughout their lifespan. In contrast, contemporary machine learning paradigms exhibit limitations in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Biqing Qi , Xingquan Chen , Junqi Gao , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou

Neural schedulers based on deep reinforcement learning (DRL) have shown considerable potential for solving real-world resource allocation problems, as they have demonstrated significant performance gain in the domain of cluster computing.…

Machine Learning · Computer Science 2024-10-28 Tegg Taekyong Sung , Bo Ryu