English
Related papers

Related papers: Wake-Sleep Consolidated Learning

200 papers

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Despite the advancements in deep learning for camera relocalization tasks, obtaining ground truth pose labels required for the training process remains a costly endeavor. While current weakly supervised methods excel in lightweight label…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Jialu Wang , Kaichen Zhou , Andrew Markham , Niki Trigoni

We focus on a relatively unexplored learning paradigm known as {\em Online Unsupervised Continual Learning} (O-UCL), where an agent receives a non-stationary, unlabeled data stream and progressively learns to identify an increasing number…

Machine Learning · Computer Science 2024-09-26 Cameron Taylor , Vassilis Vassiliades , Constantine Dovrolis

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

Machine Learning · Computer Science 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

Sleep is thought to support memory consolidation and the recovery of optimal energetic regime by reorganizing synaptic connectivity, yet how plasticity across hierarchical brain circuits contributes to abstraction and energy efficiency…

Identifying sleep stages and patterns is an essential part of diagnosing and treating sleep disorders. With the advancement of smart technologies, sensor data related to sleeping patterns can be captured easily. In this paper, we propose a…

Signal Processing · Electrical Eng. & Systems 2022-04-29 Vidya Rohini Konanur Sathish , Wai Lok Woo , Edmond S. L. Ho

Neuromorphic Continual Learning (NCL) paradigm leverages Spiking Neural Networks (SNNs) to enable continual learning (CL) capabilities for AI systems to adapt to dynamically changing environments. Currently, the state-of-the-art employ a…

Neural and Evolutionary Computing · Computer Science 2025-10-30 Mishal Fatima Minhas , Rachmad Vidya Wicaksana Putra , Falah Awwad , Osman Hasan , Muhammad Shafique

The occurrence of sleep passed through the evolutionary sieve and is widespread in animal species. Sleep is known to be beneficial to cognitive and mnemonic tasks, while chronic sleep deprivation is detrimental. Despite the importance of…

Neurons and Cognition · Quantitative Biology 2019-11-19 Cristiano Capone , Elena Pastorelli , Bruno Golosio , Pier Stanislao Paolucci

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

Machine Learning · Computer Science 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

In Continual Learning (CL), a model is required to learn a stream of tasks sequentially without significant performance degradation on previously learned tasks. Current approaches fail for a long sequence of tasks from diverse domains and…

Machine Learning · Computer Science 2023-05-29 Iordanis Fostiropoulos , Jiaye Zhu , Laurent Itti

It is an important yet challenging setting to continually learn new tasks from a few examples. Although numerous efforts have been devoted to either continual learning or few-shot learning, little work has considered this new setting of…

Machine Learning · Computer Science 2021-04-20 Liyuan Wang , Qian Li , Yi Zhong , Jun Zhu

Continual Learning (CL) methods aim to learn from a sequence of tasks while avoiding the challenge of forgetting previous knowledge. We present DREAM-CL, a novel CL method for ECG arrhythmia detection that introduces dynamic prototype…

Machine Learning · Computer Science 2026-01-19 Sana Rahmani , Reetam Chatterjee , Ali Etemad , Javad Hashemi

Continual learning (CL) studies the problem of learning a sequence of tasks, one at a time, such that the learning of each new task does not lead to the deterioration in performance on the previously seen ones while exploiting previously…

Machine Learning · Computer Science 2020-11-03 Ammar Shaker , Francesco Alesiani , Shujian Yu , Wenzhe Yin

Continual or Lifelong Learning aims to develop models capable of acquiring new knowledge from a sequence of tasks without catastrophically forgetting what has been learned before. Existing approaches often rely on storing samples from…

Machine Learning · Computer Science 2026-01-08 Shihao Ji , Zihui Song

Modern neural network based speech recognition models are required to continually absorb new data without re-training the whole system, especially in downstream applications using foundation models, having no access to the original training…

Computation and Language · Computer Science 2025-06-23 Enes Yavuz Ugan , Ngoc-Quan Pham , Alexander Waibel

Closed-loop sleep modulation is an emerging research paradigm to treat sleep disorders and enhance sleep benefits. However, two major barriers hinder the widespread application of this research paradigm. First, subjects often need to be…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Mingzhe Sun , Aaron Zhou , Naize Yang , Yaqian Xu , Yuhan Hou , Xilin Liu

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Learning new information without forgetting prior knowledge is central to human intelligence. In contrast, neural network models suffer from catastrophic forgetting: a significant degradation in performance on previously learned tasks when…

Machine Learning · Computer Science 2025-07-16 James P Jun , Vijay Marupudi , Raj Sanjay Shah , Sashank Varma

Modeling complex phenomena typically involves the use of both discrete and continuous variables. Such a setting applies across a wide range of problems, from identifying trends in time-series data to performing effective compositional scene…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Tuan Anh Le , Katherine M. Collins , Luke Hewitt , Kevin Ellis , N. Siddharth , Samuel J. Gershman , Joshua B. Tenenbaum

Recently, vision model pre-training has evolved from relying on manually annotated datasets to leveraging large-scale, web-crawled image-text data. Despite these advances, there is no pre-training method that effectively exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Chenyu Yang , Xizhou Zhu , Jinguo Zhu , Weijie Su , Junjie Wang , Xuan Dong , Wenhai Wang , Lewei Lu , Bin Li , Jie Zhou , Yu Qiao , Jifeng Dai