English
Related papers

Related papers: Exploring System Performance of Continual Learning…

200 papers

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Foundation models have transformed machine learning through large-scale pretraining and increased test-time compute. Despite surpassing human performance in several domains, these models remain fundamentally limited in continuous operation,…

Continual learning is considered a promising step towards next-generation Artificial Intelligence (AI), where deep neural networks (DNNs) make decisions by continuously learning a sequence of different tasks akin to human learning…

Machine Learning · Computer Science 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

In continual learning, the learner faces a stream of data whose distribution changes over time. Modern neural networks are known to suffer under this setting, as they quickly forget previously acquired knowledge. To address such…

Machine Learning · Computer Science 2021-03-03 Arslan Chaudhry , Albert Gordo , Puneet K. Dokania , Philip Torr , David Lopez-Paz

Online continual learning for image classification studies the problem of learning to classify images from an online stream of data and tasks, where tasks may include new classes (class incremental) or data nonstationarity (domain…

Machine Learning · Computer Science 2021-10-06 Zheda Mai , Ruiwen Li , Jihwan Jeong , David Quispe , Hyunwoo Kim , Scott Sanner

We consider a sequence of related multivariate time series learning tasks, such as predicting failures for different instances of a machine from time series of multi-sensor data, or activity recognition tasks over different individuals from…

Machine Learning · Computer Science 2022-03-15 Vibhor Gupta , Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Deep neural networks have shown remarkable performance when trained on independent and identically distributed data from a fixed set of classes. However, in real-world scenarios, it can be desirable to train models on a continuous stream of…

Machine Learning · Computer Science 2023-09-04 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher , Toshihiko Yamasaki

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

The accurate tracking of live cells using video microscopy recordings remains a challenging task for popular state-of-the-art image processing based object tracking methods. In recent years, several existing and new applications have…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Gergely Szabó , Paolo Bonaiuti , Andrea Ciliberto , András Horváth

Sensor-based human activity recognition (HAR), i.e., the ability to discover human daily activity patterns from wearable or embedded sensors, is a key enabler for many real-world applications in smart homes, personal healthcare, and urban…

Signal Processing · Electrical Eng. & Systems 2021-04-20 Saurav Jha , Martin Schiemer , Franco Zambonelli , Juan Ye

Deep learning architectures exhibit a critical drop of performance due to catastrophic forgetting when they are required to incrementally learn new tasks. Contemporary incremental learning frameworks focus on image classification and object…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Umberto Michieli , Pietro Zanuttigh

Deep learning solutions are being increasingly used in mobile applications. Although there are many open-source software tools for the development of deep learning solutions, there are no guidelines in one place in a unified manner for…

Machine Learning · Computer Science 2019-01-09 Abhishek Sehgal , Nasser Kehtarnavaz

Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning. In recent years, numerous methods have been proposed for continual…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias

Continual learning, also known as lifelong learning or incremental learning, refers to the process by which a model learns from a stream of incoming data over time. A common problem in continual learning is the classification layer's bias…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Haoran Chen , Micah Goldblum , Zuxuan Wu , Yu-Gang Jiang

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Recent advances in Internet-of-Things (IoT) technologies have sparked significant interest towards developing learning-based sensing applications on embedded edge devices. These efforts, however, are being challenged by the complexities of…

Systems and Control · Electrical Eng. & Systems 2024-02-23 Abdulrahman Bukhari , Seyedmehdi Hosseinimotlagh , Hyoseung Kim

A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Sylvestre-Alvise Rebuffi , Alexander Kolesnikov , Georg Sperl , Christoph H. Lampert

Deep reinforcement learning (DRL) has been successfully used to design forwarding strategies for multi-hop mobile wireless networks. While such strategies can be used directly for networks with varied connectivity and dynamic conditions,…

Networking and Internet Architecture · Computer Science 2025-09-30 Cheonjin Park , Victoria Manfredi , Xiaolan Zhang , Chengyi Liu , Alicia P Wolfe , Dongjin Song , Sarah Tasneem , Bing Wang

The goal of continual learning is to find a model that solves multiple learning tasks which are presented sequentially to the learner. A key challenge in this setting is that the learner may forget how to solve a previous task when learning…

Machine Learning · Computer Science 2023-06-09 Liangzu Peng , Paris V. Giampouras , René Vidal