English
Related papers

Related papers: Temporal Taskification in Streaming Continual Lear…

200 papers

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

Federated Continual Learning (FCL) leverages inter-client collaboration to balance new knowledge acquisition and prior knowledge retention in non-stationary data. However, existing batch-based FCL methods lack adaptability to streaming…

Machine Learning · Computer Science 2026-01-28 Sixing Tan , Xianmin Liu

This work addresses the challenge of streamed video depth estimation, which expects not only per-frame accuracy but, more importantly, cross-frame consistency. We argue that sharing contextual information between frames or clips is pivotal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jiahao Shao , Yuanbo Yang , Hongyu Zhou , Youmin Zhang , Yujun Shen , Vitor Guizilini , Yue Wang , Matteo Poggi , Yiyi Liao

Modern scientific instruments generate data at rates that increasingly exceed local compute capabilities and, when paired with the staging and I/O overheads of file-based transfers, also render file-based use of remote HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-01 Flavio Castro , Weijian Zheng , Joaquin Chung , Ian Foster , Rajkumar Kettimuthu

The increasing complexity of Industry 4.0 systems brings new challenges regarding predictive maintenance tasks such as fault detection and diagnosis. A corresponding and realistic setting includes multi-source data streams from different…

Machine Learning · Computer Science 2024-02-23 Victor Pellegrain , Myriam Tami , Michel Batteux , Céline Hudelot

A shared goal of several machine learning communities like continual learning, meta-learning and transfer learning, is to design algorithms and models that efficiently and robustly adapt to unseen tasks. An even more ambitious goal is to…

We introduce a framework for online learning from a single continuous video stream -- the way people and animals learn, without mini-batches, data augmentation or shuffling. This poses great challenges given the high correlation between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 João Carreira , Michael King , Viorica Pătrăucean , Dilara Gokay , Cătălin Ionescu , Yi Yang , Daniel Zoran , Joseph Heyward , Carl Doersch , Yusuf Aytar , Dima Damen , Andrew Zisserman

In Continual Learning (CL), a model is required to learn a stream of tasks sequentially without significant performance degradation on previously learned tasks. Current approaches fail for a long sequence of tasks from diverse domains and…

Machine Learning · Computer Science 2023-05-29 Iordanis Fostiropoulos , Jiaye Zhu , Laurent Itti

Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF). Recent works indicate that CL is a complex topic, even more so when…

Machine Learning · Computer Science 2022-06-09 Benedikt Bagus , Alexander Gepperth

Online continual learning, the process of training models on streaming data, has gained increasing attention in recent years. However, a critical aspect often overlooked is the label delay, where new data may not be labeled due to slow and…

Machine Learning · Computer Science 2024-04-29 Botos Csaba , Wenxuan Zhang , Matthias Müller , Ser-Nam Lim , Mohamed Elhoseiny , Philip Torr , Adel Bibi

The ability to sequentially learn multiple tasks without forgetting is a key skill of biological brains, whereas it represents a major challenge to the field of deep learning. To avoid catastrophic forgetting, various continual learning…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Francesco Lässig , Pau Vilimelis Aceituno , Martino Sorbaro , Benjamin F. Grewe

To conduct real-time analytics computations, big data stream processing engines are required to process unbounded data streams at millions of events per second. However, current streaming engines exhibit low throughput and high tuple…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-11 Shinhyung Yang , Jiun Jeong , Bernhard Scholz , Bernd Burgstaller

Continual learning (CL) is under-explored in the video domain. The few existing works contain splits with imbalanced class distributions over the tasks, or study the problem in unsuitable datasets. We introduce vCLIMB, a novel video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Andrés Villa , Kumail Alhamoud , Juan León Alcázar , Fabian Caba Heilbron , Victor Escorcia , Bernard Ghanem

Live streaming platforms require real-time monitoring and reaction to social signals, utilizing partial and asynchronous evidence from video, text, and audio. We propose StreamSense, a streaming detector that couples a lightweight streaming…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Han Wang , Deyi Ji , Lanyun Zhu , Jiebo Luo , Roy Ka-Wei Lee

Split learning emerges as a promising paradigm for collaborative distributed model training, akin to federated learning, by partitioning neural networks between clients and a server without raw data exchange. However, sequential split…

Machine Learning · Computer Science 2025-11-25 Mengdi Wang , Efe Bozkir , Enkelejda Kasneci

Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration. In temporal action…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhanzhong Pang , Fadime Sener , Shrinivas Ramasubramanian , Angela Yao

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

Machine Learning · Computer Science 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine learning where the usual assumption of stationary data distribution is relaxed or omitted. When naively applying, e.g., DNNs in CL problems, changes…

Machine Learning · Computer Science 2022-08-31 Benedikt Bagus , Alexander Gepperth , Timothée Lesort

In this paper, we explore the transferability of SSL by addressing two central questions: (i) what is the representation transferability of SSL, and (ii) how can we effectively model this transferability? Transferability is defined as the…

Machine Learning · Computer Science 2025-11-19 Huijie Guo , Jingyao Wang , Peizheng Guo , Xingchen Shen , Changwen Zheng , Wenwen Qiang