English
Related papers

Related papers: Online Continual Learning with Dynamic Label Hiera…

200 papers

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Non-Centralized Continual Learning (NCCL) has become an emerging paradigm for enabling distributed devices such as vehicles and servers to handle streaming data from a joint non-stationary environment. To achieve high reliability and…

Machine Learning · Computer Science 2025-05-07 Yichen Li , Haozhao Wang , Wenchao Xu , Tianzhe Xiao , Hong Liu , Minzhu Tu , Yuying Wang , Xin Yang , Rui Zhang , Shui Yu , Song Guo , Ruixuan Li

Graphs are essential for modeling complex interactions across domains such as social networks, biology, and recommendation systems. Traditional Graph Neural Networks, particularly Message Passing Neural Networks (MPNNs), rely heavily on…

Machine Learning · Computer Science 2025-06-13 Wei Li , Mengcheng Lan , Jiaxing Xu , Yiping Ke

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Continual reinforcement learning (CRL) refers to a naturalistic setting where an agent needs to endlessly evolve, by trial and error, to solve multiple tasks that are presented sequentially. One of the largest obstacles to CRL is that the…

Machine Learning · Computer Science 2025-07-15 Zichen Liu , Guoji Fu , Chao Du , Wee Sun Lee , Min Lin

In autonomous driving, even a meticulously trained model can encounter failures when facing unfamiliar scenarios. One of these scenarios can be formulated as an online continual learning (OCL) problem. That is, data come in an online…

Machine Learning · Computer Science 2024-11-06 Huiping Zhuang , Di Fang , Kai Tong , Yuchen Liu , Ziqian Zeng , Xu Zhou , Cen Chen

Machine learning models deployed in open-world scenarios often encounter unfamiliar conditions and perform poorly in unanticipated situations. As AI systems advance and find application in safety-critical domains, effectively handling…

Machine Learning · Computer Science 2025-04-22 Tian Xie , Jifan Zhang , Haoyue Bai , Robert Nowak

Dynamic node classification is critical for modeling evolving systems like financial transactions and academic collaborations. In such systems, dynamically capturing node information changes is critical for dynamic node classification,…

Machine Learning · Computer Science 2025-04-28 Shengtao Zhang , Haokai Zhang , Shiqi Lou , Zicheng Wang , Zinan Zeng , Yilin Wang , Minnan Luo

Convolutional dictionary learning (CDL) estimates shift invariant basis adapted to multidimensional data. CDL has proven useful for image denoising or inpainting, as well as for pattern discovery on multivariate signals. As estimated…

Machine Learning · Computer Science 2019-01-29 Thomas Moreau , Alexandre Gramfort

A continual learning (CL) algorithm learns from a non-stationary data stream. The non-stationarity is modeled by some schedule that determines how data is presented over time. Most current methods make strong assumptions on the schedule and…

Machine Learning · Computer Science 2022-10-17 Ruohan Wang , Marco Ciccone , Giulia Luise , Andrew Yapp , Massimiliano Pontil , Carlo Ciliberto

Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened new avenues of research. In meta-continual learning, the…

Pool-based active learning (AL) is a promising technology for increasing data-efficiency of machine learning models. However, surveys show that performance of recent AL methods is very sensitive to the choice of dataset and training…

Machine Learning · Computer Science 2023-09-12 Tim Bakker , Herke van Hoof , Max Welling

Hierarchical Federated Learning (HFL) has recently emerged as a promising solution for intelligent decision-making in vehicular networks, helping to address challenges such as limited communication resources, high vehicle mobility, and data…

Cryptography and Security · Computer Science 2025-05-05 M. Saeid HaghighiFard , Sinem Coleri

Training large language models (LLMs) increasingly relies on geographically distributed accelerators, causing prohibitive communication costs across regions and uneven utilization of heterogeneous hardware. We propose HALoS, a hierarchical…

Machine Learning · Computer Science 2025-06-06 Geon-Woo Kim , Junbo Li , Shashidhar Gandham , Omar Baldonado , Adithya Gangidi , Pavan Balaji , Zhangyang Wang , Aditya Akella

Food image classification is essential for monitoring health and tracking dietary in image-based dietary assessment methods. However, conventional systems often rely on static datasets with fixed classes and uniform distribution. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

Continual Learning (CL) is a powerful tool that enables agents to learn a sequence of tasks, accumulating knowledge learned in the past and using it for problem-solving or future task learning. However, existing CL methods often assume that…

Machine Learning · Computer Science 2025-06-09 Chaofan Pan , Jiafen Liu , Yanhua Li , Linbo Xiong , Fan Min , Wei Wei , Xin Yang

We reformulate the problem of encoding a multi-scale representation of a sequence in a language model by casting it in a continuous learning framework. We propose a hierarchical multi-scale language model in which short time-scale…

Computation and Language · Computer Science 2018-05-16 Thomas Wolf , Julien Chaumond , Clement Delangue

Continual learning aims to learn multiple tasks sequentially. A key challenge in continual learning is balancing between two objectives: retaining knowledge from old tasks (stability) and adapting to new tasks (plasticity). Experience…

Machine Learning · Computer Science 2025-04-01 Song Lai , Zhe Zhao , Fei Zhu , Xi Lin , Qingfu Zhang , Gaofeng Meng

Hierarchical multi-label classification (HMLC) is essential for modeling structured label dependencies in remote sensing. Yet existing approaches struggle in multi-path settings, where images may activate multiple taxonomic branches,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Boshko Koloski , Marjan Stoimchev , Jurica Levatić , Dragi Kocev , Sašo Džeroski

Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective changes through time, or where all the training data and objective criteria are never available at once. The evolution of…

Machine Learning · Computer Science 2019-11-25 Timothée Lesort , Vincenzo Lomonaco , Andrei Stoian , Davide Maltoni , David Filliat , Natalia Díaz-Rodríguez