English
Related papers

Related papers: Mitigating Task-Order Sensitivity and Forgetting v…

200 papers

Task Free online continual learning (TF-CL) is a challenging problem where the model incrementally learns tasks without explicit task information. Although training with entire data from the past, present as well as future is considered as…

Machine Learning · Computer Science 2024-02-20 Byung Hyun Lee , Min-hwan Oh , Se Young Chun

Hierarchical clustering (HC) algorithms are generally limited to small data instances due to their runtime costs. Here we mitigate this shortcoming and explore fast HC algorithms based on random projections for single (SLC) and average…

Information Retrieval · Computer Science 2014-01-24 Johannes Schneider , Michail Vlachos

For object detection detectors, enhancing model performance hinges on the ability to simultaneously consider inconsistencies across tasks and focus on difficult-to-train samples. Achieving this necessitates incorporating information from…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Yanquan Huang , Liu Wei Zhen , Yun Hao , Mengyuan Zhang , Qingyao Wu , Zikun Deng , Xueming Liu , Hong Deng

Traditionally, multitask learning (MTL) assumes that all the tasks are related. This can lead to negative transfer when tasks are indeed incoherent. Recently, a number of approaches have been proposed that alleviate this problem by…

Machine Learning · Computer Science 2012-06-22 Wenliang Zhong , James Kwok

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

Machine Learning · Computer Science 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua

Transformer-based sequential recommendation (TSR) models have shown superior performance in recommendation systems, where the quality of item representations plays a crucial role. Classical representation methods integrate item features…

Information Retrieval · Computer Science 2025-04-22 Hao Deng , Haibo Xing , Kanefumi Matsuyama , Yulei Huang , Jinxin Hu , Hong Wen , Jia Xu , Zulong Chen , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Many reinforcement learning approaches rely on temporal-difference (TD) learning to learn a critic. However, TD-learning updates can be high variance. Here, we introduce a model-based RL framework, Taylor TD, which reduces this variance in…

Machine Learning · Computer Science 2023-10-19 Michele Garibbo , Maxime Robeyns , Laurence Aitchison

Federated Continual Learning (FCL) has recently emerged as a crucial research area, as data from distributed clients typically arrives as a stream, requiring sequential learning. This paper explores a more practical and challenging FCL…

Machine Learning · Computer Science 2025-06-17 Minh-Duong Nguyen , Le-Tuan Nguyen , Quoc-Viet Pham

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

Rehearsal-based approaches are a mainstay of continual learning (CL). They mitigate the catastrophic forgetting problem by maintaining a small fixed-size buffer with a subset of data from past tasks. While most rehearsal-based approaches…

Machine Learning · Computer Science 2023-05-02 Zifeng Wang , Zheng Zhan , Yifan Gong , Yucai Shao , Stratis Ioannidis , Yanzhi Wang , Jennifer Dy

Multi-objective reinforcement learning (MORL) is effective for multi-echelon combinatorial supply chain optimisation, where tasks involve high dimensionality, uncertainty, and competing objectives. However, its deployment in dynamic…

Machine Learning · Computer Science 2026-03-09 Rifny Rachman , Josh Tingey , Richard Allmendinger , Wei Pan , Pradyumn Shukla , Bahrul Ilmi Nasution

In multi-agent reinforcement learning (MARL), the Centralized Training with Decentralized Execution (CTDE) framework is pivotal but struggles due to a gap: global state guidance in training versus reliance on local observations in…

Artificial Intelligence · Computer Science 2024-08-26 Pu Feng , Junkang Liang , Size Wang , Xin Yu , Xin Ji , Yiting Chen , Kui Zhang , Rongye Shi , Wenjun Wu

Continuous-time reinforcement learning (CTRL) provides a principled framework for sequential decision-making in environments where interactions evolve continuously over time. Despite its empirical success, the theoretical understanding of…

Machine Learning · Computer Science 2025-05-22 Runze Zhao , Yue Yu , Adams Yiyue Zhu , Chen Yang , Dongruo Zhou

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

Machine Learning · Computer Science 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

The goal of Continual Learning (CL) task is to continuously learn multiple new tasks sequentially while achieving a balance between the plasticity and stability of new and old knowledge. This paper analyzes that this insufficiency arises…

Machine Learning · Computer Science 2024-05-28 Hanxi Xiao , Fan Lyu

We present the problem of inverse constraint learning (ICL), which recovers constraints from demonstrations to autonomously reproduce constrained skills in new scenarios. However, ICL suffers from an ill-posed nature, leading to inaccurate…

Robotics · Computer Science 2023-12-11 Jaehwi Jang , Minjae Song , Daehyung Park

Heterogeneity in federated learning (FL) is a critical and challenging aspect that significantly impacts model performance and convergence. In this paper, we propose a novel framework by formulating heterogeneous FL as a hierarchical…

Optimization and Control · Mathematics 2025-09-11 Yuyang Qiu , Kibaek Kim , Farzad Yousefian

Practical machine learning systems often operate in multiple sequential stages, as seen in ranking and recommendation systems, which typically include a retrieval phase followed by a ranking phase. Effectively assessing prediction…

Information Retrieval · Computer Science 2025-02-04 Yunpeng Xu , Mufang Ying , Wenge Guo , Zhi Wei

Continual learning (CL) enables the development of models and agents that learn from a sequence of tasks while addressing the limitations of standard deep learning approaches, such as catastrophic forgetting. In this work, we investigate…

Machine Learning · Computer Science 2023-05-19 Massimo Caccia , Jonas Mueller , Taesup Kim , Laurent Charlin , Rasool Fakoor
‹ Prev 1 4 5 6 7 8 10 Next ›