English
Related papers

Related papers: Chain-of-Context Learning: Dynamic Constraint Unde…

200 papers

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not…

Deep reinforcement learning (DRL) has become a popular approach in traffic signal control (TSC) due to its ability to learn adaptive policies from complex traffic environments. Within DRL-based TSC methods, two primary control paradigms are…

Machine Learning · Computer Science 2025-09-04 Hankang Gu , Yuli Zhang , Chengming Wang , Ruiyuan Jiang , Ziheng Qiao , Pengfei Fan , Dongyao Jia

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

Machine Learning · Computer Science 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

Machine Learning · Computer Science 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

In domains such as finance, healthcare, and robotics, managing worst-case scenarios is critical, as failure to do so can lead to catastrophic outcomes. Distributional Reinforcement Learning (DRL) provides a natural framework to incorporate…

Machine Learning · Computer Science 2026-02-13 Mehrdad Moghimi , Hyejin Ku

We introduce Resilient Multiple Choice Learning (rMCL), an extension of the MCL approach for conditional distribution estimation in regression settings where multiple targets may be sampled for each training input. Multiple Choice Learning…

Machine Learning · Statistics 2023-11-17 Victor Letzelter , Mathieu Fontaine , Mickaël Chen , Patrick Pérez , Slim Essid , Gaël Richard

To address the performance limitations of the Segment Anything Model (SAM) in specific domains, existing works primarily adopt adapter-based one-step adaptation paradigms. However, some of these methods are specific developed for specific…

Machine Learning · Computer Science 2025-07-17 Yuan-Chen Shu , Zhiwei Lin , Yongtao Wang

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

A safe and efficient decision-making system is crucial for autonomous vehicles. However, the complexity of driving environments limits the effectiveness of many rule-based and machine learning approaches. Reinforcement Learning (RL), with…

Robotics · Computer Science 2024-11-05 Rongliang Zhou , Jiakun Huang , Mingjun Li , Hepeng Li , Haotian Cao , Xiaolin Song

Reinforcement Learning (RL) in Traffic Signal Control (TSC) faces significant hurdles in real-world deployment due to limited generalization to dynamic traffic flow variations. Existing approaches often overfit static patterns and use…

Artificial Intelligence · Computer Science 2026-03-13 Sheng-You Huang , Hsiao-Chuan Chang , Yen-Chi Chen , Ting-Han Wei , I-Hau Yeh , Sheng-Yao Kuan , Chien-Yao Wang , Hsuan-Han Lee , I-Chen Wu

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

In distributed applications, such as energy demand forecasting at the substation level or federated learning, a large number of related tasks must be learned by different models, while the exact task relationships are unknown. We propose…

Machine Learning · Computer Science 2026-05-25 Eloi Campagne , Yvenn Amara-Ouali , Yannig Goude , Mathilde Mougeot , Argyris Kalogeratos

Despite recent advances in improving the sample-efficiency of reinforcement learning (RL) algorithms, designing an RL algorithm that can be practically deployed in real-world environments remains a challenge. In this paper, we present…

Robotics · Computer Science 2024-07-11 Younggyo Seo , Jafar Uruç , Stephen James

Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for training a…

Computation and Language · Computer Science 2025-06-19 Xuemei Tang , Jun Wang , Qi Su , Chu-ren Huang , Jinghang Gu

Visual place recognition (VPR) is a key issue for robotics and autonomous systems. For the trade-off between time and performance, most of methods use the coarse-to-fine hierarchical architecture, which consists of retrieving top-N…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Y. Shen , R. Wang , W. Zuo , N. Zheng

In-Context Reinforcement Learning (ICRL) enables agents to learn automatically and on-the-fly from their interactive experiences. However, a major challenge in scaling up ICRL is the lack of scalable task collections. To address this, we…

Machine Learning · Computer Science 2025-11-04 Fan Wang , Pengtao Shao , Yiming Zhang , Bo Yu , Shaoshan Liu , Ning Ding , Yang Cao , Yu Kang , Haifeng Wang

Cross-modal retrieval (CMR) typically involves learning common representations to directly measure similarities between multimodal samples. Most existing CMR methods commonly assume multimodal samples in pairs and employ joint training to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Ruitao Pu , Yang Qin , Dezhong Peng , Xiaomin Song , Huiming Zheng

Reinforcement learning (RL) has emerged as an effective post-training paradigm for enhancing the reasoning capabilities of multimodal large language model (MLLM). However, current RL pipelines often suffer from training inefficiencies…

Machine Learning · Computer Science 2026-03-04 Linghao Zhu , Yiran Guan , Dingkang Liang , Jianzhong Ju , Zhenbo Luo , Bin Qin , Jian Luan , Yuliang Liu , Xiang Bai

Modern power systems face increasing vulnerability to sophisticated cyber-physical attacks beyond traditional N-1 contingency frameworks. Existing security paradigms face a critical bottleneck: efficiently identifying worst-case scenarios…

Systems and Control · Electrical Eng. & Systems 2025-09-17 Saman Mazaheri Khamaneh , Tong Wu , Wei Sun , Cong Chen

Continual learning (CL) is crucial for evaluating adaptability in learning solutions to retain knowledge. Our research addresses the challenge of catastrophic forgetting, where models lose proficiency in previously learned tasks as they…