English
Related papers

Related papers: CROP: Towards Distributional-Shift Robust Reinforc…

200 papers

Cooperative multi-agent reinforcement learning (MARL) aims to develop agents that can collaborate effectively. However, most cooperative MARL methods overfit training agents, making learned policies not generalize well to unseen…

Artificial Intelligence · Computer Science 2025-01-13 Kanefumi Matsuyama , Kefan Su , Jiangxing Wang , Deheng Ye , Zongqing Lu

This paper investigates how to efficiently transition and update policies, trained initially with demonstrations, using off-policy actor-critic reinforcement learning. It is well-known that techniques based on Learning from Demonstrations,…

Machine Learning · Computer Science 2020-04-07 Vinicius G. Goecks , Gregory M. Gremillion , Vernon J. Lawhern , John Valasek , Nicholas R. Waytowich

Knowledge distillation enables fast and effective transfer of features learned from a bigger model to a smaller one. However, distillation objectives are susceptible to sub-population shifts, a common scenario in medical imaging analysis…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Konstantinos Vilouras , Xiao Liu , Pedro Sanchez , Alison Q. O'Neil , Sotirios A. Tsaftaris

Vision-based reinforcement learning (RL) is a promising approach to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-10-05 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

Binary code representation learning has shown significant performance in binary analysis tasks. But existing solutions often have poor transferability, particularly in few-shot and zero-shot scenarios where few or no training samples are…

Software Engineering · Computer Science 2024-02-28 Hao Wang , Zeyu Gao , Chao Zhang , Zihan Sha , Mingyang Sun , Yuchen Zhou , Wenyu Zhu , Wenju Sun , Han Qiu , Xi Xiao

A critical problem with the practical utility of controllers trained with deep Reinforcement Learning (RL) is the notable lack of smoothness in the actions learned by the RL policies. This trend often presents itself in the form of control…

Robotics · Computer Science 2021-05-28 Siddharth Mysore , Bassel Mabsout , Renato Mancuso , Kate Saenko

General intelligence requires quick adaption across tasks. While existing reinforcement learning (RL) methods have made progress in generalization, they typically assume only distribution changes between source and target domains. In this…

Machine Learning · Computer Science 2025-03-07 Yupei Yang , Biwei Huang , Fan Feng , Xinyue Wang , Shikui Tu , Lei Xu

While the traditional formulation of machine learning tasks is in terms of performance on average, in practice we are often interested in how well a trained model performs on rare or difficult data points at test time. To achieve more…

Machine Learning · Computer Science 2025-12-29 Matthew J. Holland , Toma Hamada

Certified defense using randomized smoothing is a popular technique to provide robustness guarantees for deep neural networks against l2 adversarial attacks. Existing works use this technique to provably secure a pretrained non-robust model…

Machine Learning · Computer Science 2022-10-18 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

The performance of Large Language Models (LLMs) is increasingly governed by data efficiency rather than raw scaling volume. However, existing selection methods often decouple global distribution balancing from local instance selection,…

Computation and Language · Computer Science 2026-03-03 Changhao Wang , Jiaolong Yang , Xinhao Yao , Yunfei Yu , Peng Jiao , Lu Yu , Junpeng Fang , Riccardo Cantoro , Qing Cui , Jun Zhou

The inverse reinforcement learning approach to imitation learning is a double-edged sword. On the one hand, it can enable learning from a smaller number of expert demonstrations with more robustness to error compounding than behavioral…

Machine Learning · Computer Science 2024-06-06 Juntao Ren , Gokul Swamy , Zhiwei Steven Wu , J. Andrew Bagnell , Sanjiban Choudhury

Autonomous systems operate in environments that may change over time. An example is the control of a self-driving vehicle among pedestrians and human-controlled vehicles whose behavior may change based on factors such as traffic density,…

Systems and Control · Electrical Eng. & Systems 2026-02-16 Kaizer Rahaman , Jyotirmoy V. Deshmukh , Ashish R. Hota , Lars Lindemann

Deep Reinforcement Learning (DRL) has emerged as a promising approach for solving Combinatorial Optimization (CO) problems, such as the 3D Bin Packing Problem (3D-BPP), Traveling Salesman Problem (TSP), or Vehicle Routing Problem (VRP), but…

Machine Learning · Computer Science 2026-01-30 Han Fang , Paul Weng , Yutong Ban

This paper proposes an algorithm that aims to improve generalization for reinforcement learning agents by removing overfitting to confounding features. Our approach consists of a max-min game theoretic objective. A generator transfers the…

Machine Learning · Computer Science 2023-08-31 Md Masudur Rahman , Yexiang Xue

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

In this paper, we are interested in systems with multiple agents that wish to collaborate in order to accomplish a common task while a) agents have different information (decentralized information) and b) agents do not know the model of the…

Optimization and Control · Mathematics 2020-12-04 Jalal Arabneydi , Aditya Mahajan

Many problems in Reinforcement Learning (RL) seek an optimal policy with large discrete multidimensional yet unordered action spaces; these include problems in randomized allocation of resources such as placements of multiple security…

Machine Learning · Computer Science 2023-11-28 Changyu Chen , Ramesha Karunasena , Thanh Hong Nguyen , Arunesh Sinha , Pradeep Varakantham

Reinforcement learning (RL) has garnered increasing attention in text-to-image (T2I) generation. However, most existing RL approaches are tailored to either diffusion models or autoregressive models, overlooking an important alternative:…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifu Luo , Xinhao Hu , Keyu Fan , Haoyuan Sun , Zeyu Chen , Bo Xia , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

In reinforcement learning with image-based inputs, it is crucial to establish a robust and generalizable state representation. Recent advancements in metric learning, such as deep bisimulation metric approaches, have shown promising results…

Machine Learning · Computer Science 2024-11-12 Jianda Chen , Wen Zheng Terence Ng , Zichen Chen , Sinno Jialin Pan , Tianwei Zhang

As machine learning models are deployed ever more broadly, it becomes increasingly important that they are not only able to perform well on their training distribution, but also yield accurate predictions when confronted with distribution…

Machine Learning · Computer Science 2022-04-14 Paul Michel , Tatsunori Hashimoto , Graham Neubig