English
Related papers

Related papers: Differentiable Trust Region Layers for Deep Reinfo…

200 papers

Legged locomotion in unstructured environments demands not only high-performance control policies but also formal guarantees to ensure robustness under perturbations. Control methods often require carefully designed reference trajectories,…

Robotics · Computer Science 2026-03-23 Vrushabh Zinage , Narek Harutyunyan , Eric Verheyden , Fred Y. Hadaegh , Soon-Jo Chung

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

Machine Learning · Computer Science 2020-06-16 Jun Song , Chaoyue Zhao

Reinforcement learning (RL) in continuous state-action spaces remains challenging in scientific computing due to poor sample efficiency and lack of pathwise physical consistency. We introduce Differential Reinforcement Learning…

Machine Learning · Computer Science 2026-02-06 Minh Nguyen , Chandrajit Bajaj

In recent years, there has been a growing research interest in decision-focused learning, which embeds optimization problems as a layer in learning pipelines and demonstrates a superior performance than the prediction-focused approach.…

Optimization and Control · Mathematics 2024-06-25 Xutao Ma , Chao Ning , Wenli Du

Most of reinforcement learning algorithms optimize the discounted criterion which is beneficial to accelerate the convergence and reduce the variance of estimates. Although the discounted criterion is appropriate for certain tasks such as…

Machine Learning · Computer Science 2021-11-02 Xiaoteng Ma , Xiaohang Tang , Li Xia , Jun Yang , Qianchuan Zhao

Acquisition of training data for the standard semantic segmentation is expensive if requiring that each pixel is labeled. Yet, current methods significantly deteriorate in weakly supervised settings, e.g. where a fraction of pixels is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Dmitrii Marin , Yuri Boykov

Policies produced by deep reinforcement learning are typically characterised by their learning curves, but they remain poorly understood in many other respects. ReLU-based policies result in a partitioning of the input space into piecewise…

Machine Learning · Computer Science 2022-11-10 Setareh Cohan , Nam Hee Kim , David Rolnick , Michiel van de Panne

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

Optimization and Control · Mathematics 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

Work in psychology has highlighted that the geometric model of similarity standard in deep learning is not psychologically plausible because its metric properties such as symmetry do not align with human perception of similarity. In…

Machine Learning · Computer Science 2025-10-14 Moussa Koulako Bala Doumbouya , Dan Jurafsky , Christopher D. Manning

Achieving fast and stable off-policy learning in deep reinforcement learning (RL) is challenging. Most existing methods rely on semi-gradient temporal-difference (TD) methods for their simplicity and efficiency, but are consequently…

Machine Learning · Computer Science 2025-09-22 Esraa Elelimy , Brett Daley , Andrew Patterson , Marlos C. Machado , Adam White , Martha White

GRPO-style reinforcement learning (RL)-based LLM fine-tuning algorithms have recently gained popularity. Relying on heuristic trust-region approximations, however, they can lead to brittle optimization behavior, as global importance-ratio…

Machine Learning · Computer Science 2026-02-09 Doyeon Lee , Eunyi Lyou , Hyunsoo Cho , Sookyung Kim , Joonseok Lee , Jaemoo Choi

We present trust region bounds for optimizing decentralized policies in cooperative Multi-Agent Reinforcement Learning (MARL), which holds even when the transition dynamics are non-stationary. This new analysis provides a theoretical…

Machine Learning · Computer Science 2023-02-16 Mingfei Sun , Sam Devlin , Jacob Beck , Katja Hofmann , Shimon Whiteson

We propose a spurious region guided refinement approach for robustness verification of deep neural networks. Our method starts with applying the DeepPoly abstract domain to analyze the network. If the robustness property cannot be verified,…

Artificial Intelligence · Computer Science 2020-10-16 Pengfei Yang , Renjue Li , Jianlin Li , Cheng-Chao Huang , Jingyi Wang , Jun Sun , Bai Xue , Lijun Zhang

Post-training methods, especially Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), play an important role in improving large language models' (LLMs) complex reasoning abilities. However, the dominant two-stage pipeline (SFT…

Machine Learning · Computer Science 2025-12-22 Mingyu Su , Jian Guan , Yuxian Gu , Minlie Huang , Hongning Wang

One of the key challenges to deep reinforcement learning (deep RL) is to ensure safety at both training and testing phases. In this work, we propose a novel technique of unsupervised action planning to improve the safety of on-policy…

Robotics · Computer Science 2021-09-30 Hao-Lun Hsu , Qiuhua Huang , Sehoon Ha

On-policy reinforcement learning (RL) has become a popular framework for solving sequential decision problems due to its computational efficiency and theoretical simplicity. Some on-policy methods guarantee every policy update is…

Machine Learning · Computer Science 2023-12-12 K. R. Zentner , Ujjwal Puri , Zhehui Huang , Gaurav S. Sukhatme

Reinforcement Learning (RL) agents can solve diverse tasks but often exhibit unsafe behavior. Constrained Markov Decision Processes (CMDPs) address this by enforcing safety constraints, yet existing methods either sacrifice reward…

Machine Learning · Computer Science 2025-08-18 Nikola Milosevic , Johannes Müller , Nico Scherf

Deep reinforcement learning is an increasingly popular technique for synthesising policies to control an agent's interaction with its environment. There is also growing interest in formally verifying that such policies are correct and…

Artificial Intelligence · Computer Science 2022-06-02 Edoardo Bacci , David Parker

Policy gradient algorithms are an important family of deep reinforcement learning techniques. Many past research endeavors focused on using the first-order policy gradient information to train policy networks. Different from these works, we…

Machine Learning · Computer Science 2023-05-19 Gang Chen , Victoria Huang

Continual learning aims to acquire tasks sequentially without catastrophic forgetting, yet standard strategies face a core tradeoff: regularization-based methods (e.g., EWC) can overconstrain updates when task optima are weakly overlapping,…

Machine Learning · Computer Science 2026-05-28 Zekun Wang , Anant Gupta , Christopher J. MacLellan