English
Related papers

Related papers: MAD: A Magnitude And Direction Policy Parametrizat…

200 papers

Hamilton-Jacobi (HJ) Reachability offers a framework for generating safe value functions and policies in the face of adversarial disturbance, but is limited by the curse of dimensionality. Physics-informed deep learning is able to overcome…

Robotics · Computer Science 2025-10-22 Ryan Teoh , Sander Tonkens , William Sharpless , Aijia Yang , Zeyuan Feng , Somil Bansal , Sylvia Herbert

Reinforcement learning (RL) with continuous time and state/action spaces is often data-intensive and brittle under nuisance variability and shift, motivating methods that exploit value-preserving structures to stabilize and improve…

Machine Learning · Computer Science 2026-05-08 Zuyuan Zhang , Fei Xu Yu , Tian Lan

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

Machine Learning · Computer Science 2019-08-22 Tiancheng Yu , Suvrit Sra

Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated Chain-of-Thought (CoT) trajectories often exceed what the underlying problems require,…

Machine Learning · Computer Science 2026-05-12 Songtao Wei , Yi Li , Zhikai Li , Xu Hu , Yuede Ji , Guanpeng Li , Feng Chen , Carl Yang , Zhichun Guo , Bingzhe Li

Deep reinforcement learning (deep RL) excels in various domains but lacks generalizability and interpretability. On the other hand, programmatic RL methods (Trivedi et al., 2021; Liu et al., 2023) reformulate RL tasks as synthesizing…

Machine Learning · Computer Science 2024-02-12 Yu-An Lin , Chen-Tao Lee , Guan-Ting Liu , Pu-Jen Cheng , Shao-Hua Sun

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

The control of far-from-equilibrium physical systems, including active materials, has emerged as an important area for the application of reinforcement learning (RL) strategies to derive control policies for physical systems. In active…

Machine Learning · Computer Science 2021-12-23 Dominik Schildknecht , Anastasia N. Popova , Jack Stellwagen , Matt Thomson

We propose an actor-critic, model-free, and online Reinforcement Learning (RL) framework for continuous-state continuous-action Markov Decision Processes (MDPs) when the reward is highly sparse but encompasses a high-level temporal…

Machine Learning · Computer Science 2019-11-26 Lim Zun Yuan , Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Discrimination of entangled states is an important element of quantum enhanced metrology. This typically requires low-noise detection technology. Such a challenge can be circumvented by introducing nonlinear readout process. Traditionally,…

Quantum Physics · Physics 2023-08-16 Jia-Hao Cao , Feng Chen , Qi Liu , Tian-Wei Mao , Wen-Xin Xu , Ling-Na Wu , Li You

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

Deep reinforcement learning (RL) has achieved great empirical successes in various domains. However, the large search space of neural networks requires a large amount of data, which makes the current RL algorithms not sample efficient.…

Machine Learning · Computer Science 2020-08-18 Qianli Shen , Yan Li , Haoming Jiang , Zhaoran Wang , Tuo Zhao

We develop reinforcement learning (RL) boundary controllers to mitigate stop-and-go traffic congestion on a freeway segment. The traffic dynamics of the freeway segment are governed by a macroscopic Aw-Rascle-Zhang (ARZ) model, consisting…

Optimization and Control · Mathematics 2021-01-18 Huan Yu , Saehong Park , Alexandre Bayen , Scott Moura , Miroslav Krstic

Reinforcement Learning (RL) has achieved impressive results in robotics, yet high-performing pipelines remain highly task-specific, with little reuse of prior data. Offline Model-based RL (MBRL) offers greater data efficiency by training…

Robotics · Computer Science 2026-01-09 Chenhao Li , Andreas Krause , Marco Hutter

Many of the challenges facing today's reinforcement learning (RL) algorithms, such as robustness, generalization, transfer, and computational efficiency are closely related to compression. Prior work has convincingly argued why minimizing…

Machine Learning · Computer Science 2021-09-08 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

In this paper, we propose a model-free reinforcement learning method to synthesize control policies for motion planning problems with continuous states and actions. The robot is modelled as a labeled discrete-time Markov decision process…

Artificial Intelligence · Computer Science 2020-10-01 Chuanzheng Wang , Yinan Li , Stephen L. Smith , Jun Liu

A critical problem with the practical utility of controllers trained with deep Reinforcement Learning (RL) is the notable lack of smoothness in the actions learned by the RL policies. This trend often presents itself in the form of control…

Robotics · Computer Science 2021-05-28 Siddharth Mysore , Bassel Mabsout , Renato Mancuso , Kate Saenko

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

Robotics · Computer Science 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

Proportional-integral-derivative (PID) controller is widely used across various industrial process control applications because of its straightforward implementation. However, it can be challenging to fine-tune the PID parameters in…

Systems and Control · Electrical Eng. & Systems 2022-06-09 Hozefa Jesawada , Amol Yerudkar , Carmen Del Vecchio , Navdeep Singh

Power systems must maintain the frequency within acceptable limits when subjected to a disturbance. To ensure this, the most significant credible disturbance in the system is normally used as a benchmark to allocate the Primary Frequency…

Dynamical Systems · Mathematics 2023-11-28 Alinane B. Kilembe Panagiotis N. Papadopoulos