English
Related papers

Related papers: L2C2: Locally Lipschitz Continuous Constraint towa…

200 papers

We investigate an entropy-regularized reinforcement learning (RL) approach to optimal stopping problems motivated by real option models. Classical stopping rules are strict and non-randomized, limiting natural exploration in RL settings. To…

Optimization and Control · Mathematics 2026-02-18 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

Reinforcement learning (RL) has become the de facto method for achieving locomotion on humanoid robots in practice, yet stability analysis of the corresponding control policies is lacking. Recent work has attempted to merge control…

Systems and Control · Electrical Eng. & Systems 2026-05-07 Zachary Olkin , William D. Compton , Aaron D. Ames

Reinforcement learning (RL) has achieved remarkable success in various robotic tasks; however, its deployment in real-world scenarios, particularly in contact-rich environments, often overlooks critical safety and stability aspects.…

Robotics · Computer Science 2025-06-13 Heng Zhang , Gokhan Solak , Sebastian Hjorth , Arash Ajoudani

We propose an automata-theoretic approach for reinforcement learning (RL) under complex spatio-temporal constraints with time windows. The problem is formulated using a Markov decision process under a bounded temporal logic constraint.…

Artificial Intelligence · Computer Science 2023-08-01 Xiaoshan Lin , Abbasali Koochakzadeh , Yasin Yazicioglu , Derya Aksaray

Large language models (LLMs) have shown remarkable abilities in logical reasoning, in-context learning, and code generation. However, translating natural language instructions into effective robotic control policies remains a significant…

Machine Learning · Computer Science 2025-08-28 Utsav Singh , Pramit Bhattacharyya , Vinay P. Namboodiri

Entropic regularization of policies in Reinforcement Learning (RL) is a commonly used heuristic to ensure that the learned policy explores the state-space sufficiently before overfitting to a local optimal policy. The primary motivation for…

Machine Learning · Computer Science 2021-01-19 Hisham Husain , Kamil Ciosek , Ryota Tomioka

This work proposes an efficient batch algorithm for feature selection in reinforcement learning (RL) with theoretical convergence guarantees. To mitigate the estimation bias inherent in conventional regularization schemes, the first…

Machine Learning · Computer Science 2025-09-22 Kyohei Suzuki , Konstantinos Slavakis

Trainable activation functions, whose parameters are optimized alongside network weights, offer increased expressivity compared to fixed activation functions. Specifically, trainable activation functions defined as ratios of polynomials…

Machine Learning · Computer Science 2025-07-22 Rafał Surdej , Michał Bortkiewicz , Alex Lewandowski , Mateusz Ostaszewski , Clare Lyle

The lack of stability guarantee restricts the practical use of learning-based methods in core control problems in robotics. We develop new methods for learning neural control policies and neural Lyapunov critic functions in the model-free…

Robotics · Computer Science 2021-07-13 Ya-Chien Chang , Sicun Gao

This paper proposes a class of well-conditioned neural networks in which a unit amount of change in the inputs causes at most a unit amount of change in the outputs or any of the internal layers. We develop the known methodology of…

Artificial Intelligence · Computer Science 2019-02-07 Haifeng Qian , Mark N. Wegman

Robustness to noise is of utmost importance in reinforcement learning systems, particularly in military contexts where high stakes and uncertain environments prevail. Noise and uncertainty are inherent features of military operations,…

Machine Learning · Computer Science 2023-11-16 Lorenzo Nodari , Federico Cerutti

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

Many problems in Reinforcement Learning (RL) seek an optimal policy with large discrete multidimensional yet unordered action spaces; these include problems in randomized allocation of resources such as placements of multiple security…

Machine Learning · Computer Science 2023-11-28 Changyu Chen , Ramesha Karunasena , Thanh Hong Nguyen , Arunesh Sinha , Pradeep Varakantham

We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…

Optimization and Control · Mathematics 2024-04-23 Namkyeong Cho , Yeoneung Kim

We present an algorithm for local, regularized, policy improvement in reinforcement learning (RL) that allows us to formulate model-based and model-free variants in a single framework. Our algorithm can be interpreted as a natural extension…

This paper presents a risk-aware safe reinforcement learning (RL) control design for stochastic discrete-time linear systems. Rather than using a safety certifier to myopically intervene with the RL controller, a risk-informed safe…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Babak Esmaeili , Nariman Niknejad , Hamidreza Modares

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

Despite recent success, state-of-the-art learning-based models remain highly vulnerable to input changes such as adversarial examples. In order to obtain certifiable robustness against such perturbations, recent work considers…

Machine Learning · Computer Science 2023-09-13 Max Losch , David Stutz , Bernt Schiele , Mario Fritz

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh