English
Related papers

Related papers: Lyapunov Design for Robust and Efficient Robotic R…

200 papers

This paper develops a novel control synthesis method for safe stabilization of control-affine systems as a Differential Complementarity Problem (DCP). Our design uses a control Lyapunov function (CLF) and a control barrier function (CBF) to…

Optimization and Control · Mathematics 2023-01-04 Yinzhuang Yi , Shumon Koga , Bogdan Gavrea , Nikolay Atanasov

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Reinforcement learning (RL) has demonstrated the ability to maintain the plasticity of the policy throughout short-term training in aerial robot control. However, these policies have been shown to loss of plasticity when extended to…

Robotics · Computer Science 2025-03-11 Ali Tahir Karasahin , Ziniu Wu , Basaran Bahadir Kocer

We present a true-dynamics-agnostic, statistically rigorous framework for establishing exponential stability and safety guarantees of closed-loop, data-driven nonlinear control. Central to our approach is the novel concept of conformal…

Systems and Control · Electrical Eng. & Systems 2025-06-12 Ting-Wei Hsu , Hiroyasu Tsukamoto

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic…

Machine Learning · Computer Science 2022-03-10 Yikun Cheng , Pan Zhao , Manan Gandhi , Bo Li , Evangelos Theodorou , Naira Hovakimyan

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

This paper presents a risk-aware safe reinforcement learning (RL) control design for stochastic discrete-time linear systems. Rather than using a safety certifier to myopically intervene with the RL controller, a risk-informed safe…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Babak Esmaeili , Nariman Niknejad , Hamidreza Modares

Learning-based neural network (NN) control policies have shown impressive empirical performance in a wide range of tasks in robotics and control. However, formal (Lyapunov) stability guarantees over the region-of-attraction (ROA) for NN…

Machine Learning · Computer Science 2024-06-06 Lujie Yang , Hongkai Dai , Zhouxing Shi , Cho-Jui Hsieh , Russ Tedrake , Huan Zhang

Recent years have seen a rise in interest in terms of using machine learning, particularly reinforcement learning (RL), for production scheduling problems of varying degrees of complexity. The general approach is to break down the…

Machine Learning · Computer Science 2023-02-16 Alexandru Rinciog , Anne Meyer

Recent work has shown that stabilizing an affine control system to a desired state while optimizing a quadratic cost subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control Barrier…

Systems and Control · Electrical Eng. & Systems 2021-02-16 Wei Xiao , Calin A. Belta , Christos G. Cassandras

In traffic signal control, flow-based (optimizing the overall flow) and pressure-based methods (equalizing and alleviating congestion) are commonly used but often considered separately. This study introduces a unified framework using…

Systems and Control · Electrical Eng. & Systems 2024-01-18 Chaolun Ma , Bruce Wang , Zihao Li , Ahmadreza Mahmoudzadeh , Yunlong Zhang

Control laws derived from Control-Lyapunov Functions (CLFs) offer an efficient way for generating near-optimal many-revolution low-thrust trajectories. A common approach to constructing CLFs is to consider the family of quadratic functions…

Optimization and Control · Mathematics 2024-09-02 Nicholas P. Nurre , Saeid Tafazzol , Ehsan Taheri

This paper considers safe control synthesis for dynamical systems with either probabilistic or worst-case uncertainty in both the dynamics model and the safety constraints. We formulate novel probabilistic and robust (worst-case) control…

Robotics · Computer Science 2022-10-04 Kehan Long , Vikas Dhiman , Melvin Leok , Jorge Cortés , Nikolay Atanasov

Reinforcement Learning (RL) offers promising solutions for control tasks in industrial cyber-physical systems (ICPSs), yet its real-world adoption remains limited. This paper demonstrates how seemingly small but well-designed modifications…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Georg Schäfer , Tatjana Krau , Jakob Rehrl , Stefan Huber , Simon Hirlaender

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges,…

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen