English
Related papers

Related papers: A Test-Function Approach to Incremental Stability

200 papers

Developing stable controllers for large-scale networked dynamical systems is crucial but has long been challenging due to two key obstacles: certifiability and scalability. In this paper, we present a general framework to solve these…

Systems and Control · Electrical Eng. & Systems 2023-04-13 Songyuan Zhang , Yumeng Xiu , Guannan Qu , Chuchu Fan

In this paper, we propose a new robustness notion that is applicable for certifying systems' safety with respect to external disturbance signals. The proposed input-to-state safety (ISSf) notion allows us to certify systems' safety in the…

Systems and Control · Computer Science 2019-02-01 Muhammad Zakiyullah Romdlony , Bayu Jayawardhana

This paper proposes a new regularization technique for reinforcement learning (RL) towards making policy and value functions smooth and stable. RL is known for the instability of the learning process and the sensitivity of the acquired…

Robotics · Computer Science 2023-07-04 Taisuke Kobayashi

In systems where the ability to actuate is a scarce resource, e.g., spacecrafts, it is desirable to only apply a given controller in an intermittent manner--with periods where the controller is on and periods where it is off. Motivated by…

Systems and Control · Electrical Eng. & Systems 2022-04-08 Pio Ong , Gilbert Bahati , Aaron D. Ames

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Reinforcement learning (RL) is an area of significant research interest, and safe RL in particular is attracting attention due to its ability to handle safety-driven constraints that are crucial for real-world applications of RL algorithms.…

Systems and Control · Electrical Eng. & Systems 2023-04-13 Song Bo , Xunyuan Yin , Jinfeng Liu

Reinforcement learning is showing great potentials in robotics applications, including autonomous driving, robot manipulation and locomotion. However, with complex uncertainties in the real-world environment, it is difficult to guarantee…

Machine Learning · Computer Science 2020-07-28 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

Transient stability of power systems is becoming increasingly important because of the growing integration of renewable resources. These resources lead to a reduction in mechanical inertia but also provide increased flexibility in frequency…

Systems and Control · Electrical Eng. & Systems 2021-05-07 Wenqi Cui , Baosen Zhang

Input-to-state stability (ISS) and $\mathcal{L}_2$-gain are well-known robust stability properties that continue to find wide application in the analysis and control of nonlinear dynamical systems and their interconnections. We investigate…

Optimization and Control · Mathematics 2014-05-02 Christopher M. Kellett , Peter M. Dower

Barrier functions (also called certificates) have been an important tool for the verification of hybrid systems, and have also played important roles in optimization and multi-objective control. The extension of a barrier function to a…

Optimization and Control · Mathematics 2016-12-07 Xiangru Xu , Paulo Tabuada , Jessy W. Grizzle , Aaron D. Ames

We investigate the important problem of certifying stability of reinforcement learning policies when interconnected with nonlinear dynamical systems. We show that by regulating the input-output gradients of policies, strong guarantees of…

Systems and Control · Computer Science 2018-10-30 Ming Jin , Javad Lavaei

Despite recent successes in Reinforcement Learning, value-based methods often suffer from high variance hindering performance. In this paper, we illustrate this in a continuous control setting where state of the art methods perform poorly…

Machine Learning · Computer Science 2019-05-24 Pierre Thodoroff , Nishanth Anand , Lucas Caccia , Doina Precup , Joelle Pineau

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

We prove that input-to-state stability (ISS) of nonlinear systems over Banach spaces is equivalent to existence of a coercive Lipschitz continuous ISS Lyapunov function for this system. For linear infinite-dimensional systems, we show that…

Optimization and Control · Mathematics 2017-08-29 Andrii Mironchenko , Fabian Wirth

This paper demonstrates input-to-state stability (ISS) of the SIR model of infectious diseases with respect to the disease-free equilibrium and the endemic equilibrium. Lyapunov functions are constructed to verify that both equilibria are…

Optimization and Control · Mathematics 2020-06-09 Hiroshi Ito

Achieving highly dynamic behaviors on humanoid robots, such as running, requires controllers that are both robust and precise, and hence difficult to design. Classical control methods offer valuable insight into how such systems can…

Robotics · Computer Science 2025-09-25 Zachary Olkin , Kejun Li , William D. Compton , Aaron D. Ames

In a pedagogical but exhaustive manner, this survey reviews the main results on input-to-state stability (ISS) for infinite-dimensional systems. This property allows estimating the impact of inputs and initial conditions on both the…

Optimization and Control · Mathematics 2020-03-09 Andrii Mironchenko , Christophe Prieur

This paper addresses the problem of risk-aware fixed-time stabilization of a class of uncertain, output-feedback nonlinear systems modeled via stochastic differential equations. First, novel classes of certificate functions, namely…

Optimization and Control · Mathematics 2024-04-01 Mitchell Black , Georgios Fainekos , Bardh Hoxha , Dimitra Panagou

The success of Deepseek-R1 has drawn the LLM community's attention to reinforcement learning (RL) methods like GRPO. However, such rule-based 0/1 outcome reward methods lack the capability to regulate the intermediate reasoning processes…

Artificial Intelligence · Computer Science 2025-05-26 Muzhi Dai , Shixuan Liu , Qingyi Si

Analysis of transient stability of strongly nonlinear post-fault dynamics is one of the most computationally challenging parts of Dynamic Security Assessment. This paper proposes a novel approach for assessment of transient stability of the…

Systems and Control · Computer Science 2017-11-01 Thanh Long Vu , Konstantin Turitsyn