English
Related papers

Related papers: Model-free Control of Chaos with Continuous Deep Q…

200 papers

Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor…

Robotics · Computer Science 2024-05-21 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

The introduction of unexpected system disturbances and new system dynamics does not allow guaranteed continuous system stability. In this research we present a novel approach for detecting early failure indicators of non-linear highly…

Systems and Control · Electrical Eng. & Systems 2021-11-02 Amr Mahmoud , Youmna Ismaeil , Mohamed Zohdy

The Mackey--Glass equation, which was proposed to illustrate nonlinear phenomena in physiological control systems, is a classical example of a simple looking time delay system with very complicated behavior. Here we use a novel approach for…

Dynamical Systems · Mathematics 2017-08-21 Gábor Kiss , Gergely Röst

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

We examine a strange chaotic attractor and its unstable periodic orbits in case of one degree of freedom nonlinear oscillator with non symmetric potential. We propose an efficient method of chaos control stabilizing these orbits by a…

Chaotic Dynamics · Physics 2015-06-26 G. Litak , M. Ali , L. M. Saha

Delayed feedback control is an easy realizable control method which generates control force by comparing the current and the delayed version of the system states. In this paper, a new form of the delayed feedback structure is introduced.…

Systems and Control · Computer Science 2019-02-08 Zahed Dastan , Mahsan Tavakoli-Kakhki

We propose and demonstrate a nonlinear control method that can be applied to unknown, complex systems where the controller is based on a type of artificial neural network known as a reservoir computer. In contrast to many modern…

Systems and Control · Electrical Eng. & Systems 2020-10-07 Daniel Canaday , Andrew Pomerance , Daniel J Gauthier

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

Recent work on data-driven control and reinforcement learning has renewed interest in a relative old field in control theory: model-free optimal control approaches which work directly with a cost function and do not rely upon perfect…

Optimization and Control · Mathematics 2021-08-31 Eduardo D. Sontag

Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

Deep model-based reinforcement learning methods offer a conceptually simple approach to the decision-making and control problem: use learning for the purpose of estimating an approximate dynamics model, and offload the rest of the work to…

Machine Learning · Computer Science 2023-07-13 Michael Janner

In this paper a novel model-free algorithm is proposed. This algorithm can learn the nearly optimal control law of constrained-input systems from online data without requiring any a priori knowledge of system dynamics. Based on the concept…

Systems and Control · Electrical Eng. & Systems 2022-05-03 Han Zhao , Lei Guo

In this paper we address the question how the control of delayed measured chaotic systems can be improved. Both unmodified OGY control and difference control can be successfully applied only for a certain range of Lyapunov numbers depending…

chao-dyn · Physics 2007-05-23 Jens Christian Claussen , Heinz Georg Schuster

This paper introduces and analyzes an improved Q-learning algorithm for discrete-time linear time-invariant systems. The proposed method does not require any knowledge of the system dynamics, and it enjoys significant efficiency advantages…

Systems and Control · Electrical Eng. & Systems 2023-04-03 Victor G. Lopez , Mohammad Alsalti , Matthias A. Müller

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

We uncover a dynamical entanglement transition in a monitored quantum system that is heralded by a local order parameter. Classically, chaotic systems can be stochastically controlled onto unstable periodic orbits and exhibit controlled and…

Disordered Systems and Neural Networks · Physics 2022-08-10 Thomas Iadecola , Sriram Ganeshan , J. H. Pixley , Justin H. Wilson

Reinforcement learning (RL) algorithms for real-world robotic applications need a data-efficient learning process and the ability to handle complex, unknown dynamical systems. These requirements are handled well by model-based and…

Robotics · Computer Science 2017-06-20 Yevgen Chebotar , Karol Hausman , Marvin Zhang , Gaurav Sukhatme , Stefan Schaal , Sergey Levine

We study learning control in an online reset-free lifelong learning scenario, where mistakes can compound catastrophically into the future and the underlying dynamics of the environment may change. Traditional model-free policy learning…

Machine Learning · Computer Science 2020-06-30 Kevin Lu , Igor Mordatch , Pieter Abbeel

This paper presents a novel model-reference reinforcement learning algorithm for the intelligent tracking control of uncertain autonomous surface vehicles with collision avoidance. The proposed control algorithm combines a conventional…

Systems and Control · Electrical Eng. & Systems 2020-08-18 Qingrui Zhang , Wei Pan , Vasso Reppa