English
Related papers

Related papers: Controlling dynamics of stochastic systems with de…

200 papers

We consider a general class of stochastic networks and ask which network nodes need to be controlled, and how, to stabilize and switch between desired metastable (target) states in terms of the first and second statistical moments of the…

Adaptation and Self-Organizing Systems · Physics 2016-07-20 Dmytro Bielievtsov , Josef Ladenbauer , Klaus Obermayer

Dual control denotes a class of control problems where the parameters governing the system are imperfectly known. The challenge is to find the optimal balance between probing, i.e. exciting the system to understand it more, and caution,…

Optimization and Control · Mathematics 2020-04-29 Martin Péron , Christopher M. Baker , Barry D. Hughes , Iadine Chadès

The ability to effectively control brain dynamics holds great promise for the enhancement of cognitive function in humans, and the betterment of their quality of life. Yet, successfully controlling dynamics in neural systems is challenging,…

Quantitative Methods · Quantitative Biology 2018-08-29 Evelyn Tang , Danielle S. Bassett

We propose a simple, practical and intuitive approach to improve the performance of a conventional controller in uncertain environments using deep reinforcement learning while maintaining safe operation. Our approach is motivated by the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Tom Staessens , Tom Lefebvre , Guillaume Crevecoeur

Reinforcement learning is a promising approach to learning robotics controllers. It has recently been shown that algorithms based on finite-difference estimates of the policy gradient are competitive with algorithms based on the policy…

Machine Learning · Computer Science 2021-10-12 Osbert Bastani

The theory of covariance control and covariance steering (CS) deals with controlling the dispersion of trajectories of a dynamical system, under the implicit assumption that accurate prior knowledge of the system being controlled is…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Joshua Pilipovsky , Panagiotis Tsiotras

Accurate state estimation is critical for optimal policy design in dynamic systems. However, obtaining true system states is often impractical or infeasible, complicating the policy learning process. This paper introduces a novel neural…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ashik E Rasul , Hyung-Jin Yoon

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

The physical design of a robot and the policy that controls its motion are inherently coupled, and should be determined according to the task and environment. In an increasing number of applications, data-driven and learning-based…

Robotics · Computer Science 2018-09-18 Charles Schaff , David Yunis , Ayan Chakrabarti , Matthew R. Walter

We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and…

Machine Learning · Computer Science 2020-09-10 Victor M. Martinez Alvarez , Rareş Roşca , Cristian G. Fălcuţescu

This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available…

Optimization and Control · Mathematics 2021-08-31 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

Many real world stochastic control problems suffer from the "curse of dimensionality". To overcome this difficulty, we develop a deep learning approach that directly solves high-dimensional stochastic control problems based on Monte-Carlo…

Machine Learning · Computer Science 2016-11-23 Jiequn Han , Weinan E

We present the first application of an Artificial Neural Network trained through a Deep Reinforcement Learning agent to perform active flow control. It is shown that, in a 2D simulation of the Karman vortex street at moderate Reynolds…

Fluid Dynamics · Physics 2019-03-27 Jean Rabault , Miroslav Kuchta , Atle Jensen , Ulysse Reglade , Nicolas Cerardi

The increasing deployment of end use power resources in distribution systems created active distribution systems. Uncontrolled active distribution systems exhibit wide variations of voltage and loading throughout the day as some of these…

Systems and Control · Electrical Eng. & Systems 2022-08-01 Matthew Lau , Kayla Thames , Sakis Meliopoulos

Traditional economic models often rely on fixed assumptions about market dynamics, limiting their ability to capture the complexities and stochastic nature of real-world scenarios. However, reality is more complex and includes noise, making…

The robust disturbance rejection controller has been the subject of intensive research due to its undeniable importance for automation. Modern control theory tends to use model-based approaches versus model-free approaches, especially when…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Atta Oveisi

We present a novel, model-free, and data-driven methodology for controlling complex dynamical systems into previously unseen target states, including those with significantly different and complex dynamics. Leveraging a parameter-aware…

Chaotic Dynamics · Physics 2026-02-13 Daniel Köglmayr , Alexander Haluszczynski , Christoph Räth

In this paper a new framework has been applied to the design of controllers which encompasses nonlinearity, hysteresis and arbitrary density functions of forward models and inverse controllers. Using mixture density networks, the…

Optimization and Control · Mathematics 2018-01-09 Randa Herzallah

This paper presents a reinforcement learning approach to synthesizing task-driven control policies for robotic systems equipped with rich sensory modalities (e.g., vision or depth). Standard reinforcement learning algorithms typically…

Machine Learning · Computer Science 2020-02-05 Vincent Pacelli , Anirudha Majumdar

Probabilistic Boolean Networks (PBNs) were introduced as a computational model for the study of complex dynamical systems, such as Gene Regulatory Networks (GRNs). Controllability in this context is the process of making strategic…

Machine Learning · Computer Science 2020-09-08 Georgios Papagiannis , Sotiris Moschoyiannis