English
Related papers

Related papers: Learning-based hierarchical control of water reser…

200 papers

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Aerial robots can enhance their safe and agile navigation in complex and cluttered environments by efficiently exploiting the information collected during a given task. In this paper, we address the learning model predictive control problem…

Robotics · Computer Science 2024-01-10 Guanrui Li , Alex Tunchez , Giuseppe Loianno

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

Model Predictive Control (MPC) is an optimal control strategy suited for flood control of water resources infrastructure. Despite many studies on reservoir flood control and their theoretical contribution, optimisation methodologies have…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Ja-Ho Koo , Edo Abraham , Andreja Jonoski , Dimitri P. Solomatine

Recent studies on reservoir computing essentially involve a high dimensional dynamical system as the reservoir, which transforms and stores the input as a higher dimensional state, for temporal and nontemporal data processing. We…

Disordered Systems and Neural Networks · Physics 2024-08-05 R. Arun , M. Sathish Aravindh , A. Venkatesan , M. Lakshmanan

A flow control system is a critical concept for increasing the production capacity of manufacturing systems. To solve the scheduling optimization problem related to the flow control with the aim of improving productivity, existing methods…

Machine Learning · Computer Science 2023-10-13 Hwajong Lee , Chan Kim , Seong-Woo Kim

A robust Learning Model Predictive Controller (LMPC) for uncertain systems performing iterative tasks is presented. At each iteration of the control task the closed-loop state, input and cost are stored and used in the controller design.…

Systems and Control · Electrical Eng. & Systems 2021-07-06 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

The development of current building energy system operation has benefited from: 1. Informational support from the optimal design through simulation or first-principles models; 2. System load and energy prediction through machine learning…

Machine Learning · Computer Science 2023-02-22 Xia Chen , Xiaoye Cai , Alexander Kümpel , Dirk Müller , Philipp Geyer

Legged locomotion is a complex control problem that requires both accuracy and robustness to cope with real-world challenges. Legged systems have traditionally been controlled using trajectory optimization with inverse dynamics. Such…

Robotics · Computer Science 2024-01-23 Fabian Jenelten , Junzhe He , Farbod Farshidian , Marco Hutter

Closed-loop management of geological CO2 storage requires control policies that adapt to uncertain reservoir behavior while relying on observations that are realistically available during operation. This work formulates CO2 injection and…

Machine Learning · Computer Science 2026-05-05 Sofianos Panagiotis Fotias , Vassilis Gaganis

Reference tracking systems involve a plant that is stabilized by a local feedback controller and a command center that indicates the reference set-point the plant should follow. Typically, these systems are subject to limitations such as…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Maria Angelica Arroyo , Luis Felipe Giraldo

Automatic parameter tuning methods for planning algorithms, which integrate pipeline approaches with learning-based techniques, are regarded as promising due to their stability and capability to handle highly constrained environments. While…

Robotics · Computer Science 2025-03-25 Lu Wangtao , Wei Yufei , Xu Jiadong , Jia Wenhao , Li Liang , Xiong Rong , Wang Yue

Water scarcity is an urgent issue to be resolved and improving irrigation water-use efficiency through closed-loop control is essential. The complex agro-hydrological system dynamics, however, often pose challenges in closed-loop control…

Systems and Control · Electrical Eng. & Systems 2022-04-28 Zhiyinan Huang , Jinfeng Liu , Biao Huang

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model…

Machine Learning · Statistics 2016-04-13 Florimond Guéniat , Lionel Mathelin , M. Yousuff Hussaini

A random recurrent neural network, called a reservoir, can be used to learn robot movements conditioned on context inputs that encode task goals. The Learning is achieved by mapping the random dynamics of the reservoir modulated by context…

Robotics · Computer Science 2024-11-19 Zahra Koulaeizadeh , Erhan Oztop

Animals often demonstrate a remarkable ability to adapt to their environments during their lifetime. They do so partly due to the evolution of morphological and neural structures. These structures capture features of environments shared…

Machine Learning · Computer Science 2024-01-30 Corentin Léger , Gautier Hamon , Eleni Nisioti , Xavier Hinaut , Clément Moulin-Frier

As demand for computational resources reaches unprecedented levels, research is expanding into the use of complex material substrates for computing. In this study, we interface with a model of a hydrodynamic system, under development by a…

Neural and Evolutionary Computing · Computer Science 2023-04-24 Alessandro Pierro , Kristine Heiney , Shamit Shrivastava , Giulia Marcucci , Stefano Nichele

One major issue in learning-based model predictive control (MPC) for autonomous driving is the contradiction between the system model's prediction accuracy and computation efficiency. The more situations a system model covers, the more…

Robotics · Computer Science 2023-04-11 Kang Zhao , Jianru Xue , Xiangning Meng , Gengxin Li , Mengsen Wu