English
Related papers

Related papers: Optimal control of point-to-point navigation in tu…

200 papers

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

We show that the energy required by a turbulent flow to displace a given amount of fluid through a straight duct in a given time interval can be reduced by modulating in time the pumping power. The control strategy is hybrid: it is passive,…

Fluid Dynamics · Physics 2024-05-15 Giulio Foggi Rota , Alessandro Monti , Marco E. Rosti , Maurizio Quadrio

Motion planning under uncertainty is one of the main challenges in developing autonomous driving vehicles. In this work, we focus on the uncertainty in sensing and perception, resulted from a limited field of view, occlusions, and sensing…

Robotics · Computer Science 2021-10-05 Kasra Rezaee , Peyman Yadmellat , Simon Chamorro

Applying Machine Learning (ML) techniques to design and optimize computer architectures is a promising research direction. Optimizing the runtime performance of a Network-on-Chip (NoC) necessitates a continuous learning framework. In this…

Networking and Internet Architecture · Computer Science 2019-08-14 Sheng-Chun Kao , Chao-Han Huck Yang , Pin-Yu Chen , Xiaoli Ma , Tushar Krishna

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

Robotics · Computer Science 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

Homing and navigation are fundamental behaviors in biological systems that enable agents to reliably reach a target under uncertainty. We present a Reinforcement Learning (RL) framework to model adaptive homing in continuous two-dimensional…

Soft Condensed Matter · Physics 2026-02-10 Riya Singh , Pratikshya Jena , Anish Kumar , Shradha Mishra

In the backdrop of an increasingly pressing need for effective urban and highway transportation systems, this work explores the synergy between model-based and learning-based strategies to enhance traffic flow management by use of an…

Systems and Control · Electrical Eng. & Systems 2025-02-04 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Despite impressive results, reinforcement learning (RL) suffers from slow convergence and requires a large variety of tuning strategies. In this paper, we investigate the ability of RL algorithms on simple continuous control tasks. We show…

Robotics · Computer Science 2024-02-16 Daniel Layeghi , Steve Tonneau , Michael Mistry

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework. RL is an autonomous…

Machine Learning · Computer Science 2021-02-05 Rajesh Siraskar

Reinforcement learning (RL) has been shown to be effective at learning control from experience. However, RL typically requires a large amount of online interaction with the environment. This limits its applicability to real-world settings,…

Autonomous navigation of Unmanned Surface Vehicles (USV) in marine environments with current flows is challenging, and few prior works have addressed the sensorbased navigation problem in such environments under no prior knowledge of the…

Robotics · Computer Science 2023-08-01 Xi Lin , John McConnell , Brendan Englot

We apply a reinforcement learning algorithm to show how smart particles can learn approximately optimal strategies to navigate in complex flows. In this paper we consider microswimmers in a paradigmatic three-dimensional case given by a…

Fluid Dynamics · Physics 2018-04-30 K. Gustavsson , L. Biferale , A. Celani , S. Colabrese

The Optimal Power Flow (OPF) problem is integral to the functioning of power systems, aiming to optimize generation dispatch while adhering to technical and operational constraints. These constraints are far from straightforward; they…

Machine Learning · Computer Science 2023-10-10 Andrew Rosemberg , Mathieu Tanneau , Bruno Fanzeres , Joaquim Garcia , Pascal Van Hentenryck

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow…

Machine Learning · Computer Science 2023-04-04 Niklas Paulig , Ostap Okhrin

This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs). Our primary objectives are to adhere to physical operational constraints while reducing energy…

Artificial Intelligence · Computer Science 2023-10-17 Harsh Patel , Yuan Zhou , Alexander P Lamb , Shu Wang , Jieliang Luo

Compliance with maritime traffic rules is essential for the safe operation of autonomous vessels, yet training reinforcement learning (RL) agents to adhere to them is challenging. The behavior of RL agents is shaped by the training…

Systems and Control · Electrical Eng. & Systems 2026-05-28 Marlon Müller , Florian Finkeldei , Hanna Krasowski , Murat Arcak , Matthias Althoff

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

Robotics · Computer Science 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere