English
Related papers

Related papers: Robust flow control and optimal sensor placement u…

200 papers

Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Nathan P. Lawrence , Michael G. Forbes , Philip D. Loewen , Daniel G. McClement , Johan U. Backstrom , R. Bhushan Gopaluni

A flow control system is a critical concept for increasing the production capacity of manufacturing systems. To solve the scheduling optimization problem related to the flow control with the aim of improving productivity, existing methods…

Machine Learning · Computer Science 2023-10-13 Hwajong Lee , Chan Kim , Seong-Woo Kim

This study investigates the effectiveness of Model Predictive Control (MPC) and Reinforcement Learning (RL) for active flow control over a NACA 4412 airfoil near static stall at Reynolds number 4*10^5. By systematically evaluating these…

Reinforcement learning is of increasing importance in the field of robot control and simulation plays a~key role in this process. In the unmanned aerial vehicles (UAVs, drones), there is also an increase in the number of published…

Robotics · Computer Science 2023-07-27 Pawel Miera , Hubert Szolc , Tomasz Kryjak

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a 2D square bluff body at laminar regimes with vortex shedding. Controllers parameterised by neural networks are trained to drive two…

Fluid Dynamics · Physics 2024-01-17 Chengwei Xia , Junjie Zhang , Eric C. Kerrigan , Georgios Rigas

There is a critical need for efficient and reliable active flow control strategies to reduce drag and noise in aerospace and marine engineering applications. While traditional full-order models based on the Navier-Stokes equations are not…

Fluid Dynamics · Physics 2022-11-02 Indu Kant Deo , Rui Gao , Rajeev Jaiman

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the…

Machine Learning · Computer Science 2023-10-27 Ian Char , Jeff Schneider

We present a data-efficient reinforcement learning algorithm resistant to observation noise. Our method extends the highly data-efficient PILCO algorithm (Deisenroth & Rasmussen, 2011) into partially observed Markov decision processes…

Machine Learning · Statistics 2016-02-09 Rowan McAllister , Carl Edward Rasmussen

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Deep reinforcement learning (RL) has achieved great empirical successes in various domains. However, the large search space of neural networks requires a large amount of data, which makes the current RL algorithms not sample efficient.…

Machine Learning · Computer Science 2020-08-18 Qianli Shen , Yan Li , Haoming Jiang , Zhaoran Wang , Tuo Zhao

The focus of this work is to enumerate the various approaches and algorithms that center around application of reinforcement learning in robotic ma- ]]nipulation tasks. Earlier methods utilized specialized policy representations and human…

Robotics · Computer Science 2017-02-01 Smruti Amarjyoti

Collision avoidance algorithms are essential for safe and efficient robot operation among pedestrians. This work proposes using deep reinforcement (RL) learning as a framework to model the complex interactions and cooperation with nearby,…

Robotics · Computer Science 2021-01-26 Michael Everett , Yu Fan Chen , Jonathan P. How

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework. RL is an autonomous…

Machine Learning · Computer Science 2021-02-05 Rajesh Siraskar

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

Motile microorganisms develop effective swimming gaits to adapt to complex biological environments. Translating this adaptability to smart microrobots presents significant challenges in motion planning and stroke design. In this work, we…

Robotics · Computer Science 2025-06-03 Yuyang Lai , Sina Heydari , On Shun Pak , Yi Man

The naive application of Reinforcement Learning algorithms to continuous control problems -- such as locomotion and manipulation -- often results in policies which rely on high-amplitude, high-frequency control signals, known colloquially…

Robotics · Computer Science 2019-02-14 Steven Bohez , Abbas Abdolmaleki , Michael Neunert , Jonas Buchli , Nicolas Heess , Raia Hadsell

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson