English
Related papers

Related papers: Comparative analysis of machine learning methods f…

200 papers

A novel, model free, approach to experimental closed-loop flow control is implemented on a separated flow. Feedback control laws are generated using genetic programming where they are optimized using replication, mutation and cross-over of…

Fluid Dynamics · Physics 2015-06-19 Nicolas Gautier , Thomas Duriez , Jean-Luc Aider , Bernd Noack , Marc Segond , Markus Abel

We numerically investigate the flow control problem of the flow passing a stationary cylinder at a fixed Reynold number 500 using two attached control cylinders with different rotation rates. Compared to the traditional uniform (lattice)…

Fluid Dynamics · Physics 2020-07-15 Juhan Wang , Dixia Fan

This paper focuses on the active flow control of a computational fluid dynamics simulation over a range of Reynolds numbers using deep reinforcement learning (DRL). More precisely, the proximal policy optimization (PPO) method is used to…

Fluid Dynamics · Physics 2020-06-24 Hongwei Tang , Jean Rabault , Alexander Kuhnle , Yan Wang , Tongguang Wang

We consider the problem of designing an algorithm to allow a car to autonomously merge on to a highway from an on-ramp. Two broad classes of techniques have been proposed to solve motion planning problems in autonomous driving: Model…

Robotics · Computer Science 2021-09-29 Joseph Lubars , Harsh Gupta , Sandeep Chinchali , Liyun Li , Adnan Raja , R. Srikant , Xinzhou Wu

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework. RL is an autonomous…

Machine Learning · Computer Science 2021-02-05 Rajesh Siraskar

We propose an automated analysis of the flow control behaviour from an ensemble of control laws and associated time-resolved flow snapshots. The input may be the rich data base of machine learning control (MLC) optimizing a feedback law for…

Fluid Dynamics · Physics 2020-09-01 Hao Li , Guy Y. Cornejo Maceda , Yiqing Li , Jianguo Tan , Marek Morzyński , Bernd R. Noack

Machine and reinforcement learning (RL) are increasingly being applied to plan and control the behavior of autonomous systems interacting with the physical world. Examples include self-driving vehicles, distributed sensor networks, and…

Optimization and Control · Mathematics 2019-09-24 Nikolai Matni , Alexandre Proutiere , Anders Rantzer , Stephen Tu

Over the last few years, sampling-based stochastic optimal control (SOC) frameworks have shown impressive performances in reinforcement learning (RL) with applications in robotics. However, such approaches require a large amount of samples…

Systems and Control · Computer Science 2014-12-10 Yunpeng Pan , Evangelos A. Theodorou , Michail Kontitsis

Reinforcement learning (RL) policies are prone to high-frequency oscillations, especially undesirable when deploying to hardware in the real-world. In this paper, we identify, categorize, and compare methods from the literature that aim to…

Robotics · Computer Science 2024-10-23 Guilherme Christmann , Ying-Sheng Luo , Hanjaya Mandala , Wei-Chao Chen

We apply supervised machine learning techniques to a number of regression problems in fluid dynamics. Four machine learning architectures are examined in terms of their characteristics, accuracy, computational cost, and robustness for…

Fluid Dynamics · Physics 2020-03-18 Kai Fukami , Koji Fukagata , Kunihiko Taira

Designing optimal controllers continues to be challenging as systems are becoming complex and are inherently nonlinear. The principal advantage of reinforcement learning (RL) is its ability to learn from the interaction with the environment…

Machine Learning · Computer Science 2018-10-05 Savinay Nagendra , Nikhil Podila , Rashmi Ugarakhod , Koshy George

We present theoretical and numerical results concerning the problem to find the path that minimizes the time to navigate between two given points in a complex fluid under realistic navigation constraints. We contrast deterministic Optimal…

Systems and Control · Electrical Eng. & Systems 2021-03-02 Michele Buzzicotti , Luca Biferale , Fabio Bonaccorso , Patricio Clark di Leoni , Kristian Gustavsson

Learning-based congestion control (CC), including Reinforcement-Learning, promises efficient CC in a fast-changing networking landscape, where evolving communication technologies, applications and traffic workloads pose severe challenges to…

Networking and Internet Architecture · Computer Science 2026-04-17 Mihai Mazilu , Luca Giacomoni , George Parisis

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

Reinforcement learning (RL) algorithms are increasingly used to solve the optimal power flow (OPF) problem. Yet, the question of how to design RL environments to maximize training performance remains unanswered, both for the OPF and the…

Machine Learning · Computer Science 2025-05-14 Thomas Wolgast , Astrid Nieße

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Filippo Airaldi , Bart De Schutter , Azita Dabiri

This paper presents a mixed traffic control policy designed to optimize traffic efficiency across diverse road topologies, addressing issues of congestion prevalent in urban environments. A model-free reinforcement learning (RL) approach is…

Robotics · Computer Science 2025-01-29 Chuyang Xiao , Dawei Wang , Xinzheng Tang , Jia Pan , Yuexin Ma