English
Related papers

Related papers: Optimizing pulsed blowing parameters for active se…

200 papers

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear…

Systems and Control · Electrical Eng. & Systems 2021-05-03 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker

Swimming organisms can escape their predators by creating and harnessing unsteady flow fields through their body motions. Stochastic optimization and flow simulations have identified escape patterns that are consistent with those observed…

Fluid Dynamics · Physics 2021-09-29 Ioannis Mandralis , Pascal Weber , Guido Novati , Petros Koumoutsakos

Most of the current studies on autonomous vehicle decision-making and control tasks based on reinforcement learning are conducted in simulated environments. The training and testing of these studies are carried out under rule-based…

Systems and Control · Electrical Eng. & Systems 2024-04-22 Yuan Lin , Antai Xie , Xiao Liu

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

Machine Learning · Computer Science 2019-08-19 Daniel S. Brown , Scott Niekum

In most settings, from international pipelines to home water supplies, the drag caused by turbulence raises pumping costs many times higher than if the flow were laminar. Drag reduction has therefore long been an aim of high priority. In…

Fluid Dynamics · Physics 2019-02-14 Ashley P. Willis , Yongyun Hwang , Carlo Cossu

Mechanical ventilation is a critical life support intervention that delivers controlled air and oxygen to a patient's lungs, assisting or replacing spontaneous breathing. While several data-driven approaches have been proposed to optimize…

Machine Learning · Computer Science 2025-01-10 Joo Seung Lee , Malini Mahendra , Anil Aswani

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating…

Machine Learning · Computer Science 2020-06-02 Linfang Hou , Liang Pang , Xin Hong , Yanyan Lan , Zhiming Ma , Dawei Yin

The multi-dithering method has been well verified in phase locking of polarization coherent combination experiment. However, it is hard to apply to low repetition frequency pulsed lasers, since there exists an overlap frequency domain…

Signal Processing · Electrical Eng. & Systems 2022-03-10 Jiali Zhang , Jie Cao , Qun Hao , Yang Cheng , Liquan Dong , Bin Han , Xuesheng Liu

For decades, people have been seeking for fishlike flapping motions that can realize underwater propulsion with low energy cost. Complexity of the nonstationary flow field around the flapping body makes this problem very difficult. In…

Robotics · Computer Science 2023-06-28 Jin Zhang , Lei Zhou , Bochao Cao

Three-dimensional control is considered in the flow past a backward-facing step (BFS). The BFS flow at Reynolds number $Re=500$ (defined with the step height and the maximum inlet velocity) is two-dimensional and linearly stable but…

Fluid Dynamics · Physics 2020-08-12 E. Yim , I. Shukla , F. Gallaire , E. Boujo

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

Current and future high-contrast imaging instruments require extreme adaptive optics (XAO) systems to reach contrasts necessary to directly image exoplanets. Telescope vibrations and the temporal error induced by the latency of the control…

Instrumentation and Methods for Astrophysics · Physics 2021-08-26 Rico Landman , Sebastiaan Y. Haffert , Vikram M. Radhakrishnan , Christoph U. Keller

Training learning parameterizations to solve optimal power flow (OPF) with pointwise constraints is proposed. In this novel training approach, a learning parameterization is substituted directly into an OPF problem with constraints required…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Damian Owerko , Anna Scaglione , Alejandro Ribeiro

Optimal operation of chemical processes is vital for energy, resource, and cost savings in chemical engineering. The problem of optimal operation can be tackled with reinforcement learning, but traditional reinforcement learning methods…

Machine Learning · Computer Science 2025-11-21 Dean Brandner , Sergio Lucia

Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations (DNS) of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity…

Fluid Dynamics · Physics 2025-03-19 Zisong Zhou , Mengqi Zhang , Xiaojue Zhu

Reinforcement Learning, a machine learning framework for training an autonomous agent based on rewards, has shown outstanding results in various domains. However, it is known that learning a good policy is difficult in a domain where…

Machine Learning · Computer Science 2019-06-27 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world…

Machine Learning · Statistics 2017-11-15 Felix Berkenkamp , Matteo Turchetta , Angela P. Schoellig , Andreas Krause

As more inverter-connected renewable resources are integrated into the grid, frequency stability may degrade because of the reduction in mechanical inertia and damping. A common approach to mitigate this degradation in performance is to use…

Systems and Control · Electrical Eng. & Systems 2021-12-30 Wenqi Cui , Yan Jiang , Baosen Zhang

This study proposes a delay-compensated feedback controller based on proximal policy optimization (PPO) reinforcement learning to stabilize traffic flow in the congested regime by manipulating the time-gap of adaptive cruise…

Artificial Intelligence · Computer Science 2023-01-18 Shurong Mo , Nailong Wu , Jie Qi , Anqi Pan , Zhiguang Feng , Huaicheng Yan , Yueying Wang

Flow-based generative models, including diffusion models, excel at modeling continuous distributions in high-dimensional spaces. In this work, we introduce Flow Policy Optimization (FPO), a simple on-policy reinforcement learning algorithm…

Machine Learning · Computer Science 2025-08-04 David McAllister , Songwei Ge , Brent Yi , Chung Min Kim , Ethan Weber , Hongsuk Choi , Haiwen Feng , Angjoo Kanazawa