English
Related papers

Related papers: Flow Shape Design for Microfluidic Devices Using D…

200 papers

In many practical control applications, the performance level of a closed-loop system degrades over time due to the change of plant characteristics. Thus, there is a strong need for redesigning a controller without going through the system…

Systems and Control · Electrical Eng. & Systems 2023-12-01 Mei Minami , Yuka Masumoto , Yoshihiro Okawa , Tomotake Sasaki , Yutaka Hori

We present a deep reinforcement learning-based artificial intelligence agent that could provide optimized development plans given a basic description of the reservoir and rock/fluid properties with minimal computational cost. This…

Machine Learning · Computer Science 2022-07-22 Yusuf Nasir , Jincong He , Chaoshun Hu , Shusei Tanaka , Kainan Wang , XianHuan Wen

Clusters of wave-scattering oscillators offer the ability to passively control wave energy in elastic continua. However, designing such clusters to achieve a desired wave energy pattern is a highly nontrivial task. While the forward…

Signal Processing · Electrical Eng. & Systems 2024-02-29 Joshua R. Tempelman , Tobias Weidemann , Eric B. Flynn , Kathryn H. Matlack , Alexander F. Vakakis

To optimize flapping foil performance, the application of deep reinforcement learning (DRL) on controlling foil non-parametric motion is conducted in the present study. Traditional control techniques and simplified motions cannot fully…

Fluid Dynamics · Physics 2023-05-26 Z. P. Wang , R. J. Lin , Z. Y. Zhao , P. M. Guo , N. Yang , D. X. Fan

Deep reinforcement learning (DRL) for fluidic pinball, three individually rotating cylinders in the uniform flow arranged in an equilaterally triangular configuration, can learn the efficient flow control strategies due to the validity of…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Haodong Feng , Yue Wang , Hui Xiang , Zhiyang Jin , Dixia Fan

In many practical fluid dynamics experiments, measuring variables such as velocity and pressure is possible only at a limited number of sensor locations, \textcolor{black}{for a few two-dimensional planes, or for a small 3D domain in the…

Fluid Dynamics · Physics 2023-07-14 Ali Girayhan Özbay , Sylvain Laizet

For decades, people have been seeking for fishlike flapping motions that can realize underwater propulsion with low energy cost. Complexity of the nonstationary flow field around the flapping body makes this problem very difficult. In…

Robotics · Computer Science 2023-06-28 Jin Zhang , Lei Zhou , Bochao Cao

Reinforcement learning (RL) has demonstrated immense potential in advancing artificial general intelligence, agentic intelligence, and embodied intelligence. However, the inherent heterogeneity and dynamicity of RL workflows often lead to…

Profile extrusion is a continuous production process for manufacturing plastic profiles from molten polymer. Especially interesting is the design of the die, through which the melt is pressed to attain the desired shape. However, due to an…

Computational Engineering, Finance, and Science · Computer Science 2023-04-05 Clemens Fricke , Daniel Wolff , Marco Kemmerling , Stefanie Elgeti

Human motion retargeting aims to transfer the motion of one person in a "driving" video or set of images to another person. Existing efforts leverage a long training video from each target person to train a subject-specific motion transfer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Jian Ren , Menglei Chai , Oliver J. Woodford , Kyle Olszewski , Sergey Tulyakov

Deep Reinforcement Learning (DRL) has recently been proposed as a methodology to discover complex Active Flow Control (AFC) strategies [Rabault, J., Kuchta, M., Jensen, A., Reglade, U., & Cerardi, N. (2019): "Artificial neural networks…

Computational Physics · Physics 2019-10-23 Jean Rabault , Alexander Kuhnle

This paper presents for the first time successful results of active flow control with multiple independently controlled zero-net-mass-flux synthetic jets. The jets are placed on a three-dimensional cylinder along its span with the aim of…

Motile microorganisms develop effective swimming gaits to adapt to complex biological environments. Translating this adaptability to smart microrobots presents significant challenges in motion planning and stroke design. In this work, we…

Robotics · Computer Science 2025-06-03 Yuyang Lai , Sina Heydari , On Shun Pak , Yi Man

We present flow Q-learning (FQL), a simple and performant offline reinforcement learning (RL) method that leverages an expressive flow-matching policy to model arbitrarily complex action distributions in data. Training a flow policy with RL…

Machine Learning · Computer Science 2025-05-27 Seohong Park , Qiyang Li , Sergey Levine

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

Is a deep learning model capable of understanding systems governed by certain first principle laws by only observing the system's output? Can deep learning learn the underlying physics and honor the physics when making predictions? The…

Computational Physics · Physics 2020-06-11 Rohan Thavarajah , Xiang Zhai , Zheren Ma , David Castineira

Cost-effective asset management is an area of interest across several industries. Specifically, this paper develops a deep reinforcement learning (DRL) solution to automatically determine an optimal rehabilitation policy for continuously…

Machine Learning · Computer Science 2023-04-19 Zaharah A. Bukhsh , Nils Jansen , Hajo Molegraaf

Autonomous contact-based micromanipulation is challenging because surface and interfacial interactions at the microscale are difficult to model accurately, limiting the use of conventional model-based control and sim-to-real learning. We…

Robotics · Computer Science 2026-05-22 Alessandro Amici , Houari Bettahar , Veeti Jaakkola , Quan Zhou

In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in…

Fluid Dynamics · Physics 2023-09-07 L. Guastoni , J. Rabault , H. Azizpour , R. Vinuesa

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold