English
Related papers

Related papers: Adaptive Plane Reformatting for 4D Flow MRI using …

200 papers

In the past couple of years, the interest of the fluid mechanics community for deep reinforcement learning (DRL) techniques has increased at fast pace, leading to a growing bibliography on the topic. While the capabilities of DRL to solve…

Fluid Dynamics · Physics 2022-11-30 Jonathan Viquerat , Philippe Meliga , Elie Hachem

This paper addresses the problem of traversing through unknown, tilted, and narrow gaps for quadrotors using Deep Reinforcement Learning (DRL). Previous learning-based methods relied on accurate knowledge of the environment, including the…

Robotics · Computer Science 2023-07-03 Yuhan Xie , Minghao Lu , Rui Peng , Peng Lu

Autonomous Ground Vehicles (AGVs) are essential tools for a wide range of applications stemming from their ability to operate in hazardous environments with minimal human operator input. Effective motion planning is paramount for successful…

Robotics · Computer Science 2023-09-04 Shathushan Sivashangaran , Azim Eskandarian

Deep Reinforcement Learning (DRL) has emerged as a promising approach for handling highly dynamic and nonlinear Active Flow Control (AFC) problems. However, the computational cost associated with training DRL models presents a significant…

Machine Learning · Computer Science 2024-09-27 Wang Jia , Hang Xu

Model-free deep reinforcement learning (DRL) methods suffer from poor sample efficiency. To overcome this limitation, this work introduces an adaptive reduced-order-model (ROM)-based reinforcement learning framework for active flow control.…

Machine Learning · Computer Science 2026-04-08 Zesheng Yao , Zhen-Hua Wan , Canjun Yang , Qingchao Xia , Mengqi Zhang

Present-day Deep Reinforcement Learning (RL) systems show great promise towards building intelligent agents surpassing human-level performance. However, the computational complexity associated with the underlying deep neural networks (DNNs)…

Machine Learning · Computer Science 2021-09-20 Adarsh Kumar Kosta , Malik Aqeel Anwar , Priyadarshini Panda , Arijit Raychowdhury , Kaushik Roy

Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Shunyu Liu , Wei Luo , Yanzhen Zhou , Kaixuan Chen , Quan Zhang , Huating Xu , Qinglai Guo , Mingli Song

In this chapter, the regulation of Unmanned Aerial Vehicle (UAV) communication network is investigated in the presence of dynamic changes in the UAV lineup and user distribution. We target an optimal UAV control policy which is capable of…

Systems and Control · Electrical Eng. & Systems 2021-08-26 Ran Zhang , Duc Minh , Nguyen , Miao Wang , Lin X. Cai , Xuemin , Shen

Due to complexity and dynamics of construction work, resource, and cash flows, poor management of them usually leads to time and cost overruns, bankruptcy, even project failure. Existing approaches in construction failed to achieve optimal…

Artificial Intelligence · Computer Science 2023-08-17 Can Jiang , Xin Li , Jia-Rui Lin , Ming Liu , Zhiliang Ma

Embedding the intrinsic symmetry of a flow system in training its machine learning algorithms has become a significant trend in the recent surge of their application in fluid mechanics. This paper leverages the geometric symmetry of a…

Fluid Dynamics · Physics 2025-06-04 Xuan Dai , Da Xu , Mengqi Zhang , Yantao Yang

In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its…

Robotics · Computer Science 2024-03-19 Yuhong Cao , Rui Zhao , Yizhuo Wang , Bairan Xiang , Guillaume Sartoretti

Cardiac magnetic resonance imaging is a valuable non-invasive tool for identifying cardiovascular diseases. For instance, Cine MRI is the benchmark modality for assessing the cardiac function and anatomy. On the other hand, multi-contrast…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 George Yiasemis , Nikita Moriakov , Jan-Jakob Sonke , Jonas Teuwen

The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these obstacles, but…

Fluid Dynamics · Physics 2023-01-31 Alec J. Linot , Kevin Zeng , Michael D. Graham

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

Machine Learning · Computer Science 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang

A variety of autonomous navigation algorithms exist that allow robots to move around in a safe and fast manner. However, many of these algorithms require parameter re-tuning when facing new environments. In this paper, we propose PTDRL, a…

Robotics · Computer Science 2023-06-21 Elias Goldsztejn , Tal Feiner , Ronen Brafman

Background: Image reconstruction from highly undersampled 4D flow MRI data can be very time consuming and may result in significant underestimation of velocities depending on regularization, thereby limiting the applicability of the method.…

Medical Physics · Physics 2025-04-01 Luuk Jacobs , Marco Piccirelli , Valery Vishnevskiy , Sebastian Kozerke

Intelligent reflecting surface (IRS) is a promising technology to assist downlink information transmissions from a multi-antenna access point (AP) to a receiver. In this paper, we minimize the AP's transmit power by a joint optimization of…

Signal Processing · Electrical Eng. & Systems 2020-05-26 Jiaye Lin , Yuze Zou , Xiaoru Dong , Shimin Gong , Dinh Thai Hoang , Dusit Niyato

Reinforcement learning (RL) has demonstrated considerable potential for enhancing reasoning in large language models (LLMs). However, existing methods suffer from Gradient Starvation and Policy Degradation when training directly on samples…

Machine Learning · Computer Science 2025-11-13 Renda Li , Hailang Huang , Fei Wei , Feng Xiong , Yong Wang , Xiangxiang Chu

A reinforcement learning (RL) based methodology is proposed and implemented for online fine-tuning of PID controller gains, thus, improving quadrotor effective and accurate trajectory tracking. The RL agent is first trained offline on a…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Serhat Sönmez , Luca Montecchio , Simone Martini , Matthew J. Rutherford , Alessandro Rizzo , Margareta Stefanovic , Kimon P. Valavanis

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen