English
Related papers

Related papers: Active flow control for three-dimensional cylinder…

200 papers

Collision avoidance is a crucial task in vision-guided autonomous navigation. Solutions based on deep reinforcement learning (DRL) has become increasingly popular. In this work, we proposed several novel agent state and reward function…

Robotics · Computer Science 2022-10-13 Sirui Song , Kirk Saunders , Ye Yue , Jundong Liu

The four-roll mill, wherein four identical cylinders undergo rotation of identical magnitude but alternate signs, was originally proposed by GI Taylor to create local extensional flows and study their ability to deform small liquid drops.…

Fluid Dynamics · Physics 2021-12-08 Marco Vona , Eric Lauga

Unmanned Aerial Vehicles (UAVs) are increasingly populating urban areas for delivery and surveillance purposes. In this work, we develop an optimal navigation strategy based on Deep Reinforcement Learning. The environment is represented by…

Artificial Intelligence · Computer Science 2025-10-30 Federica Tonti , Ricardo Vinuesa

Increasing traffic demands, higher levels of automation, and communication enhancements provide novel design opportunities for future air traffic controllers (ATCs). This article presents a novel deep reinforcement learning (DRL) controller…

Machine Learning · Computer Science 2022-11-28 Lei Wang , Hongyu Yang , Yi Lin , Suwan Yin , Yuankai Wu

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Air traffic control is becoming a more and more complex task due to the increasing number of aircraft. Current air traffic control methods are not suitable for managing this increased traffic. Autonomous air traffic control is deemed a…

Artificial Intelligence · Computer Science 2020-07-06 Joris Mollinga , Herke van Hoof

The increasing number of unmanned aerial vehicles (UAVs) in urban environments requires a strategy to minimize their environmental impact, both in terms of energy efficiency and noise reduction. In order to reduce these concerns, novel…

Artificial Intelligence · Computer Science 2024-09-27 Federica Tonti , Jean Rabault , Ricardo Vinuesa

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow…

Machine Learning · Computer Science 2023-04-04 Niklas Paulig , Ostap Okhrin

Studies that broaden drone applications into complex tasks require a stable control framework. Recently, deep reinforcement learning (RL) algorithms have been exploited in many studies for robot control to accomplish complex tasks.…

Resin infusion (RI) and resin transfer moulding (RTM) are critical processes for the manufacturing of high-performance fibre-reinforced polymer composites, particularly for large-scale applications such as wind turbine blades. Controlling…

This study employed smoothed particle hydrodynamics (SPH) as the numerical environment, integrated with deep reinforcement learning (DRL) real-time control algorithms to optimize the sloshing suppression in a tank with a centrally…

Fluid Dynamics · Physics 2025-05-06 Mai Ye , Yaru Ren , Silong Zhang , Hao Ma , Xiangyu Hu , Oskar J. Haidn

Aerial robot solutions are becoming ubiquitous for an increasing number of tasks. Among the various types of aerial robots, blimps are very well suited to perform long-duration tasks while being energy efficient, relatively silent and safe.…

Robotics · Computer Science 2021-09-28 Yu Tang Liu , Eric Price , Pascal Goldschmid , Michael J. Black , Aamir Ahmad

Deep reinforcement learning has shown its advantages in real-time decision-making based on the state of the agent. In this stage, we solved the task of using a real robot to manipulate the cube to a given trajectory. The task is broken down…

Robotics · Computer Science 2021-12-10 Qingfeng Yao , Jilong Wang , Shuyu Yang

The range and speed of direct ink writing, the workhorse of 3d and 4d printing, is limited by the practice of liquid extrusion from a nozzle just above the surface to prevent instabilities to cause deviations from the required print path.…

Fluid Dynamics · Physics 2023-02-14 Gaurav Chaudhary , Stephanie Christ , A John Hart , L Mahadevan

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Unsteady flow fields over a circular cylinder are trained and predicted using four different deep learning networks: convolutional neural networks with and without consideration of conservation laws, generative adversarial networks with and…

Fluid Dynamics · Physics 2019-10-04 Sangseung Lee , Donghyun You

Due to complexity and dynamics of construction work, resource, and cash flows, poor management of them usually leads to time and cost overruns, bankruptcy, even project failure. Existing approaches in construction failed to achieve optimal…

Artificial Intelligence · Computer Science 2023-08-17 Can Jiang , Xin Li , Jia-Rui Lin , Ming Liu , Zhiliang Ma

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing…

Artificial Intelligence · Computer Science 2024-07-02 Luis E. Alvarez , Marc W. Brittain , Steven D. Young

Traditional wind farm control operates each turbine independently to maximize individual power output. However, coordinated wake steering across the entire farm can substantially increase the combined wind farm energy production. Although…

Fluid Dynamics · Physics 2025-06-26 Andrew Mole , Max Weissenbacher , Georgios Rigas , Sylvain Laizet