English
Related papers

Related papers: Active flow control for three-dimensional cylinder…

200 papers

Emerging vehicular systems with increasing proportions of automated components present opportunities for optimal control to mitigate congestion and increase efficiency. There has been a recent interest in applying deep reinforcement…

Artificial Intelligence · Computer Science 2022-08-02 Zhongxia Yan , Abdul Rahman Kreidieh , Eugene Vinitsky , Alexandre M. Bayen , Cathy Wu

Microfluidic devices are utilized to control and direct flow behavior in a wide variety of applications, particularly in medical diagnostics. A particularly popular form of microfluidics -- called inertial microfluidic flow sculpting --…

Machine Learning · Computer Science 2018-12-03 Xian Yeow Lee , Aditya Balu , Daniel Stoecklein , Baskar Ganapathysubramanian , Soumik Sarkar

With the growing need to reduce energy consumption and greenhouse gas emissions, Eco-driving strategies provide a significant opportunity for additional fuel savings on top of other technological solutions being pursued in the…

Systems and Control · Electrical Eng. & Systems 2022-12-16 Lindsey Kerbel , Beshah Ayalew , Andrej Ivanco , Keith Loiselle

Stop-and-go waves in traffic flow pose a persistent challenge, compromising safety, efficiency, and environmental sustainability. This paper introduces a novel mitigation strategy discovered through training multi-agent deep reinforcement…

Physics and Society · Physics 2025-11-19 Raphael Korbmacher , Daniel Straub , Antoine Tordeux , Claudia Totzeck

Mastering autonomous drone landing on dynamic platforms presents formidable challenges due to unpredictable velocities and external disturbances caused by the wind, ground effect, turbines or propellers of the docking platform. This study…

Robotics · Computer Science 2024-03-13 Robinroy Peter , Lavanya Ratnabala , Demetros Aschu , Aleksey Fedoseev , Dzmitry Tsetserukou

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

Despite the increasing adoption of Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), there still remain challenges limiting real-world deployment. In this paper, we first integrate buoyancy and hydrodynamics models…

Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial…

Robotics · Computer Science 2025-06-06 Xinyu Cui , Boai Sun , Yi Zhu , Ning Yang , Haifeng Zhang , Weicheng Cui , Dixia Fan , Jun Wang

Despite significant advancements in Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), their robustness in real-world conditions, particularly under external disturbances, remains insufficiently explored. In this…

Robotics · Computer Science 2025-06-06 Luis F. W. Batista , Stéphanie Aravecchia , Seth Hutchinson , Cédric Pradalier

The physical design of a robot and the policy that controls its motion are inherently coupled, and should be determined according to the task and environment. In an increasing number of applications, data-driven and learning-based…

Robotics · Computer Science 2018-09-18 Charles Schaff , David Yunis , Ayan Chakrabarti , Matthew R. Walter

Event-triggered control (ETC) methods can achieve high-performance control with a significantly lower number of samples compared to usual, time-triggered methods. These frameworks are often based on a mathematical model of the system and…

Systems and Control · Computer Science 2018-09-17 Dominik Baumann , Jia-Jie Zhu , Georg Martius , Sebastian Trimpe

Turbulence is a complex phenomenon that has a chaotic nature with multiple spatio-temporal scales, making predictions of turbulent flows a challenging topic. Nowadays, an abundance of high-fidelity databases can be generated by experimental…

Fluid Dynamics · Physics 2022-08-12 Mustafa Z. Yousif , Linqi Yu , Sergio Hoyas , Ricardo Vinuesa , HeeChang Lim

Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far…

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Systems and Control · Electrical Eng. & Systems 2020-09-24 Simen Theie Havenstrøm , Camilla Sterud , Adil Rasheed , Omer San

Maritime autonomous transportation has played a crucial role in the globalization of the world economy. Deep Reinforcement Learning (DRL) has been applied to automatic path planning to simulate vessel collision avoidance situations in open…

Artificial Intelligence · Computer Science 2021-06-29 Nader Zare , Bruno Brandoli , Mahtab Sarvmaili , Amilcar Soares , Stan Matwin

This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex…

Robotics · Computer Science 2025-11-21 Minwoo Kim , Geunsik Bae , Jinwoo Lee , Woojae Shin , Changseung Kim , Myong-Yol Choi , Heejung Shin , Hyondong Oh

Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Shunyu Liu , Wei Luo , Yanzhen Zhou , Kaixuan Chen , Quan Zhang , Huating Xu , Qinglai Guo , Mingli Song

In this survey, we systematically summarize the current literature on studies that apply reinforcement learning (RL) to the motion planning and control of autonomous vehicles. Many existing contributions can be attributed to the pipeline…

Robotics · Computer Science 2021-06-02 Fei Ye , Shen Zhang , Pin Wang , Ching-Yao Chan

This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model…

Machine Learning · Statistics 2016-04-13 Florimond Guéniat , Lionel Mathelin , M. Yousuff Hussaini

Aerial operation in turbulent environments is a challenging problem due to the chaotic behavior of the flow. This problem is made even more complex when a team of aerial robots is trying to achieve coordinated motion in turbulent wind…

Robotics · Computer Science 2023-06-09 Diego Patiño , Siddharth Mayya , Juan Calderon , Kostas Daniilidis , David Saldaña