English
Related papers

Related papers: Deep reinforcement learning for turbulent drag red…

200 papers

Human error is a substantial factor in marine accidents, accounting for 85% of all reported incidents. By reducing the need for human intervention in vessel navigation, AI-based methods can potentially reduce the risk of accidents. AI…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Joel Jose , Md Shadab Alam , Abhilash Sharma Somayajula

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach…

Networking and Internet Architecture · Computer Science 2026-01-21 Efe Ağlamazlar , Emirhan Eken , Harun Batur Geçici

Deep reinforcement learning (DRL) has seen several successful applications to process control. Common methods rely on a deep neural network structure to model the controller or process. With increasingly complicated control structures, the…

Deep Reinforcement Learning (DRL) has emerged as a powerful model-free paradigm for learning optimal policies. However, in navigation tasks with cluttered environments, DRL methods often suffer from insufficient exploration, especially…

Robotics · Computer Science 2025-07-04 Licheng Luo , Mingyu Cai

Despite significant advancements in Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), their robustness in real-world conditions, particularly under external disturbances, remains insufficiently explored. In this…

Robotics · Computer Science 2025-06-06 Luis F. W. Batista , Stéphanie Aravecchia , Seth Hutchinson , Cédric Pradalier

Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to…

Machine Learning · Computer Science 2025-07-30 Ruturaj Sambhus , Aydin Gokce , Stephen Welch , Connor W. Herron , Alexander Leonessa

We train active neural-network flow controllers using a deep learning PDE augmentation method to optimize lift-to-drag ratios in turbulent airfoil flows at Reynolds number $5\times10^4$ and Mach number 0.4. Direct numerical simulation and…

Fluid Dynamics · Physics 2025-10-09 Xuemin Liu , Tom Hickling , Jonathan F. MacArt

Deep reinforcement learning (DRL) agents are trained through trial-and-error interactions with the environment. This leads to a long training time for dense neural networks to achieve good performance. Hence, prohibitive computation and…

Machine Learning · Computer Science 2022-05-09 Ghada Sokar , Elena Mocanu , Decebal Constantin Mocanu , Mykola Pechenizkiy , Peter Stone

Order picking is a pivotal operation in warehouses that directly impacts overall efficiency and profitability. This study addresses the dynamic order picking problem, a significant concern in modern warehouse management, where real-time…

Optimization and Control · Mathematics 2025-04-08 Sasan Mahmoudinazlou , Abhay Sobhanan , Hadi Charkhgard , Ali Eshragh , George Dunn

This paper presents a Pre-Training Deep Reinforcement Learning(DRL) for avoidance navigation without map for mobile robots which map raw sensor data to control variable and navigate in an unknown environment. The efficient offline training…

Robotics · Computer Science 2023-08-04 Yang Wenkai Ji Ruihang Zhang Yuxiang Lei Hao , Zhao Zijie

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

Streaming applications are becoming widespread across an extensive range of business domains as an increasing number of sources continuously produce data that need to be processed and analysed in real time. Modern businesses are…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-28 Maria R. Read , Chinmaya Dehury , Satish Narayana Srirama , Rajkumar Buyya

Deep Reinforcement Learning (DRL) has been applied successfully to many robotic applications. However, the large number of trials needed for training is a key issue. Most of existing techniques developed to improve training efficiency (e.g.…

Robotics · Computer Science 2018-12-13 Linhai Xie , Sen Wang , Stefano Rosa , Andrew Markham , Niki Trigoni

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow…

Machine Learning · Computer Science 2023-04-04 Niklas Paulig , Ostap Okhrin

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

To improve the system performance towards the Shannon limit, advanced radio resource management mechanisms play a fundamental role. In particular, scheduling should receive much attention, because it allocates radio resources among…

Machine Learning · Computer Science 2021-03-23 Jian Wang , Chen Xu , Rong Li , Yiqun Ge , Jun Wang

The pressure strain correlation plays a critical role in the Reynolds stress transport modelling. Accurate modelling of the pressure strain correlation leads to proper prediction of turbulence stresses and subsequently the other terms of…

Fluid Dynamics · Physics 2021-03-02 J P Panda , H V Warrior

Deep Reinforcement Learning (DRL) has achieved great success in solving complicated decision-making problems. Despite the successes, DRL is frequently criticized for many reasons, e.g., data inefficient, inflexible and intractable reward…

Machine Learning · Computer Science 2023-02-07 Weiqin Chen

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural…

Machine Learning · Computer Science 2024-08-06 Yang Zhao , Jiaxi Yang , Wenbo Wang , Helin Yang , Dusit Niyato