English
Related papers

Related papers: A perspective on fluid mechanical environments for…

200 papers

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Reinforcement learning (RL) methods learn optimal decisions in the presence of a stationary environment. However, the stationary assumption on the environment is very restrictive. In many real world problems like traffic signal control,…

Machine Learning · Computer Science 2020-06-08 Sindhu Padakandla , Prabuchandran K. J , Shalabh Bhatnagar

We propose an open-source python platform for applications of Deep Reinforcement Learning (DRL) in fluid mechanics. DRL has been widely used in optimizing decision-making in nonlinear and high-dimensional problems. Here, an agent maximizes…

Fluid Dynamics · Physics 2024-06-19 Qiulei Wang , Lei Yan , Gang Hu , Chao Li , Yiqing Xiao , Hao Xiong , Jean Rabault , Bernd R. Noack

It is common practice in reinforcement learning (RL) research to train and deploy agents in bespoke simulators, typically implemented by engineers directly in general-purpose programming languages or hardware acceleration frameworks such as…

Artificial Intelligence · Computer Science 2025-08-12 Dennis J. N. J. Soemers , Spyridon Samothrakis , Kurt Driessens , Mark H. M. Winands

Climate change poses an existential threat, necessitating effective climate policies to enact impactful change. Decisions in this domain are incredibly complex, involving conflicting entities and evidence. In the last decades, policymakers…

Physics and Society · Physics 2026-05-29 James Rudd-Jones , Fiona Thendean , María Pérez-Ortiz

An exciting and promising frontier for Deep Reinforcement Learning (DRL) is its application to real-world robotic systems. While modern DRL approaches achieved remarkable successes in many robotic scenarios (including mobile robotics,…

Machine Learning · Computer Science 2024-06-03 Davide Corsi , Davide Camponogara , Alessandro Farinelli

Safely navigating through an urban environment without violating any traffic rules is a crucial performance target for reliable autonomous driving. In this paper, we present a Reinforcement Learning (RL) based methodology to DEtect and FIX…

Robotics · Computer Science 2025-07-21 Resul Dagdanov , Feyza Eksen , Halil Durmus , Ferhat Yurdakul , Nazim Kemal Ure

This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs). Our primary objectives are to adhere to physical operational constraints while reducing energy…

Artificial Intelligence · Computer Science 2023-10-17 Harsh Patel , Yuan Zhou , Alexander P Lamb , Shu Wang , Jieliang Luo

Much of the current work on reinforcement learning studies episodic settings, where the agent is reset between trials to an initial state distribution, often with well-shaped reward functions. Non-episodic settings, where the agent must…

Machine Learning · Computer Science 2020-06-23 John D. Co-Reyes , Suvansh Sanjeev , Glen Berseth , Abhishek Gupta , Sergey Levine

Reinforcement Learning (RL) in various decision-making tasks of machine learning provides effective results with an agent learning from a stand-alone reward function. However, it presents unique challenges with large amounts of environment…

Machine Learning · Computer Science 2020-03-10 Neda Navidi

Remarkable progress has been made in automated problem solving through societies of agents based on large language models (LLMs). Computational fluid dynamics (CFD), as a complex problem, presents unique challenges in automated simulations…

Artificial Intelligence · Computer Science 2024-08-08 Yuxuan Chen , Xu Zhu , Hua Zhou , Zhuyin Ren

We address the problem of deploying a reinforcement learning (RL) agent on a physical system such as a datacenter cooling unit or robot, where critical constraints must never be violated. We show how to exploit the typically smooth dynamics…

Artificial Intelligence · Computer Science 2018-01-29 Gal Dalal , Krishnamurthy Dvijotham , Matej Vecerik , Todd Hester , Cosmin Paduraru , Yuval Tassa

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

Machine Learning · Computer Science 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

This work focuses on the main challenges and problems in developing a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds,…

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Reinforcement learning (RL) has recently achieved tremendous successes in many artificial intelligence applications. Many of the forefront applications of RL involve multiple agents, e.g., playing chess and Go games, autonomous driving, and…

Computer Science and Game Theory · Computer Science 2021-11-24 Asuman Ozdaglar , Muhammed O. Sayin , Kaiqing Zhang

Solving real-world complex tasks using reinforcement learning (RL) without high-fidelity simulation environments or large amounts of offline data can be quite challenging. Online RL agents trained in imperfect simulation environments can…

Machine Learning · Computer Science 2025-04-17 Haoyi Niu , Tianying Ji , Bingqi Liu , Haocheng Zhao , Xiangyu Zhu , Jianying Zheng , Pengfei Huang , Guyue Zhou , Jianming Hu , Xianyuan Zhan

As humans and animals learn in the natural world, they encounter distributions of entities, situations and events that are far from uniform. Typically, a relatively small set of experiences are encountered frequently, while many important…

Machine Learning · Computer Science 2022-08-09 Stephanie C. Y. Chan , Andrew K. Lampinen , Pierre H. Richemond , Felix Hill