English
Related papers

Related papers: Learning Efficient Navigation in Vortical Flow Fie…

200 papers

In dynamic flow fields, various animals exhibit remarkable odor search capabilities despite relying on stochastic detections. Interestingly, there exists an optimal time window for integrating these detections that maximizes search…

Machine Learning · Computer Science 2026-05-20 Changxu Zhao , Dongxiao Zhao , Xin Bian , Gaojin Li

This paper addresses the challenge of active perception within autonomous navigation in complex, unknown environments. Revisiting the foundational principles of active perception, we introduce an end-to-end reinforcement learning framework…

Robotics · Computer Science 2026-02-03 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

Robotics · Computer Science 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

Autonomous navigation in marine environments can be extremely challenging, especially in the presence of spatially varying flow disturbances and dynamic and static obstacles. In this work, we demonstrate that incorporating local flow field…

Robotics · Computer Science 2025-07-11 Ehsan Kazemi , Dechen Gao , Iman Soltani

Motion planning in navigation systems is highly susceptible to upstream perceptual errors, particularly in human detection and tracking. To mitigate this issue, the concept of guidance points--a novel directional cue within a reinforcement…

Robotics · Computer Science 2025-03-05 Qianyi Zhang , Wentao Luo , Boyi Liu , Ziyang Zhang , Yaoyuan Wang , Jingtai Liu

Deep Reinforcement Learning has been successfully applied in various computer games [8]. However, it is still rarely used in real-world applications, especially for the navigation and continuous control of real mobile robots [13]. Previous…

The application of reinforcement learning algorithms onto real life problems always bears the challenge of filtering the environmental state out of raw sensor readings. While most approaches use heuristics, biology suggests that there must…

Artificial Intelligence · Computer Science 2012-05-07 Wendelin Böhmer

Intelligent navigation among social crowds is an essential aspect of mobile robotics for applications such as delivery, health care, or assistance. Deep Reinforcement Learning emerged as an alternative planning method to conservative…

Robotics · Computer Science 2021-09-24 Linh Kästner , Junhui Li , Zhengcheng Shen , Jens Lambrecht

Autonomous agents operating in domains such as robotics or video game simulations must adapt to changing tasks without forgetting about the previous ones. This process called Continual Reinforcement Learning poses non-trivial difficulties,…

Machine Learning · Computer Science 2026-02-02 Anthony Kobanda , Odalric-Ambrym Maillard , Rémy Portelas

We consider a single kinematically controlled robot with a bounded control range. The robot travels in a two-dimensional region supporting an unknown unsteady scalar field. A single sensor provides the field value at the current location of…

Optimization and Control · Mathematics 2015-02-10 Alexey S. Matveev , Michael C. Hoy , Andrey V. Savkin

In this paper, we consider the problem of building learning agents that can efficiently learn to navigate in constrained environments. The main goal is to design agents that can efficiently learn to understand and generalize to different…

Machine Learning · Computer Science 2020-03-04 Kei Ota , Yoko Sasaki , Devesh K. Jha , Yusuke Yoshiyasu , Asako Kanezaki

This thesis presents a solution that enables aerial robots to reason about surrounding wind flow fields in real time using on board sensors and embedded flight hardware. The core novelty of this research is the fusion of range measurements…

Robotics · Computer Science 2026-04-02 Spencer Folk

Robots need to be able to work in multiple different environments. Even when performing similar tasks, different behaviour should be deployed to best fit the current environment. In this paper, We propose a new approach to navigation, where…

Robotics · Computer Science 2021-06-04 Xihan Bian , Oscar Mendez , Simon Hadfield

Flow matching policies learn continuous velocity fields that transport noise to actions, enabling fast deterministic inference for robot manipulation. However, standard training optimizes a pointwise velocity objective while inference…

Robotics · Computer Science 2026-05-12 Riad Ahmed , Sujosh Nag , Moniruzzaman Akash , Mostafa Hussein , Momotaz Begum

Mobile robot navigation in complex and dynamic environments is a challenging but important problem. Reinforcement learning approaches fail to solve these tasks efficiently due to reward sparsities, temporal complexities and…

Robotics · Computer Science 2018-04-30 Xi Chen , Ali Ghadirzadeh , John Folkesson , Patric Jensfelt

Local navigation in cluttered environments often suffers from dense obstacles and frequent local minima. Conventional local planners rely on heuristics and are prone to failure, while deep reinforcement learning(DRL)based approaches provide…

Robotics · Computer Science 2026-03-18 Jiwon Park , Dongkyu Lee , I Made Aswin Nahrendra , Jaeyoung Lim , Hyun Myung

Autonomous ocean-exploring vehicles have begun to take advantage of onboard sensor measurements of water properties such as salinity and temperature to locate oceanic features in real time. Such targeted sampling strategies enable more…

Fluid Dynamics · Physics 2024-03-19 Peter Gunnarson , John O. Dabiri

Visual exploration and smart data collection via autonomous vehicles is an attractive topic in various disciplines. Disturbances like wind significantly influence both the power consumption of the flying robots and the performance of the…

Signal Processing · Electrical Eng. & Systems 2021-01-27 Amir Niaraki , Jeremy Roghair , Ali Jannesari

In this paper we consider the problem of robot navigation in simple maze-like environments where the robot has to rely on its onboard sensors to perform the navigation task. In particular, we are interested in solutions to this problem that…

Robotics · Computer Science 2017-07-25 Jingwei Zhang , Jost Tobias Springenberg , Joschka Boedecker , Wolfram Burgard

To find the path that minimizes the time to navigate between two given points in a fluid flow is known as Zermelo's problem. Here, we investigate it by using a Reinforcement Learning (RL) approach for the case of a vessel which has a slip…