English
Related papers

Related papers: Robust Reinforcement Learning Algorithm for Vision…

200 papers

Autonomous aerial-surface robot teams offer a scalable solution for maritime monitoring, but deployment remains difficult due to water-induced visual artifacts and bandwidth-limited coordination. This paper presents a decentralized…

Robotics · Computer Science 2026-03-03 Muhammad Farhan Ahmed , Vincent Frémont

Owing to the enhanced flexibility in deployment and decreasing costs of manufacturing, the demand for unmanned aerial vehicles (UAVs) is expected to soar in the upcoming years. In this paper, we explore a UAV aided search and rescue~(SAR)…

Systems and Control · Electrical Eng. & Systems 2020-02-21 Shriyanti Kulkarni , Vedashree Chaphekar , Md Moin Uddin Chowdhury , Fatih Erden , Ismail Guvenc

Computer vision-based object detection is a key modality for advanced Detect-And-Avoid systems that allow for autonomous flight missions of UAVs. While standard object detection frameworks do not predict the actual depth of an object, this…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 David Silva , Nicolas Jourdan , Nils Gählert

Monocular SLAM refers to using a single camera to estimate robot ego motion while building a map of the environment. While Monocular SLAM is a well studied problem, automating Monocular SLAM by integrating it with trajectory planning…

Monocular SLAM refers to using a single camera to estimate robot ego motion while building a map of the environment. While Monocular SLAM is a well studied problem, automating Monocular SLAM by integrating it with trajectory planning…

For real-world deployments, it is critical to allow robots to navigate in complex environments autonomously. Traditional methods usually maintain an internal map of the environment, and then design several simple rules, in conjunction with…

Robotics · Computer Science 2021-04-16 Yuanyang Zhu , Zhi Wang , Chunlin Chen , Daoyi Dong

An important focus of current research in the field of Micro Aerial Vehicles (MAVs) is to increase the safety of their operation in general unstructured environments. Especially indoors, where GPS cannot be used for localization, reliable…

Computer Vision and Pattern Recognition · Computer Science 2015-05-12 T. Holzmann , R. Prettenthaler , J. Pestana , D. Muschick , G. Graber , C. Mostegel , F. Fraundorfer , H. Bischof

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Climate-induced disasters are and will continue to be on the rise, and thus search-and-rescue (SAR) operations, where the task is to localize and assist one or several people who are missing, become increasingly relevant. In many cases the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Aleksis Pirinen , Anton Samuelsson , John Backsund , Kalle Åström

Combining deep neural networks with reinforcement learning has shown great potential in the next-generation intelligent control. However, there are challenges in terms of safety and cost in practical applications. In this paper, we propose…

Robotics · Computer Science 2018-11-16 Fan Wang , Bo Zhou , Ke Chen , Tingxiang Fan , Xi Zhang , Jiangyong Li , Hao Tian , Jia Pan

Sustainability is becoming increasingly critical in the maritime transport, encompassing both environmental and social impacts, such as Greenhouse Gas (GHG) emissions and navigational safety. Traditional vessel navigation heavily relies on…

Machine Learning · Computer Science 2026-01-19 Zhang Xiaocai , Xiao Zhe , Liang Maohan , Liu Tao , Li Haijiang , Zhang Wenbin

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

This paper presents the development of a real time tracking algorithm that runs on a 1.2 GHz PC/104 computer on-board a small UAV. The algorithm uses zero mean normalized cross correlation to detect and locate an object in the image. A…

Computer Vision and Pattern Recognition · Computer Science 2012-03-13 Ashraf Qadir , Jeremiah Neubert , William Semke

In unseen and complex outdoor environments, collision avoidance navigation for unmanned aerial vehicle (UAV) swarms presents a challenging problem. It requires UAVs to navigate through various obstacles and complex backgrounds. Existing…

Robotics · Computer Science 2024-07-16 Jiafan Zhuang , Gaofei Han , Zihao Xia , Boxi Wang , Wenji Li , Dongliang Wang , Zhifeng Hao , Ruichu Cai , Zhun Fan

Rocket recycling is a crucial pursuit in aerospace technology, aimed at reducing costs and environmental impact in space exploration. The primary focus centers on rocket landing control, involving the guidance of a nonlinear underactuated…

Machine Learning · Computer Science 2024-07-23 Yuxuan Jiang , Yujie Yang , Zhiqian Lan , Guojian Zhan , Shengbo Eben Li , Qi Sun , Jian Ma , Tianwen Yu , Changwu Zhang

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

Robotics · Computer Science 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Autonomously controlling the position of Remotely Operated underwater Vehicles (ROVs) is of crucial importance for a wide range of underwater engineering applications, such as in the inspection and maintenance of underwater industrial…

Robotics · Computer Science 2025-02-25 Ali Safa , Waqas Aman , Ali Al-Zawqari , Saif Al-Kuwari

Optical cameras are gaining popularity as the suitable sensor for relative navigation in space due to their attractive sizing, power and cost properties when compared to conventional flight hardware or costly laser-based systems. However, a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Duarte Rondao , Nabil Aouf , Mark A. Richardson , Vincent Dubanchet

This study presents a novel environment-aware reinforcement learning (RL) framework designed to augment the operational capabilities of autonomous underwater vehicles (AUVs) in underwater environments. Departing from traditional RL…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Yimian Ding , Jingzehua Xu , Guanwen Xie , Shuai Zhang , Yi Li

Reinforcement learning (RL) is effective in many robotic applications, but it requires extensive exploration of the state-action space, during which behaviors can be unsafe. This significantly limits its applicability to large robots with…

Robotics · Computer Science 2026-01-05 Mehdi Heydari Shahna , Pauli Mustalahti , Jouni Mattila