English
Related papers

Related papers: NavTrust: Benchmarking Trustworthiness for Embodie…

200 papers

Advancing safe autonomous systems through reinforcement learning (RL) requires robust benchmarks to evaluate performance, analyze methods, and assess agent competencies. Humans primarily rely on embodied visual perception to safely navigate…

Artificial Intelligence · Computer Science 2025-03-12 Tristan Tomilin , Meng Fang , Mykola Pechenizkiy

This paper proposes an end-to-end deep reinforcement learning approach for mobile robot navigation with dynamic obstacles avoidance. Using experience collected in a simulation environment, a convolutional neural network (CNN) is trained to…

Robotics · Computer Science 2020-02-12 Guangda Chen , Lifan Pan , Yu'an Chen , Pei Xu , Zhiqiang Wang , Peichen Wu , Jianmin Ji , Xiaoping Chen

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

Motion planning in navigation systems is highly susceptible to upstream perceptual errors, particularly in human detection and tracking. To mitigate this issue, the concept of guidance points--a novel directional cue within a reinforcement…

Robotics · Computer Science 2025-03-05 Qianyi Zhang , Wentao Luo , Boyi Liu , Ziyang Zhang , Yaoyuan Wang , Jingtai Liu

Recent advances in vision-language models (VLMs) have shown promise for human-level embodied intelligence. However, existing benchmarks for VLM-driven embodied agents often rely on high-level commands or discretized action spaces, which are…

Artificial Intelligence · Computer Science 2026-02-25 Bo Peng , Pi Bu , Keyu Pan , Xinrun Xu , Yinxiu Zhao , Miao Chen , Yang Du , Lin Li , Jun Song , Tong Xu

The evaluation of navigation instructions remains a persistent challenge in Vision-and-Language Navigation (VLN) research. Traditional reference-based metrics such as BLEU and ROUGE fail to capture the functional utility of spatial…

Computation and Language · Computer Science 2026-01-13 Farzad Shami , Subhrasankha Dey , Nico Van de Weghe , Henrikki Tenkanen

Text classification models, especially neural networks based models, have reached very high accuracy on many popular benchmark datasets. Yet, such models when deployed in real world applications, tend to perform badly. The primary reason is…

Computation and Language · Computer Science 2020-02-04 Utkarsh Desai , Srikanth Tamilselvam , Jassimran Kaur , Senthil Mani , Shreya Khare

Navigation and manipulation are core capabilities in Embodied AI, yet training agents with these capabilities in the real world faces high costs and time complexity. Therefore, sim-to-real transfer has emerged as a key approach, yet the…

Robotics · Computer Science 2025-05-06 Lik Hang Kenny Wong , Xueyang Kang , Kaixin Bai , Jianwei Zhang

While natural language is commonly used to guide embodied agents, the inherent ambiguity and verbosity of language often hinder the effectiveness of language-guided navigation in complex environments. To this end, we propose Visual Prompt…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shuo Feng , Zihan Wang , Yuchen Li , Rui Kong , Hengyi Cai , Shuaiqiang Wang , Gim Hee Lee , Piji Li , Shuqiang Jiang

Federated embodied agent learning protects the data privacy of individual visual environments by keeping data locally at each client (the individual environment) during training. However, since the local data is inaccessible to the server…

Artificial Intelligence · Computer Science 2024-03-19 Yunchao Zhang , Zonglin Di , Kaiwen Zhou , Cihang Xie , Xin Eric Wang

Water quality is foundational to environmental sustainability, ecosystem resilience, and public health. Deep learning offers transformative potential for large-scale water quality prediction and scientific insights generation. However,…

Machine Learning · Computer Science 2025-10-28 Xiaobo Xia , Xiaofeng Liu , Jiale Liu , Kuai Fang , Lu Lu , Samet Oymak , William S. Currie , Tongliang Liu

Recent applications of deep learning to navigation have generated end-to-end navigation solutions whereby visual sensor input is mapped to control signals or to motion primitives. The resulting visual navigation strategies work very well at…

Robotics · Computer Science 2018-01-17 Justin S. Smith , Jin-Ha Hwang , Fu-Jen Chu , Patricio A. Vela

Embodied navigation (EN) advances traditional navigation by enabling robots to perform complex egocentric tasks through sensing, social, and motion intelligence. In contrast to classic methodologies that rely on explicit localization and…

Robotics · Computer Science 2025-08-22 Chaoran Xiong , Yulong Huang , Fangwen Yu , Changhao Chen , Yue Wang , Songpengchen Xia , Ling Pei

Autonomous underwater robots are increasingly deployed for environmental monitoring, infrastructure inspection, subsea resource exploration, and long-horizon exploration. Yet, despite rapid advances in learning-based planning and control,…

Robotics · Computer Science 2026-03-10 Jingzehua Xu , Guanwen Xie , Jiwei Tang , Shuai Zhang , Xiaofan Li

Traversability estimation in rugged, unstructured environments remains a challenging problem in field robotics. Often, the need for precise, accurate traversability estimation is in direct opposition to the limited sensing and compute…

Robotics · Computer Science 2024-07-12 Samuel Triest , David D. Fan , Sebastian Scherer , Ali-Akbar Agha-Mohammadi

Visual Navigation is a core task in Embodied AI, enabling agents to navigate complex environments toward given objectives. Across diverse settings within Navigation tasks, many necessitate the modelling of sequential data accumulated from…

Artificial Intelligence · Computer Science 2025-06-19 Ruoyu Wang , Xinshu Li , Chen Wang , Lina Yao

Embodied navigation methods commonly operate in static environments with stationary objects. In this work, we present approaches for tackling navigation in dynamic scenarios with non-stationary targets. In an indoor environment, we assume…

Robotics · Computer Science 2026-04-22 Vishnu Sashank Dorbala , Bhrij Patel , Amrit Singh Bedi , Dinesh Manocha

Earth observation foundation models have shown strong generalization across multiple Earth observation tasks, but their robustness under real-world perturbations remains underexplored. To bridge this gap, we introduce REOBench, the first…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Xiang Li , Yong Tao , Siyuan Zhang , Siwei Liu , Zhitong Xiong , Chunbo Luo , Lu Liu , Mykola Pechenizkiy , Xiao Xiang Zhu , Tianjin Huang

Visual Object Tracking (VOT) is a fundamental task with widespread applications in autonomous navigation, surveillance, and maritime robotics. Despite significant advances in generic object tracking, maritime environments continue to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Ahsan Baidar Bakht , Muhayy Ud Din , Sajid Javed , Irfan Hussain

Multi-modal 3D object detection models for automated driving have demonstrated exceptional performance on computer vision benchmarks like nuScenes. However, their reliance on densely sampled LiDAR point clouds and meticulously calibrated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Till Beemelmanns , Quan Zhang , Christian Geller , Lutz Eckstein