English
Related papers

Related papers: NavTrust: Benchmarking Trustworthiness for Embodie…

200 papers

The Embodied AI community has made significant strides in visual navigation tasks, exploring targets from 3D coordinates, objects, language descriptions, and images. However, these navigation models often handle only a single input modality…

Object-centric representation learning offers the potential to overcome limitations of image-level representations by explicitly parsing image scenes into their constituent components. While image-level representations typically lack…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Nathan Drenkow , Mathias Unberath

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Recent advances in the areas of Multimodal Machine Learning and Artificial Intelligence (AI) have led to the development of challenging tasks at the intersection of Computer Vision, Natural Language Processing, and Robotics. Whereas many…

Robotics · Computer Science 2023-04-07 Jonathan Francis , Nariaki Kitamura , Felix Labelle , Xiaopeng Lu , Ingrid Navarro , Jean Oh

The research field of Embodied AI has witnessed substantial progress in visual navigation and exploration thanks to powerful simulating platforms and the availability of 3D data of indoor and photorealistic environments. These two factors…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Roberto Bigazzi , Federico Landi , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

Vision-Language Navigation (VLN) tasks often leverage panoramic RGB and depth inputs to provide rich spatial cues for action planning, but these sensors can be costly or less accessible in real-world deployments. Recent approaches based on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Shuo Wang , Yongcai Wang , Zhaoxin Fan , Yucheng Wang , Maiyue Chen , Kaihui Wang , Zhizhong Su , Wanting Li , Xudong Cai , Yeying Jin , Deying Li

Event cameras provide high dynamic range and microsecond-level temporal resolution, making them well-suited for indoor robot navigation, where conventional RGB cameras degrade under fast motion or low-light conditions. Despite advances in…

The state-of-the-art deep neural networks are vulnerable to common corruptions (e.g., input data degradations, distortions, and disturbances caused by weather changes, system error, and processing). While much progress has been made in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Chenyu Yi , Siyuan Yang , Haoliang Li , Yap-peng Tan , Alex Kot

Goal-oriented navigation presents a fundamental challenge for autonomous systems, requiring agents to navigate complex environments to reach designated targets. This survey offers a comprehensive analysis of multimodal navigation approaches…

Robotics · Computer Science 2025-04-23 I-Tak Ieong , Hao Tang

The outstanding performance of Large Multimodal Models (LMMs) has made them widely applied in vision-related tasks. However, various corruptions in the real world mean that images will not be as ideal as in simulations, presenting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Chunyi Li , Jianbo Zhang , Zicheng Zhang , Haoning Wu , Yuan Tian , Wei Sun , Guo Lu , Xiaohong Liu , Xiongkuo Min , Weisi Lin , Guangtao Zhai

Recent advances in the areas of multimodal machine learning and artificial intelligence (AI) have led to the development of challenging tasks at the intersection of Computer Vision, Natural Language Processing, and Embodied AI. Whereas many…

Machine Learning · Computer Science 2022-05-26 Jonathan Francis , Nariaki Kitamura , Felix Labelle , Xiaopeng Lu , Ingrid Navarro , Jean Oh

Household tidying is an important application area, yet current benchmarks neither model user preferences nor support mobility, and they generalize poorly, making it hard to comprehensively assess integrated language-to-action capabilities.…

Robotics · Computer Science 2025-11-20 Xiaoquan Sun , Ruijian Zhang , Kang Pang , Bingchen Miao , Yuxiang Tan , Zhen Yang , Ming Li , Jiayu Chen

A robot that can carry out a natural-language instruction has been a dream since before the Jetsons cartoon series imagined a life of leisure mediated by a fleet of attentive robot helpers. It is a dream that remains stubbornly distant.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Peter Anderson , Qi Wu , Damien Teney , Jake Bruce , Mark Johnson , Niko Sünderhauf , Ian Reid , Stephen Gould , Anton van den Hengel

Vision-Language Models (VLMs) have shown rapid progress in mobile GUI navigation. This paper presents a systematic study of data scaling, benchmarking, and reasoning for VLM-based agents in this domain. To facilitate rigorous evaluation, we…

Artificial Intelligence · Computer Science 2026-05-27 Heng Qu , Yike Liu , Renren Jin , Wenzong Zhang , Pengzhi Gao , Wei Liu , Jian Luan

The enhanced mobility brought by legged locomotion empowers quadrupedal robots to navigate through complex and unstructured environments. However, optimizing agile locomotion while accounting for the varying energy costs of traversing…

Gradient Boosting Decision Trees (GBDTs) are widely used in industry and academia for their high accuracy and efficiency, particularly on structured data. However, watermarking GBDT models remains underexplored compared to neural networks.…

Artificial Intelligence · Computer Science 2025-11-14 Jun Woo Chung , Yingjie Lao , Weijie Zhao

The integration of vision-language models (VLMs) is driving a new generation of embodied agents capable of operating in human-centered environments. However, as deployment expands, these systems face growing safety risks, particularly when…

Cryptography and Security · Computer Science 2025-10-21 Zonghao Ying , Le Wang , Yisong Xiao , Jiakai Wang , Yuqing Ma , Jinyang Guo , Zhenfei Yin , Mingchuan Zhang , Aishan Liu , Xianglong Liu

Embodied navigation has long been fragmented by task-specific architectures. We introduce ABot-N0, a unified Vision-Language-Action (VLA) foundation model that achieves a ``Grand Unification'' across 5 core tasks: Point-Goal, Object-Goal,…

Vision-Language Navigation (VLN) requires an embodied agent to navigate complex environments by following natural language instructions, which typically demands tight fusion of visual and language modalities. Existing VLN methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Daojie Peng , Fulong Ma , Jun Ma

Robot navigation systems are critical for various real-world applications such as delivery services, hospital logistics, and warehouse management. Although classical navigation methods provide interpretability, they rely heavily on expert…

Robotics · Computer Science 2025-10-17 Shiwei Feng , Xuan Chen , Zikang Xiong , Zhiyuan Cheng , Yifei Gao , Siyuan Cheng , Sayali Kate , Xiangyu Zhang