English
Related papers

Related papers: Hierarchical Reasoning with Vision-Language Models…

200 papers

Visual Object Goal Navigation (ObjectNav) requires a robot to locate a target object in an unseen environment using egocentric observations. However, decision-making policies often struggle to transfer to unseen environments and novel…

Robotics · Computer Science 2025-04-15 Yuxin Cai , Xiangkun He , Maonan Wang , Hongliang Guo , Wei-Yun Yau , Chen Lv

In order to operate safely on the road, autonomous vehicles need not only to be able to identify objects in front of them, but also to be able to estimate the risk level of the object in front of the vehicle automatically. It is obvious…

Robotics · Computer Science 2019-04-24 Songlin Xu , Jiacheng Zhu

True intelligence hinges on the ability to uncover and leverage hidden causal relations. Despite significant progress in AI and computer vision (CV), there remains a lack of benchmarks for assessing models' abilities to infer latent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Disheng Liu , Yiran Qiao , Wuche Liu , Yiren Lu , Yunlai Zhou , Tuo Liang , Yu Yin , Jing Ma

Ensuring the safety of autonomous vehicles requires virtual scenario-based testing, which depends on the robust evaluation and generation of safety-critical scenarios. So far, researchers have used scenario-based testing frameworks that…

Artificial Intelligence · Computer Science 2025-07-21 Yuan Gao , Mattia Piccinini , Korbinian Moller , Amr Alanwar , Johannes Betz

Drivers' perception of risky situations has always been a challenge in driving. Existing risk-detection methods excel at identifying collisions but face challenges in assessing the behavior of road users in non-collision situations. This…

Human-Computer Interaction · Computer Science 2025-11-19 Wei Xiang , Ziyue Lei , Jie Wang , Yingying Huang , Qi Zheng , Tianyi Zhang , An Zhao , Lingyun Sun

End-to-end autonomous driving systems built on Vision Language Models (VLMs) have shown significant promise, yet their reliance on autoregressive architectures introduces some limitations for real-world applications. The sequential,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Can Cui , Yupeng Zhou , Juntong Peng , Sung-Yeon Park , Zichong Yang , Prashanth Sankaranarayanan , Jiaru Zhang , Ruqi Zhang , Ziran Wang

Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions, yet existing machine learning approaches remain fragmented and task-specific, with each downstream task employing distinct architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Pushkal Mishra , Kshitiz Bansal , Dinesh Bharadia

This paper presents an improved system based on our prior work, designed to create explanations for autonomous robot actions during Human-Robot Interaction (HRI). Previously, we developed a system that used Large Language Models (LLMs) to…

In trustworthy medical diagnosis systems, integrating out-of-distribution (OOD) detection aims to identify unknown diseases in samples, thereby mitigating the risk of misdiagnosis. In this study, we propose a novel OOD detection framework…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Runhe Lai , Xinhua Lu , Kanghao Chen , Qichao Chen , Wei-Shi Zheng , Ruixuan Wang

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

In recent years, reinforcement learning (RL)-based methods for learning driving policies have gained increasing attention in the autonomous driving community and have achieved remarkable progress in various driving scenarios. However,…

Robotics · Computer Science 2024-12-23 Zilin Huang , Zihao Sheng , Yansong Qu , Junwei You , Sikai Chen

Object categories are typically organized into a multi-granularity taxonomic hierarchy. When classifying categories at different hierarchy levels, traditional uni-modal approaches focus primarily on image features, revealing limitations in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Peng Xia , Xingtong Yu , Ming Hu , Lie Ju , Zhiyong Wang , Peibo Duan , Zongyuan Ge

Visual-language reasoning, driving knowledge, and value alignment are essential for advanced autonomous driving systems. However, existing approaches largely rely on data-driven learning, making it difficult to capture the complex logic…

Robotics · Computer Science 2026-03-13 Zhongyu Xia , Wenhao Chen , Yongtao Wang , Ming-Hsuan Yang

Existing benchmarks for Vision-Language Model (VLM) on autonomous driving (AD) primarily assess interpretability through open-form visual question answering (QA) within coarse-grained tasks, which remain insufficient to assess capabilities…

Computation and Language · Computer Science 2025-03-28 Yue Li , Meng Tian , Zhenyu Lin , Jiangtong Zhu , Dechang Zhu , Haiqiang Liu , Zining Wang , Yueyi Zhang , Zhiwei Xiong , Xinhai Zhao

Recent advances in Vision-Language Models (VLMs) have demonstrated impressive capabilities in perception and reasoning. However, the ability to perform causal inference -- a core aspect of human cognition -- remains underexplored,…

Computation and Language · Computer Science 2025-08-14 Keummin Ka , Junhyeong Park , Jaehyun Jeon , Youngjae Yu

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

Lately, researchers in artificial intelligence have been really interested in how language and vision come together, giving rise to the development of multimodal models that aim to seamlessly integrate textual and visual information.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rajat Chawla , Arkajit Datta , Tushar Verma , Adarsh Jha , Anmol Gautam , Ayush Vatsal , Sukrit Chaterjee , Mukunda NS , Ishaan Bhola

The large-scale deployment of autonomous vehicles is yet to come, and one of the major remaining challenges lies in urban dense traffic scenarios. In such cases, it remains challenging to predict the future evolution of the scene and future…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Hao Shao , Letian Wang , Ruobing Chen , Steven L. Waslander , Hongsheng Li , Yu Liu

Evaluating short-form video content requires moving beyond surface-level quality metrics toward human-aligned, multimodal reasoning. While existing frameworks like VideoScore-2 assess visual and semantic fidelity, they do not capture how…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arnav Gupta , Gurekas Singh Sahney , Hardik Rathi , Abhishek Chandwani , Ishaan Gupta , Pratik Narang , Dhruv Kumar

Large Vision Language Models (VLMs), such as CLIP, have significantly contributed to various computer vision tasks, including object recognition and object detection. Their open vocabulary feature enhances their value. However, their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Ali Rasekh , Sepehr Kazemi Ranjbar , Milad Heidari , Wolfgang Nejdl