English
Related papers

Related papers: RailVQA: A Benchmark and Framework for Efficient I…

200 papers

We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 N Dinesh Reddy , Dylan Snyder , Lona Kiragu , Mirajul Mohin , Shahrear Bin Amin , Sudeep Pillai

In this paper we present a machine vision system to efficiently monitor, analyze and present visual data acquired with a railway overhead gantry equipped with multiple cameras. This solution aims to improve the safety of daily life railway…

Computer Vision and Pattern Recognition · Computer Science 2015-07-29 Giuseppe Lisanti , Svebor Karaman , Daniele Pezzatini , Alberto Del Bimbo

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

Artificial Intelligence · Computer Science 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

Recent advances in multi-modal large language models (MLLMs) have demonstrated strong performance across various domains; however, their ability to comprehend driving scenes remains less proven. The complexity of driving scenarios, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sung-Yeon Park , Can Cui , Yunsheng Ma , Ahmadreza Moradipari , Rohit Gupta , Kyungtae Han , Ziran Wang

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

While multimodal large language models excel at tasks that integrate visual perception with symbolic reasoning, their performance is often undermined by a critical vulnerability: perception-induced errors that propagate through the…

Multimedia · Computer Science 2025-09-29 Songjun Tu , Qichao Zhang , Jingbo Sun , Yuqian Fu , Linjing Li , Xiangyuan Lan , Dongmei Jiang , Yaowei Wang , Dongbin Zhao

Bird's eye view (BEV)-based 3D perception plays a crucial role in autonomous driving applications. The rise of large language models has spurred interest in BEV-based captioning to understand object behavior in the surrounding environment.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yunsheng Ma , Burhaneddin Yaman , Xin Ye , Jingru Luo , Feng Tao , Abhirup Mallik , Ziran Wang , Liu Ren

Vision-Language-Action (VLA) models have recently emerged in autonomous driving, with the promise of leveraging rich world knowledge to improve the cognitive capabilities of driving systems. However, adapting such models for driving tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yongkang Li , Lijun Zhou , Sixu Yan , Bencheng Liao , Tianyi Yan , Kaixin Xiong , Long Chen , Hongwei Xie , Bing Wang , Guang Chen , Hangjun Ye , Wenyu Liu , Haiyang Sun , Xinggang Wang

Tables contain factual and quantitative data accompanied by various structures and contents that pose challenges for machine comprehension. Previous methods generally design task-specific architectures and objectives for individual tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Weichao Zhao , Hao Feng , Qi Liu , Jingqun Tang , Shu Wei , Binghong Wu , Lei Liao , Yongjie Ye , Hao Liu , Wengang Zhou , Houqiang Li , Can Huang

The prevalence of user-generated content (UGC) on platforms such as YouTube and TikTok has rendered no-reference (NR) perceptual video quality assessment (VQA) vital for optimizing video delivery. Nonetheless, the characteristics of…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Xinyi Wang , Angeliki Katsenou , Junxiao Shen , David Bull

Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inference typically provides; yet, retraining large models is often computationally expensive and data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

While Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in tasks such as abnormality detection and report generation for anatomical modalities, their capability in functional imaging remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Zanting Ye , Xiaolong Niu , Xuanbin Wu , Xu Han , Shengyuan Liu , Jing Hao , Zhihao Peng , Hao Sun , Jieqin Lv , Fanghu Wang , Yanchao Huang , Hubing Wu , Yixuan Yuan , Habib Zaidi , Arman Rahmim , Yefeng Zheng , Lijun Lu

"Read the room" is a significant social reasoning capability in human daily life. Humans can infer others' mental states from subtle social cues. Previous social reasoning tasks and datasets lack complexity (e.g., simple scenes, basic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Lixing Niu , Jiapeng Li , Xingping Yu , Shu Wang , Ruining Feng , Bo Wu , Ping Wei , Yisen Wang , Lifeng Fan

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Visual Question Answering systems target answering open-ended textual questions given input images. They are a testbed for learning high-level reasoning with a primary use in HCI, for instance assistance for the visually impaired. Recent…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Theo Jaunet , Corentin Kervadec , Romain Vuillemot , Grigory Antipov , Moez Baccouche , Christian Wolf

The domain of joint vision-language understanding, especially in the context of reasoning in Visual Question Answering (VQA) models, has garnered significant attention in the recent past. While most of the existing VQA models focus on…

Computation and Language · Computer Science 2022-11-11 Rakesh Vaideeswaran , Feng Gao , Abhinav Mathur , Govind Thattai

While autonomous driving technology has made remarkable strides, data-driven approaches still struggle with complex scenarios due to their limited reasoning capabilities. Meanwhile, knowledge-driven autonomous driving systems have evolved…

Artificial Intelligence · Computer Science 2025-01-15 Yukai Ma , Tiantian Wei , Naiting Zhong , Jianbiao Mei , Tao Hu , Licheng Wen , Xuemeng Yang , Botian Shi , Yong Liu

Automated perception of urban roadside infrastructure is crucial for smart city management, yet general-purpose models often struggle to capture the necessary fine-grained attributes and domain rules. While Large Vision Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Luxuan Fu , Chong Liu , Bisheng Yang , Zhen Dong

While visual question-answering (VQA) benchmarks have catalyzed the development of reasoning techniques, they have focused on vertical thinking. Effective problem-solving also necessitates lateral thinking, which remains understudied in AI…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Koen Kraaijveld , Yifan Jiang , Kaixin Ma , Filip Ilievski

Although Large Vision Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, their scalability and deployment are constrained by massive computational requirements. In particular, the massive amount of…

Machine Learning · Computer Science 2026-04-14 Surendra Pathak , Bo Han