English
Related papers

Related papers: From Scene to Object: Text-Guided Dual-Gaze Predic…

200 papers

Vision-language models (VLMs) have recently shown remarkable capabilities in visual understanding and generation, but remain vulnerable to adversarial manipulations of visual content. Prior object-hiding attacks primarily rely on…

Cryptography and Security · Computer Science 2026-03-18 Amira Guesmi , Muhammad Shafique

Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs could greatly benefit the analysis of human gaze and attention, a central task in human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hengfei Wang , Anshul Gupta , Pierre Vuillecard , Jean-Marc Odobez

Large vision-language models (VLMs) are increasingly used in autonomous-vehicle (AV) stacks, but hallucination limits their reliability in safety-critical pipelines. We present Shapley-credited Context-Aware Dawid-Skene with Agreement, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Feng , Keyang Zhang , Hassane Ouchouid , Ashwil Kaniamparambil , Ioannis Souflas , Panagiotis Angeloudis

Gaze understanding unifies the detection of people, their gaze targets, and objects of interest into a single framework, offering critical insight into visual attention and intent estimation. Although prior research has modelled gaze cues…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Athul M. Mathew , Haithem Hermassi , Thariq Khalid , Arshad Ali Khan

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

Artificial Intelligence · Computer Science 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the visual content. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Younan Zhu , Linwei Tao , Minjing Dong , Chang Xu

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Thomson Tong , Diba Darooneh

Recent end-to-end autonomous driving approaches have leveraged Vision-Language Models (VLMs) to enhance planning capabilities in complex driving scenarios. However, VLMs are inherently trained as generalist models, lacking specialized…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jingyu Li , Junjie Wu , Dongnan Hu , Xiangkai Huang , Bin Sun , Zhihui Hao , Xianpeng Lang , Xiatian Zhu , Li Zhang

Attention models are widely used in Vision-language (V-L) tasks to perform the visual-textual correlation. Humans perform such a correlation with a strong linguistic understanding of the visual world. However, even the best performing…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Gouthaman KV , Athira Nambiar , Kancheti Sai Srinivas , Anurag Mittal

While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuechen Luo , Fang Li , Shaoqing Xu , Yang Ji , Zehan Zhang , Bing Wang , Yuannan Shen , Jianwei Cui , Long Chen , Guang Chen , Hangjun Ye , Zhi-Xin Yang , Fuxi Wen

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

The growing demand for dynamic, user-centric data analysis and visualization is evident across domains like healthcare, finance, and research. Traditional visualization tools often fail to meet individual user needs due to their static and…

Artificial Intelligence · Computer Science 2024-12-30 Pradeep Sain

The rapid development of Vision-Language models (VLMs) and Multimodal Language Models (MLLMs) in autonomous driving research has significantly reshaped the landscape by enabling richer scene understanding, context-aware reasoning, and more…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Karthik Mohan , Sonam Singh , Amit Arvind Kale

Human visual attention on three-dimensional objects emerges from the interplay between bottom-up geometric processing and top-down semantic recognition. Existing 3D saliency methods rely on hand-crafted geometric features or learning-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Soham Pahari , Sandeep C. Kumain

End-to-end autonomous driving systems built on Vision Language Models (VLMs) have shown significant promise, yet their reliance on autoregressive architectures introduces some limitations for real-world applications. The sequential,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Can Cui , Yupeng Zhou , Juntong Peng , Sung-Yeon Park , Zichong Yang , Prashanth Sankaranarayanan , Jiaru Zhang , Ruqi Zhang , Ziran Wang

Accurate accident anticipation remains challenging when driver cognition and dynamic road conditions are underrepresented in predictive models. In this paper, we propose CAMERA (Context-Aware Multi-modal Enhanced Risk Anticipation), a…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Jiaxun Zhang , Haicheng Liao , Yumu Xie , Chengyue Wang , Yanchen Guan , Bin Rao , Zhenning Li

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-regularized framework that enhances VLMs for two key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Anupam Pani , Yanchao Yang

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

We present an approach that combines appearance and semantic information for 2D image-based localization (2D-VL) across large perceptual changes and time lags. Compared to appearance features, the semantic layout of a scene is generally…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Zachary Seymour , Karan Sikka , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar