English
Related papers

Related papers: WebAccessVL: Violation-Aware VLM for Web Accessibi…

200 papers

Approximately 200 million individuals around the world suffer from varying degrees of visual impairment, making it crucial to leverage AI technology to offer walking assistance for these people. With the recent progress of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhiqiang Yuan , Ting Zhang , Ying Deng , Jiapei Zhang , Yeshuang Zhu , Zexi Jia , Jie Zhou , Jinchao Zhang

Visually linking matching cues is a crucial ability in daily life, such as identifying the same person in multiple photos based on their cues, even without knowing who they are. Despite the extensive knowledge that vision-language models…

Computation and Language · Computer Science 2025-07-03 Jianshu Zhang , Dongyu Yao , Renjie Pi , Paul Pu Liang , Yi R. Fung

Automating garment manipulation poses a significant challenge for assistive robotics due to the diverse and deformable nature of garments. Traditional approaches typically require separate models for each garment type, which limits…

Robotics · Computer Science 2024-10-08 Xin Li , Siyuan Huang , Qiaojun Yu , Zhengkai Jiang , Ce Hao , Yimeng Zhu , Hongsheng Li , Peng Gao , Cewu Lu

World models - generative models that simulate environment dynamics conditioned on past observations and actions - are gaining prominence in planning, simulation, and embodied AI. However, evaluating their rollouts remains a fundamental…

Video-Language Models (VLMs) have demonstrated impressive multi-modal reasoning capabilities across diverse computer vision applications. However, these VLMs are task-specific and assume that both video and language inputs are complete.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang , Changshuo Wang , Keke Tang , Daizong Liu , Siyi Wang , Wei Ji

Face verification systems have seen substantial advancements; however, they often lack transparency in their decision-making processes. In this paper, we introduce an innovative Vision-Language Model (VLM) for Face Verification, which not…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Syed Abdul Hannan , Hazim Bukhari , Thomas Cantalapiedra , Eman Ansar , Massa Baali , Rita Singh , Bhiksha Raj

The success of Vision Language Models (VLMs) on various vision-language tasks heavily relies on pre-training with large scale web-crawled datasets. However, the noisy and incomplete nature of web data makes dataset scale crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Yiyi Tao , Zhuoyue Wang , Hang Zhang , Lun Wang

The Large Vision-Language Model (LVLM) integrates computer vision and natural language processing techniques, offering substantial application potential. However, these models demand extensive resources during inference. Adaptive attention…

Artificial Intelligence · Computer Science 2025-02-10 Junyang Zhang , Mu Yuan , Ruiguang Zhong , Puhan Luo , Huiyou Zhan , Ningkang Zhang , Chengchen Hu , Xiangyang Li

Assessing the aesthetic quality of graphic design is central to visual communication, yet remains underexplored in vision language models (VLMs). We investigate whether VLMs can evaluate design aesthetics in ways comparable to humans. Prior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Arctanx An , Shizhao Sun , Danqing Huang , Mingxi Cheng , Yan Gao , Ji Li , Yu Qiao , Jiang Bian

Model editing aims to correct outdated or erroneous knowledge in large models without costly retraining. Recent research discovered that the mid-layer representation of the subject's final token in a prompt has a strong influence on factual…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Qizhou Chen , Taolin Zhang , Chengyu Wang , Xiaofeng He , Dakan Wang , Tingting Liu

Vision Language Models (VLMs) have advanced perception in autonomous driving (AD), but they remain vulnerable to adversarial threats. These risks range from localized physical patches to imperceptible global perturbations. Existing defense…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xiaoxu Peng , Dong Zhou , Jianwen Zhang , Guanghui Sun , Anh Tu Ngo , Anupam Chattopadhyay

Visual agent models for automating human activities on Graphical User Interfaces (GUIs) have emerged as a promising research direction, driven by advances in large Vision Language Models (VLMs). A critical challenge in GUI automation is the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Joonhyung Park , Peng Tang , Sagnik Das , Srikar Appalaraju , Kunwar Yashraj Singh , R. Manmatha , Shabnam Ghadar

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

We introduce VLM-Lens, a toolkit designed to enable systematic benchmarking, analysis, and interpretation of vision-language models (VLMs) by supporting the extraction of intermediate outputs from any layer during the forward pass of…

Computation and Language · Computer Science 2025-10-03 Hala Sheta , Eric Huang , Shuyu Wu , Ilia Alenabi , Jiajun Hong , Ryker Lin , Ruoxi Ning , Daniel Wei , Jialin Yang , Jiawei Zhou , Ziqiao Ma , Freda Shi

Large Vision-Language Models (LVLMs) have shown impressive capabilities across a range of tasks that integrate visual and textual understanding, such as image captioning and visual question answering. These models are trained on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiaomei Zhang , Hanyu Zheng , Xiangyu Zhu , Jinghuan Wei , Junhong Zou , Zhen Lei , Zhaoxiang Zhang

Information visualizations are powerful tools that help users quickly identify patterns, trends, and outliers, facilitating informed decision-making. However, when visualizations incorporate deceptive design elements-such as truncated or…

Computation and Language · Computer Science 2025-08-14 Ridwan Mahbub , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Mizanur Rahman , Mir Tafseer Nayeem , Enamul Hoque

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

The integration of vision-language models into robotic systems constitutes a significant advancement in enabling machines to interact with their surroundings in a more intuitive manner. While VLMs offer rich multimodal reasoning, existing…

Artificial Intelligence · Computer Science 2025-03-03 Hamed Rahimi , Adil Bahaj , Mouad Abrini , Mahdi Khoramshahi , Mounir Ghogho , Mohamed Chetouani

As the modern vehicle becomes more software-defined, it is beginning to take significant effort to avoid serious regression in software design. This is because automotive software architects rely largely upon manual review of code to spot…

Software Engineering · Computer Science 2022-08-30 Dhasarathy Parthasarathy , Cecilia Ekelin , Anjali Karri , Jiapeng Sun , Panagiotis Moraitis

Vision-based quality assessment in additive manufacturing often requires dedicated machine learning models and application-specific datasets. However, data collection and model training can be expensive and time-consuming. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang