English
Related papers

Related papers: Fine-Tuning Vision-Language Models for Understandi…

200 papers

This paper addresses the challenge of answering technical questions derived from Japan's River and Sediment Control Technical Standards -- a multi-volume regulatory document covering survey, planning, design, and maintenance of river…

Information Retrieval · Computer Science 2026-03-17 Takato Yasuno

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Reliable evaluation is essential for the development of vision-language models (VLMs). However, Japanese VQA benchmarks have undergone far less iterative refinement than their English counterparts. As a result, many existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Issa Sugiura , Koki Maeda , Shuhei Kurita , Yusuke Oda , Daisuke Kawahara , Naoaki Okazaki

Vision-Language Models (VLMs) are powerful tools for processing and understanding text and images. We study the processing of visual tokens in the language model component of LLaVA, a prominent VLM. Our approach focuses on analyzing the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Clement Neo , Luke Ong , Philip Torr , Mor Geva , David Krueger , Fazl Barez

Detecting temporal changes in geographical landscapes is critical for applications like environmental monitoring and urban planning. While remote sensing data is abundant, existing vision-language models (VLMs) often fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hosam Elgendy , Ahmed Sharshar , Ahmed Aboeitta , Yasser Ashraf , Mohsen Guizani

This thesis explores a multimodal AI framework for enhancing construction safety through the combined analysis of textual and visual data. In safety-critical environments such as construction sites, accident data often exists in multiple…

Artificial Intelligence · Computer Science 2025-11-21 Islem Sahraoui

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

This paper presents a novel pipeline for 2D keypoint estima- tion of surgical tools by leveraging Vision Language Models (VLMs) fine- tuned using a low rank adjusting (LoRA) technique. Unlike traditional Convolutional Neural Network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Krit Duangprom , Tryphon Lambrou , Binod Bhattarai

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Thomson Tong , Diba Darooneh

The deployment of lightweight segmentation models on drones for autonomous power line inspection presents a critical challenge: maintaining reliable performance under real-world conditions that differ from training data. Although compact…

Artificial Intelligence · Computer Science 2026-04-08 Akram Hossain , Rabab Abdelfattah , Xiaofeng Wang , Kareem Abdelfatah

Vision Language Models (VLMs) hold great promise for streamlining labour-intensive medical imaging workflows, yet systematic security evaluations in clinical settings remain scarce. We introduce VSF--Med, an end-to-end vulnerability-scoring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Binesh Sadanandan , Vahid Behzadan

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Vision-language models (VLMs) have made substantial progress across a wide range of visual question answering benchmarks, spanning visual reasoning, document understanding, and multimodal dialogue. These improvements are evident in a wide…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Dhruba Ghosh , Yuhui Zhang , Ludwig Schmidt

Vision-Language Models (VLMs) excel at visual description yet remain under-validated for cultural interpretation. Existing benchmarks assess perception without interpretation, and common evaluation proxies, such as automated metrics and…

Computation and Language · Computer Science 2026-02-26 Haorui Yu , Xuehang Wen , Fengrui Zhang , Qiufeng Yi

Industrial diagrams such as piping and instrumentation diagrams (P&IDs) are essential for the design, operation, and maintenance of industrial plants. Converting these diagrams into digital form is an important step toward building digital…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sanjukta Ghosh

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Vision-Language Models (VLMs) demonstrate impressive capabilities across multimodal tasks, yet exhibit systematic spatial reasoning failures, achieving only 49% (CLIP) to 54% (BLIP-2) accuracy on basic directional relationships. For safe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Yugyung Lee

Recent advances in Image Quality Assessment (IQA) have leveraged Multi-modal Large Language Models (MLLMs) to generate descriptive explanations. However, despite their strong visual perception modules, these models often fail to reliably…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yuan Li , Zitang Sun , Yen-Ju Chen , Shin'ya Nishida

Image-based quality assessment (QA) in additive manufacturing (AM) often relies heavily on the expertise and constant attention of skilled human operators. While machine learning and deep learning methods have been introduced to assist in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qiaojie Zheng , Jiucai Zhang , Joy Gockel , Michael B. Wakin , Craig Brice , Xiaoli Zhang