English
Related papers

Related papers: Fine-tuning a vision-language model for fracture-s…

200 papers

Recent advances in vision-language models (VLMs) have sparked growing interest in using them to automate web tasks, yet their feasibility as independent agents that reason and act purely from visual input remains underexplored. We…

Human-Computer Interaction · Computer Science 2026-04-14 Alexandra Yakovleva , Henrik Pärssinen , Harri Valpola , Juho Kannala , Alexander Ilin

Vision-Language Model (VLM) have gained widespread adoption in Open-Vocabulary (OV) object detection and segmentation tasks. Despite they have shown promise on OV-related tasks, their effectiveness in conventional vision tasks has thus far…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yongchao Feng , Yajie Liu , Shuai Yang , Wenrui Cai , Jinqing Zhang , Qiqi Zhan , Ziyue Huang , Hongxi Yan , Qiao Wan , Chenguang Liu , Junzhe Wang , Jiahui Lv , Ziqi Liu , Tengyuan Shi , Qingjie Liu , Yunhong Wang

Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between. One cause of this failure arises before language reasoning begins: the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Renjie Gu , Kaichen Zhou , Yan Luo , Mengyu Wang

Vision--language models reliably name objects in a scene, but do they represent the 3D layout those objects inhabit? We introduce a 3,034-sample human-curated benchmark targeting three components of spatial understanding: depth-ordered…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Animesh Maheshwari , Divyansh Sahu , Nishit Verma

The integration of artificial intelligence in healthcare has opened new horizons for improving medical diagnostics and patient care. However, challenges persist in developing systems capable of generating accurate and contextually relevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Salmè , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

Vision-Language Models (VLMs) excel at complex visual tasks such as VQA and chart understanding, yet recent work suggests they struggle with simple perceptual tests. We present an evaluation of vision-language models' capacity for nonlocal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Shmuel Berman , Jia Deng

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

Artificial Intelligence · Computer Science 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Professionals working in technical domain typically hand-draw (on whiteboard, paper, etc.) technical diagrams (e.g., flowcharts, block diagrams, etc.) during discussions; however, if they want to edit these later, it needs to be drawn from…

Computation and Language · Computer Science 2026-01-27 Tafazzul Nadeem , Bhavik Shangari , Manish Rai , Gagan Raj Gupta , Ashutosh Modi

Visual Language Models (VLMs) have demonstrated impressive capabilities in visual grounding tasks. However, their effectiveness in the medical domain, particularly for abnormality detection and localization within medical images, remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jun Li , Che Liu , Wenjia Bai , Rossella Arcucci , Cosmin I. Bercea , Julia A. Schnabel

Instruction tuning has significantly advanced large language models (LLMs) such as ChatGPT, enabling them to align with human instructions across diverse tasks. However, progress in open vision-language models (VLMs) has been limited due to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Lei Li , Yuwei Yin , Shicheng Li , Liang Chen , Peiyi Wang , Shuhuai Ren , Mukai Li , Yazheng Yang , Jingjing Xu , Xu Sun , Lingpeng Kong , Qi Liu

Vision-language models (VLMs) demonstrate impressive zero-shot and few-shot learning capabilities, making them essential for several downstream tasks. However, fine-tuning these models at scale remains challenging, particularly in federated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Arkajyoti Mitra , Afia Anjum , Paul Agbaje , Mert Pesé , Habeeb Olufowobi

Recent advances in generative artificial intelligence have enabled the creation of highly realistic image forgeries, raising significant concerns about digital media authenticity. While existing detection methods demonstrate promising…

Multimedia · Computer Science 2025-04-15 Junhao Xu , Jingjing Chen , Yang Jiao , Jiacheng Zhang , Zhiyu Tan , Hao Li , Yu-Gang Jiang

Recent advances in multimodal large language models (MLLMs) have demonstrated strong capabilities in understanding general visual content. However, these general-domain MLLMs perform poorly in face perception tasks, often producing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jingzhi Li , Changjiang Luo , Ruoyu Chen , Hua Zhang , Wenqi Ren , Jianhou Gan , Xiaochun Cao

Vision-Language Models (VLMs) excel at 2D tasks such as grounding and captioning, yet remain limited in 3D understanding. A key limitation is their text-only supervision paradigm, which under-constrains fine-grained visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanxun Yu , Xuan Qu , Yuxin Wang , Jianke Zhu , Lei Ke

Large language models (LLMs) have increased interest in vision language models (VLMs), which process image-text pairs as input. Studies investigating the visual understanding ability of VLMs have been proposed, but such studies are still…

Computation and Language · Computer Science 2024-06-25 Jesse Atuhurra , Iqra Ali , Tatsuya Hiraoka , Hidetaka Kamigaito , Tomoya Iwakura , Taro Watanabe

Safety hazard identification and prevention are the key elements of proactive safety management. Previous research has extensively explored the applications of computer vision to automatically identify hazards from image clips collected…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Muhammad Adil , Gaang Lee , Vicente A. Gonzalez , Qipei Mei

Crash diagrams are essential tools in transportation safety analysis, yet their manual preparation remains time-consuming and prone to human variability. This study investigates the use of Vision-Language Models (VLMs) to automate crash…

Human-Computer Interaction · Computer Science 2026-04-20 Xiao Lu , Hao Zhen , Jidong J. Yang

Vision Language Models (VLMs) hold great promise for streamlining labour-intensive medical imaging workflows, yet systematic security evaluations in clinical settings remain scarce. We introduce VSF--Med, an end-to-end vulnerability-scoring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Binesh Sadanandan , Vahid Behzadan

Vision-Language Models (VLMs) have recently shown remarkable progress in multimodal reasoning, yet their applications in autonomous driving remain limited. In particular, the ability to understand road topology, a key requirement for safe…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Xin Chen , Jia He , Maozheng Li , Dongliang Xu , Tianyu Wang , Yixiao Chen , Zhixin Lin , Yue Yao

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Amirhosein Chahe , Lifeng Zhou
‹ Prev 1 3 4 5 6 7 10 Next ›