English
Related papers

Related papers: XBench: A Comprehensive Benchmark for Visual-Langu…

200 papers

Vision-language modeling (VLM) aims to bridge the information gap between images and natural language. Under the new paradigm of first pre-training on massive image-text pairs and then fine-tuning on task-specific data, VLM in the remote…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xingxing Weng , Chao Pang , Gui-Song Xia

Recent advancements in multimodal models have significantly improved vision-language (VL) alignment in radiology. However, existing approaches struggle to effectively utilize complex radiology reports for learning and offer limited…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi

Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, their deployment in risk-sensitive areas requires a deeper…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weijie Tu , Weijian Deng , Dylan Campbell , Stephen Gould , Tom Gedeon

A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-tuning these VLMs for medical use presents considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Aisha Urooj Khan , John Garrett , Tyler Bradshaw , Lonie Salkowski , Jiwoong Jason Jeong , Amara Tariq , Imon Banerjee

Image geolocalization has traditionally been addressed through retrieval-based place recognition or geometry-based visual localization pipelines. Recent advances in Vision-Language Models (VLMs) have demonstrated strong zero-shot reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Siddhant Bharadwaj , Ashish Vashist , Fahimul Aleem , Shruti Vyas

Low-level visual perception underpins reliable remote sensing (RS) image analysis, yet current image quality assessment (IQA) methods output uninterpretable scalar scores rather than characterizing physics-driven RS degradations, deviating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chen Zhong , Xiao An , Jiaxing Sun , Zihan Gui , Guangyi Yang , Wei He

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Evaluating the alignment capabilities of large Vision-Language Models (VLMs) is essential for determining their effectiveness as helpful assistants. However, existing benchmarks primarily focus on basic abilities using nonverbal methods,…

Computation and Language · Computer Science 2025-06-05 Yuhang Wu , Wenmeng Yu , Yean Cheng , Yan Wang , Xiaohan Zhang , Jiazheng Xu , Ming Ding , Yuxiao Dong

Large Vision-Language Models (LVLMs) have demonstrated outstanding performance across various multimodal tasks. However, they suffer from a problem known as language prior, where responses are generated based solely on textual patterns…

Artificial Intelligence · Computer Science 2025-02-11 Kang-il Lee , Minbeom Kim , Seunghyun Yoon , Minsung Kim , Dongryeol Lee , Hyukhun Koh , Kyomin Jung

Although large Vision-Language Models (VLMs) have demonstrated remarkable performance in a wide range of multimodal tasks, their true reasoning capabilities on human IQ tests remain underexplored. To advance research on the fluid…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Tan-Hanh Pham , Phu-Vinh Nguyen , Dang The Hung , Bui Trong Duong , Vu Nguyen Thanh , Chris Ngo , Tri Quang Truong , Truong-Son Hy

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

Visually linking matching cues is a crucial ability in daily life, such as identifying the same person in multiple photos based on their cues, even without knowing who they are. Despite the extensive knowledge that vision-language models…

Computation and Language · Computer Science 2025-07-03 Jianshu Zhang , Dongyu Yao , Renjie Pi , Paul Pu Liang , Yi R. Fung

Vision-language models (VLMs) are gaining attention in medical image analysis. These are pre-trained on large, heterogeneous data sources, yielding rich and transferable representations. Notably, the combination of modality-specialized VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Julio Silva-Rodríguez , Fereshteh Shakeri , Houda Bahig , Jose Dolz , Ismail Ben Ayed

Despite recent advances in video understanding, the capabilities of Large Video Language Models (LVLMs) to perform video-based causal reasoning remains underexplored, largely due to the absence of relevant and dedicated benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Pritam Sarkar , Ali Etemad

As vision-language models (VLMs) are deployed globally, their ability to understand culturally situated knowledge becomes essential. Yet, existing evaluations largely assess static recall or isolated visual grounding, leaving unanswered…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Bryan Chen Zhengyu Tan , Zheng Weihua , Zhengyuan Liu , Nancy F. Chen , Hwaran Lee , Kenny Tsu Wei Choo , Roy Ka-Wei Lee

Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of images across multiple 3D sequences and longitudinal studies. This process requires advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shiv Ghosh , Junayd Lateef , Chih-Hua Liu , Yannan Yu , Andreas M. Rauschecker , Madhumita Sushil

Vision-Language Models (VLMs) have advanced across multimodal benchmarks but still show clear gaps in ordinal number understanding, i.e., the ability to track relative positions and generalize to large indices. We present OrdinalBench, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yusuke Tozaki , Hisashi Miyamori

Vision-language models (VLMs) have gained significant attention in computational pathology due to their multimodal learning capabilities that enhance big-data analytics of giga-pixel whole slide image (WSI). However, their sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Vasudev Sharma , Ahmed Alagha , Abdelhakim Khellaf , Vincent Quoc-Huy Trinh , Mahdi S. Hosseini

Vision-language models (VLMs) have recently shown remarkable performance in navigation and localization tasks by leveraging large-scale pretraining for semantic understanding. However, applying VLMs to 6-DoF endoscopic camera localization…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Qingyao Tian , Bingyu Yang , Huai Liao , Xinyan Huang , Junyong Li , Dong Yi , Hongbin Liu

While multimodal large language models (MLLMs) exhibit strong performance on single-video tasks (e.g., video question answering), their capability for spatiotemporal pattern reasoning across multiple videos remains a critical gap in pattern…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Nannan Zhu , Yonghao Dong , Teng Wang , Xueqian Li , Shengjun Deng , Yijia Wang , Zheng Hong , Tiantian Geng , Guo Niu , Hanyan Huang , Xiongfei Yao , Shuaiwei Jiao
‹ Prev 1 3 4 5 6 7 10 Next ›