English
Related papers

Related papers: PathGLS: Evaluating Pathology Vision-Language Mode…

200 papers

Vision-Language Models (VLMs) are advancing computational pathology with superior visual understanding capabilities. However, current systems often reduce diagnosis to directly output conclusions without verifiable evidence-linked…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Songhan Jiang , Fengchun Liu , Ziyue Wang , Linghan Cai , Yongbing Zhang

Large Language Models (LLMs) and Vision-Language Large Models (LVLMs) have achieved remarkable progress in natural language processing and multimodal understanding. Despite their impressive generalization capabilities, current LVLMs often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Leilei Guo , Antonio Carlos Rivera , Peiyu Tang , Haoxuan Ren , Zheyu Song

Despite their promise to perform complex reasoning, large language models (LLMs) have been shown to have limited effectiveness in end-to-end planning. This has inspired an intriguing question: if these models cannot plan well, can they…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Mohamed Aghzal , Xiang Yue , Erion Plaku , Ziyu Yao

Large Vision-Language Models (LVLMs) have achieved significant success in recent years, and they have been extended to the medical domain. Although demonstrating satisfactory performance on medical Visual Question Answering (VQA) tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Danfeng Guo , Demetri Terzopoulos

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

Computation and Language · Computer Science 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart

Current benchmarks for assessing vision-language models (VLMs) often focus on their perception or problem-solving capabilities and neglect other critical aspects such as fairness, multilinguality, or toxicity. Furthermore, they differ in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Tony Lee , Haoqin Tu , Chi Heem Wong , Wenhao Zheng , Yiyang Zhou , Yifan Mai , Josselin Somerville Roberts , Michihiro Yasunaga , Huaxiu Yao , Cihang Xie , Percy Liang

Visually-conditioned language models (VLMs) have seen growing adoption in applications such as visual dialogue, scene understanding, and robotic task planning; adoption that has fueled a wealth of new models such as LLaVa, InstructBLIP, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Siddharth Karamcheti , Suraj Nair , Ashwin Balakrishna , Percy Liang , Thomas Kollar , Dorsa Sadigh

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

The rapid development of Large Multimodal Models (LMMs) has significantly advanced multimodal understanding by harnessing the language abilities of Large Language Models (LLMs) and integrating modality-specific encoders. However, LMMs are…

Computation and Language · Computer Science 2025-02-20 Anirudh Phukan , Divyansh , Harshit Kumar Morj , Vaishnavi , Apoorv Saxena , Koustava Goswami

Recent advances in deep learning have completely transformed the domain of computational pathology (CPath). More specifically, it has altered the diagnostic workflow of pathologists by integrating foundation models (FMs) and vision-language…

Machine Learning · Computer Science 2024-09-19 Dibaloke Chanda , Milan Aryal , Nasim Yahya Soltani , Masoud Ganji

Vision-Language Models (VLMs) are increasingly deployed in settings where reliable visual grounding carries operational consequences, yet their behavior under progressively coercive prompt phrasing remains undercharacterized. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhiyuan Jiang , Weihao Hong , Xinlei Guan , Tejaswi Dhandu , Miles Q. Li , Meng Xu , Kuan Huang , Umamaheswara Rao Tida , Bingyu Shen , Daehan Kwak , Boyang Li

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

With the development of generative artificial intelligence and instruction tuning techniques, multimodal large language models (MLLMs) have made impressive progress on general reasoning tasks. Benefiting from the chain-of-thought (CoT)…

Machine Learning · Computer Science 2025-07-03 Junjie Zhou , Yingli Zuo , Shichang Feng , Peng Wan , Qi Zhu , Daoqiang Zhang , Wei Shao

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci

Large Vision Language Models (LVLMs) have achieved significant progress in integrating visual and textual inputs for multimodal reasoning. However, a recurring challenge is ensuring these models utilize visual information as effectively as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Estelle Aflalo , Gabriela Ben Melech Stan , Tiep Le , Man Luo , Shachar Rosenman , Sayak Paul , Shao-Yen Tseng , Vasudev Lal

Vision Language Models (VLMs) hold great promise for streamlining labour-intensive medical imaging workflows, yet systematic security evaluations in clinical settings remain scarce. We introduce VSF--Med, an end-to-end vulnerability-scoring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Binesh Sadanandan , Vahid Behzadan

Vision Language Models (VLMs) like CLIP have attracted substantial attention in pathology, serving as backbones for applications such as zero-shot image classification and Whole Slide Image (WSI) analysis. Additionally, they can function as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yuxuan Sun , Yunlong Zhang , Yixuan Si , Chenglu Zhu , Zhongyi Shui , Kai Zhang , Jingxiong Li , Xingheng Lyu , Tao Lin , Lin Yang

Vision language models (VLMs) are designed to extract relevant visuospatial information from images. Some research suggests that VLMs can exhibit humanlike scene understanding, while other investigations reveal difficulties in their ability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Sangeet Khemlani , Tyler Tran , Nathaniel Gyory , Anthony M. Harrison , Wallace E. Lawson , Ravenna Thielstrom , Hunter Thompson , Taaren Singh , J. Gregory Trafton