English
Related papers

Related papers: PSF-Med: Measuring and Explaining Paraphrase Sensi…

200 papers

Large language models used for clinical abstraction are sensitive to prompt wording, yet most work treats prompts as fixed and studies uncertainty in isolation. We argue these should be treated jointly. Across two clinical tasks (MedAlign…

Computation and Language · Computer Science 2026-02-02 Arinbjörn Kolbeinsson , Daniel Timbie , Sajjan Narsinghani , Sanjay Hariharan

Vision-language models (VLMs) are increasingly deployed as evaluators in tasks requiring nuanced image understanding, yet their reliability in scoring alignment between images and text descriptions remains underexplored. We investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Arya Shah , Deepali Mishra , Chaklam Silpasuwanchai

Despite the promise of foundation models in medical AI, current systems remain limited - they are modality-specific and lack transparent reasoning processes, hindering clinical adoption. To address this gap, we present EVLF-FM, a multimodal…

Vision-language models (VLMs) demonstrate strong multimodal capabilities but have been found to be more susceptible to generating harmful content compared to their backbone large language models (LLMs). Our investigation reveals that the…

Machine Learning · Computer Science 2025-01-29 Qing Li , Jiahui Geng , Zongxiong Chen , Kun Song , Lei Ma , Fakhri Karray

Medical Vision-Language Models (Med-VLMs) have demonstrated remarkable performance across diverse medical imaging tasks by leveraging large-scale image-text pretraining. However, their confidence calibration is largely unexplored, and so…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Abhishek Basu , Fahad Shamshad , Ashshak Sharifdeen , Karthik Nandakumar , Muhammad Haris Khan

Recent Reinforcement Learning (RL) advances for Large Language Models (LLMs) have improved reasoning tasks, yet their resource-constrained application to medical imaging remains underexplored. We introduce ChexReason, a vision-language…

Large language models (LLMs) can fluently generate student-like responses, making them attractive as simulated students for training and evaluating AI tutors and human educators. Yet such simulators are typically evaluated by output…

Computation and Language · Computer Science 2026-05-14 Heejin Do , Shashank Sonkar , Mrinmaya Sachan

Vision-language models (VLMs) pre-trained at large scale have shown unprecedented transferability capabilities and are being progressively integrated into medical image analysis. Although its discriminative potential has been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Julio Silva-Rodríguez , Leo Fillioux , Paul-Henry Cournède , Maria Vakalopoulou , Stergios Christodoulidis , Ismail Ben Ayed , Jose Dolz

Large language models have been shown to behave inconsistently in response to meaning-preserving paraphrastic inputs. At the same time, researchers evaluate the knowledge and reasoning abilities of these models with test evaluations that do…

Computation and Language · Computer Science 2024-04-19 Neha Srikanth , Marine Carpuat , Rachel Rudinger

Incorporating large language models (LLMs) in medical question answering demands more than high average accuracy: a model that returns substantively different answers each time it is queried is not a reliable medical tool. Online health…

Information Retrieval · Computer Science 2026-04-14 Avi-ad Avraam Buskila

Vision language models (VLMs) have shown significant promise in visual grounding for images as well as videos. In medical imaging research, VLMs represent a bridge between object detection and segmentation, and report understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Andrew Seohwan Yu , Mohsen Hariri , Kunio Nakamura , Mingrui Yang , Xiaojuan Li , Vipin Chaudhary

Several recent works seek to adapt general-purpose large language models (LLMs) and vision-language models (VLMs) for medical applications through continued pretraining on publicly available biomedical corpora. These works typically claim…

Computation and Language · Computer Science 2025-07-01 Daniel P. Jeong , Pranav Mani , Saurabh Garg , Zachary C. Lipton , Michael Oberst

The reasoning gap between large and compact vision-language models (VLMs) limits the deployment of medical AI on portable clinical devices. Compact VLMs of 2--4B parameters can run on resource-constrained hardware but lack the multi-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Runze Ma , Shunbo Jia , Haonan Lyu , Guo Liu , Caizhi Liao

Large vision-language models (VLMs) often rely on familiar semantic priors, but existing evaluations do not cleanly separate perception failures from rule-mapping failures. We study this behavior as semantic fixation: preserving a default…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Md Tanvirul Alam

Visual language models (VLMs) have the potential to transform medical workflows. However, the deployment is limited by sycophancy. Despite this serious threat to patient safety, a systematic benchmark remains lacking. This paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Juangui Xu , Zikun Guo , Jingwei Lv , Hongbin Lin , Shu Yang , Jun Wen , Di Wang , Lijie Hu

Subtle semantic differences in retinal image and text data present great challenges for pre-training visual-language models. Moreover, false negative samples, i.e., image-text pairs having the same semantics but incorrectly regarded as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shengzhu Yang , Jiawei Du , Jia Guo , Weihang Zhang , Hanruo Liu , Huiqi Li , Ningli Wang

Pre-trained Language Models (PLMs) can be accurately fine-tuned for downstream text processing tasks. Recently, researchers have introduced several parameter-efficient fine-tuning methods that optimize input prompts or adjust a small number…

Computation and Language · Computer Science 2024-06-07 Saeed Najafi , Alona Fyshe

Vision-language models (VLMs) show promise in drafting radiology reports, yet they frequently suffer from logical inconsistencies, generating diagnostic impressions unsupported by their own perceptual findings or missing logically entailed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Vikash Singh , Debargha Ganguly , Haotian Yu , Chengwei Zhou , Prerna Singh , Brandon Lee , Vipin Chaudhary , Gourav Datta

Reinforcement learning (RL) is increasingly used to post-train medical Vision-Language Models (VLMs), yet it remains unclear whether RL improves medical visual reasoning or mainly sharpens behaviors already induced by supervised fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ahmadreza Jeddi , Kimia Shaban , Negin Baghbanzadeh , Natasha Sharan , Abhishek Moturu , Elham Dolatabadi , Babak Taati

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink