English
Related papers

Related papers: Logit-Level Uncertainty Quantification in Vision-L…

200 papers

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Deep learning models for semantic segmentation are prone to poor performance in real-world applications due to the highly challenging nature of the task. Model uncertainty quantification (UQ) is one way to address this issue of lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Rishabh Singh , Jose C. Principe

The deployment of vision-language models (VLMs) in dermatology is hindered by the trilemma of high computational costs, extreme data scarcity, and the black-box nature of deep learning. To address these challenges, we present SkinCLIP-VL, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhixiang Lu , Shijie Xu , Kaicheng Yan , Xuyue Cai , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Jionglong Su

To leverage the full potential of Large Language Models (LLMs) it is crucial to have some information on their answers' uncertainty. This means that the model has to be able to quantify how certain it is in the correctness of a given…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mirko Borszukovszki , Ivo Pascal de Jong , Matias Valdenegro-Toro

Vision-Language Models (VLMs), exemplified by CLIP, have emerged as foundational for multimodal intelligence. However, their capacity for logical understanding remains significantly underexplored, resulting in critical ''logical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yuchen Zhou , Jiayu Tang , Shuo Yang , Xiaoyan Xiao , Yuqin Dai , Wenhao Yang , Chao Gou , Xiaobo Xia , Tat-Seng Chua

Despite the outstanding performance in multimodal tasks, Large Vision-Language Models (LVLMs) have been plagued by the issue of hallucination, i.e., generating content that is inconsistent with the corresponding visual inputs. While…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Bei Yan , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Recent advances in Vision-Language Models (VLMs) have achieved impressive progress in multimodal mathematical reasoning. Yet, how much visual information truly contributes to reasoning remains unclear. Existing benchmarks report strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yuandong Wang , Yao Cui , Yuxin Zhao , Zhen Yang , Yangfu Zhu , Zhenzhou Shao

Large language models (LLMs) have shown remarkable achievements in natural language processing tasks, producing high-quality outputs. However, LLMs still exhibit limitations, including the generation of factually incorrect information. In…

Computation and Language · Computer Science 2023-11-17 Sridevi Wagle , Sai Munikoti , Anurag Acharya , Sara Smith , Sameera Horawalavithana

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Vision-language models (VLMs), such as CLIP, have gained popularity for their strong open vocabulary classification performance, but they are prone to assigning high confidence scores to misclassifications, limiting their reliability in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zhenxiang Lin , Maryam Haghighat , Will Browne , Dimity Miller

The recent performance leap of Large Language Models (LLMs) opens up new opportunities across numerous industrial applications and domains. However, erroneous generations, such as false predictions, misinformation, and hallucination made by…

Software Engineering · Computer Science 2025-01-07 Yuheng Huang , Jiayang Song , Zhijie Wang , Shengming Zhao , Huaming Chen , Felix Juefei-Xu , Lei Ma

As large language models (LLMs) are increasingly deployed in high-stakes applications, robust uncertainty estimation is essential for ensuring the safe and trustworthy deployment of LLMs. We present the most comprehensive study to date of…

Computation and Language · Computer Science 2025-06-02 Linwei Tao , Yi-Fan Yeh , Minjing Dong , Tao Huang , Philip Torr , Chang Xu

Despite the widespread adoption of large language models (LLMs) for recommendation, we demonstrate that LLMs often exhibit uncertainty in their recommendations. To ensure the trustworthy use of LLMs in generating recommendations, we…

Information Retrieval · Computer Science 2025-02-13 Wonbin Kweon , Sanghwan Jang , SeongKu Kang , Hwanjo Yu

Convection of liquid metals drives large natural processes and is important in technical processes. Model experiments are conducted for research purposes where simulations are expensive and the clarification of open questions requires novel…

Fluid Dynamics · Physics 2024-04-18 David Weik , Zehua Dou , Dirk Räbiger , Tobias Vogt , Sven Eckert , Jürgen Czarske , Lars Büttner

Large Language Models (LLMs) have significantly advanced sentiment analysis, yet their inherent uncertainty and variability pose critical challenges to achieving reliable and consistent outcomes. This paper systematically explores the Model…

TodevelopanovelUncertaintyQuantification (UQ) framework to estimate the uncertainty of patient survival models in the absence of ground truth, we developed and evaluated our approach based on a dataset of 1383 patients treated with…

The remarkable performance of large language models (LLMs) in content generation, coding, and common-sense reasoning has spurred widespread integration into many facets of society. However, integration of LLMs raises valid questions on…

Computation and Language · Computer Science 2025-07-03 Ola Shorinwa , Zhiting Mei , Justin Lidard , Allen Z. Ren , Anirudha Majumdar

Large Language Models (LLMs) have demonstrated remarkable capability in a variety of NLP tasks. However, LLMs are also prone to generate nonfactual content. Uncertainty Quantification (UQ) is pivotal in enhancing our understanding of a…

Computation and Language · Computer Science 2024-10-07 Caiqi Zhang , Fangyu Liu , Marco Basaldella , Nigel Collier

Vision-Language Models (VLMs) have achieved strong performance on standard vision-language benchmarks, yet often rely on surface-level recognition rather than deeper reasoning. We propose visual word puzzles as a challenging alternative, as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Ali Najar , Alireza Mirrokni , Arshia Izadyari , Sadegh Mohammadian , Amir Homayoon Sharifizade , Asal Meskin , Mobin Bagherian , Ehsaneddin Asgari
‹ Prev 1 3 4 5 6 7 10 Next ›