中文
相关论文

相关论文: Logit-Level Uncertainty Quantification in Vision-L…

200 篇论文

Multimodal large language models (MLLMs) combine visual and textual data for tasks such as image captioning and visual question answering. Proper uncertainty calibration is crucial, yet challenging, for reliable use in areas like healthcare…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Zijun Chen , Wenbo Hu , Guande He , Zhijie Deng , Zheng Zhang , Richang Hong

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci

Uncertainty quantification (UQ) is an important component of molecular property prediction, particularly for drug discovery applications where model predictions direct experimental design and where unanticipated imprecision wastes valuable…

机器学习 · 计算机科学 2020-05-21 Lior Hirschfeld , Kyle Swanson , Kevin Yang , Regina Barzilay , Connor W. Coley

Deep learning models (DLMs) frequently achieve accurate segmentation and classification of tumors from medical images. However, DLMs lacking feedback on their image segmentation mechanisms, such as Dice coefficients and confidence in their…

图像与视频处理 · 电气工程与系统科学 2024-12-31 Elhoucine Elfatimi , Pratik Shah

Machine learning (ML) offers promising new approaches to tackle complex problems and has been increasingly adopted in chemical and materials sciences. Broadly speaking, ML models employ generic mathematical functions and attempt to learn…

材料科学 · 物理学 2024-08-21 Jin Dai , Santosh Adhikari , Mingjian Wen

Uncertainty quantification (UQ) plays a pivotal role in reduction of uncertainties during both optimization and decision making processes. It can be applied to solve a variety of real-world applications in science and engineering. Bayesian…

The rise of large language models (LLMs) and their tight integration into our daily life make it essential to dedicate efforts towards their trustworthiness. Uncertainty quantification for LLMs can establish more human trust into their…

计算与语言 · 计算机科学 2026-05-06 Daniel Yang , Yao-Hung Hubert Tsai , Makoto Yamada

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

计算与语言 · 计算机科学 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

Uncertainty quantification has emerged as an effective approach to closed-book hallucination detection for LLMs, but existing methods are largely designed for short-form outputs and do not generalize well to long-form generation. We…

计算与语言 · 计算机科学 2026-02-20 Dylan Bouchard , Mohit Singh Chauhan , Viren Bajaj , David Skarbrevik

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Despite demonstrating impressive capabilities, Large Language Models (LLMs) still often struggle to accurately express the factual knowledge they possess, especially in cases where the LLMs' knowledge boundaries are ambiguous. To improve…

计算与语言 · 计算机科学 2025-05-26 Boyang Xue , Fei Mi , Qi Zhu , Hongru Wang , Rui Wang , Sheng Wang , Erxin Yu , Xuming Hu , Kam-Fai Wong

Large language models (LLMs) deliver impressive results for a variety of tasks, but state-of-the-art systems require fast GPUs with large amounts of memory. To reduce both the memory and latency of these systems, practitioners quantize…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Gautom Das , Vincent La , Ethan Lau , Abhinav Shrivastava , Matthew Gwilliam

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

计算与语言 · 计算机科学 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Combining multiple Vision-Language Models (VLMs) can enhance multimodal reasoning and robustness, but aggregating heterogeneous models' outputs amplifies uncertainty and increases the risk of hallucinations. We propose SCoOP…

人工智能 · 计算机科学 2026-05-29 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Uncertainty Quantification (UQ) in Language Models (LMs) is key to improving their safety and reliability. Evaluations often use metrics like AUROC to assess how well UQ methods (e.g., negative sequence probabilities) correlate with task…

With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and…

计算与语言 · 计算机科学 2024-11-04 Xin Qiu , Risto Miikkulainen

Vision-Language Models (VLMs) have shown promise in various 2D visual tasks, yet their readiness for 3D clinical diagnosis remains unclear due to stringent demands for recognition precision, reasoning ability, and domain knowledge. To…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Yixiong Chen , Wenjie Xiao , Pedro R. A. S. Bassi , Xinze Zhou , Sezgin Er , Ibrahim Ethem Hamamci , Zongwei Zhou , Alan Yuille

Uncertainty Quantification (UQ) is essential for creating trustworthy machine learning models. Recent years have seen a steep rise in UQ methods that can flag suspicious examples, however, it is often unclear what exactly these methods…

机器学习 · 计算机科学 2023-10-31 Hao Sun , Boris van Breugel , Jonathan Crabbe , Nabeel Seedat , Mihaela van der Schaar