English
Related papers

Related papers: Can We Trust the Performance Evaluation of Uncerta…

200 papers

With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and…

Computation and Language · Computer Science 2024-11-04 Xin Qiu , Risto Miikkulainen

Large Language Models (LLMs) show promise for natural language generation in healthcare, but risk hallucinating factually incorrect information. Deploying LLMs for medical question answering necessitates reliable uncertainty estimation (UE)…

Computation and Language · Computer Science 2024-07-12 Jiaxin Wu , Yizhou Yu , Hong-Yu Zhou

Research on automated text summarization relies heavily on human and automatic evaluation. While recent work on human evaluation mainly adopted intrinsic evaluation methods, judging the generic quality of text summaries, e.g.…

Computation and Language · Computer Science 2023-05-25 Xiao Pu , Mingqi Gao , Xiaojun Wan

As Large Language Models (LLMs) are increasingly deployed in real-world applications, reliable uncertainty quantification (UQ) becomes critical for safe and effective use. Most existing UQ approaches for language models aim to produce a…

Computation and Language · Computer Science 2026-04-14 Maiya Goloburda , Roman Vashurin , Fedor Chernogorsky , Nurkhan Laiyk , Daniil Orel , Preslav Nakov , Maxim Panov

The recent performance leap of Large Language Models (LLMs) opens up new opportunities across numerous industrial applications and domains. However, erroneous generations, such as false predictions, misinformation, and hallucination made by…

Software Engineering · Computer Science 2025-01-07 Yuheng Huang , Jiayang Song , Zhijie Wang , Shengming Zhao , Huaming Chen , Felix Juefei-Xu , Lei Ma

Uncertainty estimation is an essential and heavily-studied component for the reliable application of semantic segmentation methods. While various studies exist claiming methodological advances on the one hand, and successful application on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Kim-Celine Kahl , Carsten T. Lüth , Maximilian Zenk , Klaus Maier-Hein , Paul F. Jaeger

In recent years, Large Language Models (LLMs) have become fundamental to a broad spectrum of artificial intelligence applications. As the use of LLMs expands, precisely estimating the uncertainty in their predictions has become crucial.…

Artificial Intelligence · Computer Science 2024-10-29 Mohammad Beigi , Sijia Wang , Ying Shen , Zihao Lin , Adithya Kulkarni , Jianfeng He , Feng Chen , Ming Jin , Jin-Hee Cho , Dawei Zhou , Chang-Tien Lu , Lifu Huang

In recent years, large language models (LLMs) have become increasingly prevalent, offering remarkable text generation capabilities. However, a pressing challenge is their tendency to make confidently wrong predictions, highlighting the…

Computation and Language · Computer Science 2024-03-06 Xiang Gao , Jiaxin Zhang , Lalla Mouatadid , Kamalika Das

Abstractive text summarization has garnered increased interest as of late, in part due to the proliferation of large language models (LLMs). One of the most pressing problems related to generation of abstractive summaries is the need to…

Computation and Language · Computer Science 2023-10-17 Grant C. Forbes , Parth Katlana , Zeydy Ortiz

Uncertainty estimation (UE) aims to detect hallucinated outputs of large language models (LLMs) to improve their reliability. However, UE metrics often exhibit unstable performance across configurations, which significantly limits their…

Artificial Intelligence · Computer Science 2026-04-02 Ponhvoan Srey , Quang Minh Nguyen , Xiaobao Wu , Anh Tuan Luu

As large language models (LLMs) are increasingly deployed in high-stakes applications, robust uncertainty estimation is essential for ensuring the safe and trustworthy deployment of LLMs. We present the most comprehensive study to date of…

Computation and Language · Computer Science 2025-06-02 Linwei Tao , Yi-Fan Yeh , Minjing Dong , Tao Huang , Philip Torr , Chang Xu

Large language models (LLMs) have shown promising results in a wide array of generative NLP tasks, such as summarization and machine translation. In the context of narrative generation, however, existing models still do not capture factors…

Computation and Language · Computer Science 2023-10-23 Joseph Marvin Imperial , Harish Tayyar Madabushi

Recent advances of powerful Language Models have allowed Natural Language Generation (NLG) to emerge as an important technology that can not only perform traditional tasks like summarisation or translation, but also serve as a natural…

Computation and Language · Computer Science 2023-07-31 Joris Baan , Nico Daheim , Evgenia Ilia , Dennis Ulmer , Haau-Sing Li , Raquel Fernández , Barbara Plank , Rico Sennrich , Chrysoula Zerva , Wilker Aziz

Large Language Models (LLMs) have become indispensable tools across various applications, making it more important than ever to ensure the quality and the trustworthiness of their outputs. This has led to growing interest in uncertainty…

Computation and Language · Computer Science 2025-09-26 Roman Vashurin , Maiya Goloburda , Preslav Nakov , Maxim Panov

Applications of large language models often involve the generation of free-form responses, in which case uncertainty quantification becomes challenging. This is due to the need to identify task-specific uncertainties (e.g., about the…

Computation and Language · Computer Science 2024-10-21 Ziyu Wang , Chris Holmes

Transformer-based language models have set new benchmarks across a wide range of NLP tasks, yet reliably estimating the uncertainty of their predictions remains a significant challenge. Existing uncertainty estimation (UE) techniques often…

Machine Learning · Computer Science 2024-09-18 Elizaveta Kostenok , Daniil Cherniavskii , Alexey Zaytsev

Large language models (LLMs) specializing in natural language generation (NLG) have recently started exhibiting promising capabilities across a variety of domains. However, gauging the trustworthiness of responses generated by LLMs remains…

Computation and Language · Computer Science 2024-05-21 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Despite notable advances in large language models (LLMs), reliable evaluation of text generation tasks such as text style transfer (TST) remains an open challenge. Existing research has shown that automatic metrics often correlate poorly…

Computation and Language · Computer Science 2026-03-05 Vitaly Protasov , Nikolay Babakov , Daryna Dementieva , Alexander Panchenko

The generation of texts using Large Language Models (LLMs) is inherently uncertain, with sources of uncertainty being not only the generation of texts, but also the prompt used and the downstream interpretation. Within this work, we provide…

Machine Learning · Computer Science 2026-03-30 Steffen Herbold , Florian Lemmerich

Large language models (LLMs) show remarkable promise for democratizing automated reasoning by generating formal specifications. However, a fundamental tension exists: LLMs are probabilistic, while formal verification demands deterministic…