English
Related papers

Related papers: Trustworthy Summarization via Uncertainty Quantifi…

200 papers

Extracting meaning from uncertain, noisy data is a fundamental problem across time series analysis, pattern recognition, and language modeling. This survey presents a unified mathematical framework that connects classical estimation theory,…

Machine Learning · Computer Science 2025-08-22 Mohammed Elmusrati

We present a novel framework addressing a critical vulnerability in Large Language Models (LLMs): the prevalence of factual inaccuracies within intermediate reasoning steps despite correct final answers. This phenomenon poses substantial…

Computation and Language · Computer Science 2025-08-05 Rui Jiao , Yue Zhang , Jinku Li

Large language models (LLMs) excel in abstractive summarization tasks, delivering fluent and pertinent summaries. Recent advancements have extended their capabilities to handle long-input contexts, exceeding 100k tokens. However, in…

Computation and Language · Computer Science 2024-11-15 Mathieu Ravaut , Aixin Sun , Nancy F. Chen , Shafiq Joty

This paper addresses the challenge of model uncertainty in quantitative finance, where decisions in portfolio allocation, derivative pricing, and risk management rely on estimating stochastic models from limited data. In practice, the…

Computational Finance · Quantitative Finance 2025-06-10 Hans Buehler , Blanka Horvath , Yannick Limmer , Thorsten Schmidt

Large language models (LLMs) show remarkable promise for democratizing automated reasoning by generating formal specifications. However, a fundamental tension exists: LLMs are probabilistic, while formal verification demands deterministic…

The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision…

Machine Learning · Statistics 2023-10-11 Maryam Kheirandish , Shengfan Zhang , Donald G. Catanzaro , Valeriu Crudu

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text…

Computation and Language · Computer Science 2022-10-24 Bin Wang , Chen Zhang , Yan Zhang , Yiming Chen , Haizhou Li

Trust is a crucial factor affecting the adoption of machine learning (ML) models. Qualitative studies have revealed that end-users, particularly in the medical domain, need models that can express their uncertainty in decision-making…

Machine Learning · Computer Science 2023-04-21 Andrew Houston , Georgina Cosma

Recent advances in handling long sequences have facilitated the exploration of long-context in-context learning (ICL). While much of the existing research emphasizes performance improvements driven by additional in-context examples, the…

Computation and Language · Computer Science 2025-05-28 Yifei Wang , Yu Sheng , Linjing Li , Daniel Zeng

The recent explosion in the capabilities of large language models has led to a wave of interest in how best to prompt a model to perform a given task. While it may be tempting to simply choose a prompt based on average performance on a…

Machine Learning · Computer Science 2024-03-29 Thomas P. Zollo , Todd Morrill , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

Readability refers to how easily a reader can understand a written text. Several factors affect the readability level, such as the complexity of the text, its subject matter, and the reader's background knowledge. Generating summaries based…

Computation and Language · Computer Science 2023-10-17 Leonardo F. R. Ribeiro , Mohit Bansal , Markus Dreyer

The last decade in deep learning has brought on increasingly capable systems that are deployed on a wide variety of applications. In natural language processing, the field has been transformed by a number of breakthroughs including large…

Artificial Intelligence · Computer Science 2024-10-23 Dennis Ulmer

Query-focused summarization (QFS) is a fundamental task in natural language processing with broad applications, including search engines and report generation. However, traditional approaches assume the availability of relevant documents,…

Computation and Language · Computer Science 2024-08-21 Weijia Zhang , Jia-Hong Huang , Svitlana Vakulenko , Yumo Xu , Thilina Rajapakse , Evangelos Kanoulas

Evidence-based medicine promises to improve the quality of healthcare by empowering medical decisions and practices with the best available evidence. The rapid growth of medical evidence, which can be obtained from various sources, poses a…

The rapid rise of large language models (LLMs) is reshaping the landscape of automatic assessment in education. While these systems demonstrate substantial advantages in adaptability to diverse question types and flexibility in output…

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Large Language Models (LLMs) have shown significant advances in text generation but often lack the reliability needed for autonomous deployment in high-stakes domains like healthcare, law, and finance. Existing approaches rely on external…

Artificial Intelligence · Computer Science 2024-11-12 Ninad Naik

Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documents. Most recent…

Computation and Language · Computer Science 2022-03-16 Bo Pang , Erik Nijkamp , Wojciech Kryściński , Silvio Savarese , Yingbo Zhou , Caiming Xiong

Improving the quality of model-generated summaries, especially factuality, the accuracy of a summary with respect to its source content, remains a challenge. While reranking could select the optimal output from multiple generated…

Computation and Language · Computer Science 2026-05-29 Riza Setiawan Soetedjo , Yusuke Sakai , Hidetaka Kamigaito , Jingun Kwon , Manabu Okumura , Taro Watanabe

Uncertainty Quantification (UQ) research has primarily focused on closed-book factual question answering (QA), while contextual QA remains unexplored, despite its importance in real-world applications. In this work, we focus on UQ for the…