English
Related papers

Related papers: Uncertainty Aware Learning for Language Model Alig…

200 papers

Reliable uncertainty quantification in deep neural networks is very crucial in safety-critical applications such as automated driving for trustworthy and informed decision-making. Assessing the quality of uncertainty estimates is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Neslihan Kose , Ranganath Krishnan , Akash Dhamasia , Omesh Tickoo , Michael Paulitsch

Linking textual values in tabular data to their corresponding entities in a Knowledge Base is a core task across a variety of data integration and enrichment applications. Although Large Language Models (LLMs) have shown State-of-The-Art…

Computation and Language · Computer Science 2025-10-03 Carlo Bono , Federico Belotti , Matteo Palmonari

LLMs increasingly excel on AI benchmarks, but doing so does not guarantee validity for downstream tasks. This study contrasts LLM alignment on benchmarks, downstream tasks, and, importantly the intended impact of those tasks. We evaluate…

Machine Learning · Computer Science 2026-04-21 Michael Hardy , Yunsung Kim

Active learning (AL) in open set scenarios presents a novel challenge of identifying the most valuable examples in an unlabeled data pool that comprises data from both known and unknown classes. Traditional methods prioritize selecting…

Machine Learning · Computer Science 2024-11-14 Chen-Chen Zong , Ye-Wen Wang , Kun-Peng Ning , Hai-Bo Ye , Sheng-Jun Huang

Recent progress in large language models (LLMs) has focused on producing responses that meet human expectations and align with shared values - a process coined alignment. However, aligning LLMs remains challenging due to the inherent…

Future self-adaptive robots are expected to operate in highly dynamic environments while effectively managing uncertainties. However, identifying the sources and impacts of uncertainties in such robotic systems and defining appropriate…

Robotics · Computer Science 2025-10-13 Hassan Sartaj , Jalil Boudjadar , Mirgita Frasheri , Shaukat Ali , Peter Gorm Larsen

As large language models (LLMs) are increasingly used for factual question-answering, it becomes more important for LLMs to have the capability to communicate the likelihood that their answer is correct. For these verbalized expressions of…

Computation and Language · Computer Science 2025-12-15 Sophia Hager , David Mueller , Kevin Duh , Nicholas Andrews

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

Large Language Models (LLMs) have shown remarkable performance across a wide range of downstream tasks. However, it is challenging for users to discern whether the responses of LLM are generated with certainty or are fabricated to meet user…

Artificial Intelligence · Computer Science 2025-01-14 Hsiu-Yuan Huang , Zichen Wu , Yutong Yang , Junzhao Zhang , Yunfang Wu

Understanding how large language models (LLMs) internally represent and process their predictions is central to detecting uncertainty and preventing hallucinations. While several studies have shown that models encode uncertainty in their…

Computation and Language · Computer Science 2025-07-10 Sunwoo Kim , Haneul Yoo , Alice Oh

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

Computation and Language · Computer Science 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

Comprehensive evaluation of Large Language Models (LLMs) is an open research problem. Existing evaluations rely on deterministic point estimates generated via greedy decoding. However, we find that deterministic evaluations fail to capture…

Machine Learning · Computer Science 2025-03-04 Yan Scholten , Stephan Günnemann , Leo Schwinn

Models trained on different datasets can be merged by a weighted-averaging of their parameters, but why does it work and when can it fail? Here, we connect the inaccuracy of weighted-averaging to mismatches in the gradients and propose a…

Machine Learning · Computer Science 2024-08-26 Nico Daheim , Thomas Möllenhoff , Edoardo Maria Ponti , Iryna Gurevych , Mohammad Emtiyaz Khan

Machine unlearning has the potential to improve the safety of large language models (LLMs) by removing sensitive or harmful information post hoc. A key challenge in unlearning involves balancing between forget quality (effectively…

Machine Learning · Computer Science 2025-06-23 Shengyuan Hu , Neil Kale , Pratiksha Thaker , Yiwei Fu , Steven Wu , Virginia Smith

As large language models (LLMs) are trained on massive datasets, they have raised significant privacy and ethical concerns due to their potential to inadvertently retain sensitive information. Unlearning seeks to selectively remove specific…

Computation and Language · Computer Science 2025-06-17 Philipp Spohn , Leander Girrbach , Jessica Bader , Zeynep Akata

Large language model (LLM) agents are increasingly deployed in structured biomedical data environments, yet they often produce fluent but overconfident outputs when reasoning over complex multi-table data. We introduce an uncertainty-aware…

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

Unlearning methods have the potential to improve the privacy and safety of large language models (LLMs) by removing sensitive or harmful information post hoc. The LLM unlearning research community has increasingly turned toward empirical…

Computation and Language · Computer Science 2025-04-09 Pratiksha Thaker , Shengyuan Hu , Neil Kale , Yash Maurya , Zhiwei Steven Wu , Virginia Smith

As many fine-tuned pre-trained language models~(PLMs) with promising performance are generously released, investigating better ways to reuse these models is vital as it can greatly reduce the retraining computational cost and the potential…

Computation and Language · Computer Science 2021-12-15 Lei Li , Yankai Lin , Xuancheng Ren , Guangxiang Zhao , Peng Li , Jie Zhou , Xu Sun

Large language models (LLMs) have delivered significant breakthroughs across diverse domains but can still produce unreliable or misleading outputs, posing critical challenges for real-world applications. While many recent studies focus on…

Computation and Language · Computer Science 2025-09-08 Yang Nan , Pengfei He , Ravi Tandon , Han Xu