中文
相关论文

相关论文: Aligning LLM Uncertainty with Human Disagreement i…

200 篇论文

Large language models have been widely applied to sequential recommendation tasks, yet during inference, they continue to rely on decoding strategies developed for natural language processing. This creates a mismatch between text-generation…

信息检索 · 计算机科学 2025-09-01 Chenke Yin , Li Fan , Jia Wang , Dongxiao Hu , Haichao Zhang , Chong Zhang , Yang Xiang

RL alignment methods, including RLHF and DPO, are primarily based on pairwise preference data. Although scalar or score-based feedback has been collected in some settings, it is rarely used directly, and preference magnitude information is…

While Large Language Models (LLMs) demonstrate impressive capabilities, they still struggle with generating factually incorrect content (i.e., hallucinations). A promising approach to mitigate this issue is enabling models to express…

计算与语言 · 计算机科学 2025-06-05 Ruihan Yang , Caiqi Zhang , Zhisong Zhang , Xinting Huang , Sen Yang , Nigel Collier , Dong Yu , Deqing Yang

Trust is a crucial factor affecting the adoption of machine learning (ML) models. Qualitative studies have revealed that end-users, particularly in the medical domain, need models that can express their uncertainty in decision-making…

机器学习 · 计算机科学 2023-04-21 Andrew Houston , Georgina Cosma

There are two major types of uncertainty one can model. Aleatoric uncertainty captures noise inherent in the observations. On the other hand, epistemic uncertainty accounts for uncertainty in the model -- uncertainty which can be explained…

计算机视觉与模式识别 · 计算机科学 2017-10-06 Alex Kendall , Yarin Gal

For aligning large language models (LLMs), prior work has leveraged reinforcement learning via human feedback (RLHF) or variations of direct preference optimization (DPO). While DPO offers a simpler framework based on maximum likelihood…

人工智能 · 计算机科学 2025-05-27 Anirudhan Badrinath , Prabhat Agarwal , Jiajing Xu

Clustering-based unsupervised domain adaptive (UDA) person re-identification (ReID) reduces exhaustive annotations. However, owing to unsatisfactory feature embedding and imperfect clustering, pseudo labels for target domain data inherently…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Jian Han , Ya-Li li , Shengjin Wang

Despite the widespread application of Large Language Models (LLMs) across various domains, they frequently exhibit overconfidence when encountering uncertain scenarios, yet existing solutions primarily rely on evasive responses (e.g., "I…

人工智能 · 计算机科学 2025-06-03 Jingyu Liu , Jingquan Peng , xiaopeng Wu , Xubin Li , Tiezheng Ge , Bo Zheng , Yong Liu

Many machine learning tasks involve inherent subjectivity, where annotators naturally provide varied labels. Standard practice collapses these label distributions into single labels, aggregating diverse human judgments into point estimates.…

机器学习 · 计算机科学 2025-11-19 Agamdeep Singh , Ashish Tiwari , Hosein Hasanbeig , Priyanshu Gupta

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

计算与语言 · 计算机科学 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

The emerging large language model role-playing agents (LLM RPAs) aim to simulate individual human behaviors, but the persona fidelity is often undermined by manually-created profiles (e.g., cherry-picked information and personality…

计算与语言 · 计算机科学 2025-10-30 Bingsheng Yao , Bo Sun , Yuanzhe Dong , Yuxuan Lu , Dakuo Wang

While explainability is a desirable characteristic of increasingly complex black-box models, modern explanation methods have been shown to be inconsistent and contradictory. The semantics of explanations is not always fully understood - to…

人工智能 · 计算机科学 2024-08-09 Omer Reingold , Judy Hanwen Shen , Aditi Talati

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

机器学习 · 计算机科学 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

There is growing recognition that many NLP tasks lack a single ground truth, as human judgments reflect diverse perspectives. To capture this variation, models have been developed to predict full annotation distributions rather than…

计算与语言 · 计算机科学 2026-02-27 Frances Yung , Daniil Ignatev , Merel Scholman , Vera Demberg , Massimo Poesio

In automatic emotion recognition (AER), labels assigned by different human annotators to the same utterance are often inconsistent due to the inherent complexity of emotion and the subjectivity of perception. Though deterministic labels…

声音 · 计算机科学 2024-04-02 Wen Wu , Chao Zhang , Philip C. Woodland

Conformal prediction is a model-agnostic approach to generating prediction sets that cover the true class with a high probability. Although its prediction set size is expected to capture aleatoric uncertainty, there is a lack of evidence…

机器学习 · 计算机科学 2025-11-24 Misgina Tsighe Hagos , Claes Lundström

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

计算与语言 · 计算机科学 2026-01-21 Md Talha Mohsin

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

机器学习 · 计算机科学 2025-10-29 Xiaofan Zhou , Lu Cheng

In recent years, large language models (LLMs) have achieved breakthrough progress in many dialogue generation tasks. However, their lack of emotion and fine-grained role awareness limits the model's ability to provide personalized and…

计算与语言 · 计算机科学 2025-03-26 Ke Ji , Yixin Lian , Linxu Li , Jingsheng Gao , Weiyuan Li , Bin Dai

Pairwise comparisons from multiple judges are central to large language model evaluation and preference modeling, yet standard ranking pipelines often pool judgments into a single score vector, treating systematic judge disagreement as…

统计方法学 · 统计学 2026-05-08 Shibo Yu , Yingzhou Wang , Yan Chen , Guodong Li , Jin-Hong Du