中文
相关论文

相关论文: Knowing What You Cannot Explain: Learning to Rejec…

200 篇论文

As Large Language Models (LLMs) become increasingly integrated into high-stakes domains, there have been several approaches proposed toward generating natural language explanations. These explanations are crucial for enhancing the…

计算与语言 · 计算机科学 2025-11-13 Krithi Shailya , Shreya Rajpal , Gokul S Krishnan , Balaraman Ravindran

In many high-risk machine learning applications it is essential for a model to indicate when it is uncertain about a prediction. While large language models (LLMs) can reach and even surpass human-level accuracy on a variety of benchmarks,…

计算与语言 · 计算机科学 2024-06-06 Evan Becker , Stefano Soatto

The application of machine learning based decision making systems in safety critical areas requires reliable high certainty predictions. Reject options are a common way of ensuring a sufficiently high certainty of predictions made by the…

人工智能 · 计算机科学 2022-05-17 André Artelt , Roel Visser , Barbara Hammer

Assessing the quality of outputs generated by generative models, such as large language models and vision language models, presents notable challenges. Traditional methods for evaluation typically rely on either human assessments, which are…

计算与语言 · 计算机科学 2024-10-10 Yaswanth Narsupalli , Abhranil Chandra , Sreevatsa Muppirala , Manish Gupta , Pawan Goyal

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguish input-level ambiguity (data uncertainty) from capability…

计算与语言 · 计算机科学 2026-04-21 Jingyi Ren , Ante Wang , Yunghwei Lai , Xiaolong Wang , Linlu Gong , Weitao Li , Weizhi Ma , Yang Liu

Large language models (LLMs) rarely admit uncertainty, often producing fluent but misleading answers, rather than abstaining (i.e., refusing to answer). This weakness is even evident in temporal question answering, where models frequently…

计算与语言 · 计算机科学 2026-03-05 Xinyu Zhou , Chang Jin , Carsten Eickhoff , Zhijiang Guo , Seyed Ali Bahrainian

As large language models (LLMs) become widely deployed, concerns about their safety and alignment grow. An approach to steer LLM behavior, such as mitigating biases or defending against jailbreaks, is to identify which parts of a prompt…

计算与语言 · 计算机科学 2025-05-20 Kenza Amara , Rita Sevastjanova , Mennatallah El-Assady

Many high-performing machine learning models are not interpretable. As they are increasingly used in decision scenarios that can critically affect individuals, it is necessary to develop tools to better understand their outputs. Popular…

人工智能 · 计算机科学 2023-05-30 Laura State , Salvatore Ruggieri , Franco Turini

For Large Language Models (LLMs) to be reliably deployed in both everyday and high-stakes domains, knowing when not to answer is equally critical as answering correctly. Real-world user queries, which can be underspecified, ill-posed, or…

人工智能 · 计算机科学 2025-06-11 Polina Kirichenko , Mark Ibrahim , Kamalika Chaudhuri , Samuel J. Bell

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

信息检索 · 计算机科学 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

Reinforcement learning has become the standard for improving reasoning in large language models, yet evidence increasingly suggests that RL does not teach new strategies; it redistributes probability mass over solutions the base model…

计算与语言 · 计算机科学 2026-05-12 Ömer Faruk Akgül , Rajgopal Kannan , Willie Neiswanger , Viktor Prasanna

The use of machine learning (ML) models in decision-making contexts, particularly those used in high-stakes decision-making, are fraught with issue and peril since a person - not a machine - must ultimately be held accountable for the…

机器学习 · 计算机科学 2022-06-06 Michael T. Lash

In order to be deployed safely, Large Language Models (LLMs) must be capable of dynamically adapting their behavior based on their level of knowledge and uncertainty associated with specific topics. This adaptive behavior, which we refer to…

计算与语言 · 计算机科学 2024-07-04 Alexandre Piché , Aristides Milios , Dzmitry Bahdanau , Chris Pal

Recommender systems help users navigate information overload by providing personalized recommendations aligned with their preferences. Collaborative Filtering (CF) is a widely adopted approach, but while advanced techniques like graph…

信息检索 · 计算机科学 2024-09-24 Qiyao Ma , Xubin Ren , Chao Huang

Recommendation Systems have become integral to modern user experiences, but lack transparency in their decision-making processes. Existing explainable recommendation methods are hindered by reliance on a post-hoc paradigm, wherein…

信息检索 · 计算机科学 2024-12-04 Xiaohan Yu , Li Zhang , Chong Chen

This paper presents ReasoningRec, a reasoning-based recommendation framework that leverages Large Language Models (LLMs) to bridge the gap between recommendations and human-interpretable explanations. In contrast to conventional…

信息检索 · 计算机科学 2024-10-31 Millennium Bismay , Xiangjue Dong , James Caverlee

Abstention Ability (AA) is a critical aspect of Large Language Model (LLM) reliability, referring to an LLM's capability to withhold responses when uncertain or lacking a definitive answer, without compromising performance. Although…

计算与语言 · 计算机科学 2024-09-25 Nishanth Madhusudhan , Sathwik Tejaswi Madhusudhan , Vikas Yadav , Masoud Hashemi

Local explanations of learning-to-rank (LTR) models are thought to extract the most important features that contribute to the ranking predicted by the LTR model for a single data point. Evaluating the accuracy of such explanations is…

机器学习 · 统计学 2022-03-17 Amir Hossein Akhavan Rahnama , Judith Butepage

In clinical decision-making, predictive models face a persistent trade-off: accurate models are often opaque "black boxes," while interpretable methods frequently lack predictive precision or statistical grounding. In this paper, we…

人工智能 · 计算机科学 2026-02-10 Zijian Shao , Haiyang Shen , Mugeng Liu , Gecheng Fu , Yaoqi Guo , Yanfeng Wang , Yun Ma

As larger deep learning models are hard to interpret, there has been a recent focus on generating explanations of these black-box models. In contrast, we may have apriori explanations of how models should behave. In this paper, we formalize…

机器学习 · 计算机科学 2023-12-27 Rattana Pukdee , Dylan Sam , J. Zico Kolter , Maria-Florina Balcan , Pradeep Ravikumar