中文
相关论文

相关论文: Support-Contra Asymmetry in LLM Explanations

200 篇论文

Large Language Models (LLMs) are so powerful that they sometimes learn correlations between labels and features that are irrelevant to the task, leading to poor generalization on out-of-distribution data. We propose explanation-based…

计算与语言 · 计算机科学 2023-06-07 Josh Magnus Ludan , Yixuan Meng , Tai Nguyen , Saurabh Shah , Qing Lyu , Marianna Apidianaki , Chris Callison-Burch

Large language models are increasingly deployed in settings where reliability matters, yet output-level uncertainty signals such as token probabilities, entropy, and self-consistency can become brittle under calibration--deployment…

计算与语言 · 计算机科学 2026-04-20 Yanli Wang , Peng Kuang , Xiaoyu Han , Kaidi Xu , Haohan Wang

Despite the effectiveness of large language models (LLMs) for code generation, they often output incorrect code. One reason is that model output probabilities are often not well-correlated with correctness, and reflect only the final output…

软件工程 · 计算机科学 2026-01-22 Francisco Ribeiro , Claudio Spiess , Prem Devanbu , Sarah Nadi

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

计算与语言 · 计算机科学 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

Linear approximations to the decision boundary of a complex model have become one of the most popular tools for interpreting predictions. In this paper, we study such linear explanations produced either post-hoc by a few recent methods or…

机器学习 · 计算机科学 2018-01-31 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

With the advent of larger and more complex deep learning models, such as in Natural Language Processing (NLP), model qualities like explainability and interpretability, albeit highly desirable, are becoming harder challenges to tackle and…

计算与语言 · 计算机科学 2024-01-30 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Large language models (LLMs) are increasingly used as epistemic partners in everyday reasoning, yet their errors remain predominantly analyzed through predictive metrics rather than through their interpretive effects on human judgment. This…

Large Language Models (LLMs) are increasingly deployed in socially sensitive settings, raising concerns about fairness and biases, particularly across intersectional demographic attributes. In this paper, we systematically evaluate…

计算与语言 · 计算机科学 2026-04-24 Chaima Boufaied , Ronnie De Souza Santos , Ann Barcomb

Large Language Models (LLMs) have been shown to exhibit various biases and stereotypes in their generated content. While extensive research has investigated biases in LLMs, prior work has predominantly focused on explicit bias, with minimal…

计算与语言 · 计算机科学 2025-06-04 Yachao Zhao , Bo Wang , Yan Wang , Dongming Zhao , Ruifang He , Yuexian Hou

Large Language Models (LLMs) are expected to be predictable and trustworthy to support reliable decision-making systems. Yet current LLMs often show inconsistencies in their judgments. In this work, we examine logical preference consistency…

计算与语言 · 计算机科学 2025-02-11 Yinhong Liu , Zhijiang Guo , Tianya Liang , Ehsan Shareghi , Ivan Vulić , Nigel Collier

Large Language Models (LLMs), originally developed for natural language processing (NLP), have demonstrated the potential to generalize across modalities and domains. With their in-context learning (ICL) capabilities, LLMs can perform…

人工智能 · 计算机科学 2025-08-26 Nikolaos Pavlidis , Vasilis Perifanis , Symeon Symeonidis , Pavlos S. Efraimidis

Large language models (LLMs) have led to breakthroughs in language tasks, yet the internal mechanisms that enable their remarkable generalization and reasoning abilities remain opaque. This lack of transparency presents challenges such as…

计算与语言 · 计算机科学 2024-04-17 Haiyan Zhao , Fan Yang , Bo Shen , Himabindu Lakkaraju , Mengnan Du

Large Language Models (LLMs) have made significant advances in natural language processing, but their underlying mechanisms are often misunderstood. Despite exhibiting coherent answers and apparent reasoning behaviors, LLMs rely on…

计算与语言 · 计算机科学 2024-08-05 Bo Zhou , Daniel Geißler , Paul Lukowicz

Large language models (LLMs) have recently been used as backbones for recommender systems. However, their performance often lags behind conventional methods in standard tasks like retrieval. We attribute this to a mismatch between LLMs'…

Large language models (LLMs) perform very well in several natural language processing tasks but raise explainability challenges. In this paper, we examine the effect of random elements in the training of LLMs on the explainability of their…

This paper presents several novel findings on the explainability of vision reflection in large multimodal models (LMMs). First, we show that prompting an LMM to verify the prediction of a specialized vision model can improve recognition…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Guoyuan An , JaeYoon Kim , SungEui Yoon

Large Language Models (LLMs) are intended to reflect human linguistic competencies. But humans have access to a broad and embodied context, which is key in detecting and resolving linguistic ambiguities, even in isolated text spans. A…

计算与语言 · 计算机科学 2025-10-22 Amber Shore , Russell Scheinberg , Ameeta Agrawal , So Young Lee

Instruction-tuned Large Language Models (LLMs) excel at many tasks and will even explain their reasoning, so-called self-explanations. However, convincing and wrong self-explanations can lead to unsupported confidence in LLMs, thus…

计算与语言 · 计算机科学 2024-05-20 Andreas Madsen , Sarath Chandar , Siva Reddy

We introduce and study artificial impressions--patterns in LLMs' internal representations of prompts that resemble human impressions and stereotypes based on language. We fit linear probes on generated prompts to predict impressions…

计算与语言 · 计算机科学 2025-10-13 Nicholas Deas , Kathleen McKeown

Large Language Models (LLMs) are increasingly used in clinical settings, where sensitivity to linguistic uncertainty can influence diagnostic interpretation and decision-making. Yet little is known about where such epistemic cues are…

计算与语言 · 计算机科学 2025-12-01 Srivarshinee Sridhar , Raghav Kaushik Ravi , Kripabandhu Ghosh