中文
相关论文

相关论文: Evaluating the False Trust Engendered by LLM Expla…

200 篇论文

Large language models (LLMs) achieve strong performance and have revolutionized NLP, but their lack of explainability keeps them treated as black boxes, limiting their use in domains that demand transparency and trust. A promising direction…

计算与语言 · 计算机科学 2026-04-17 Bar Alon , Itamar Zimerman , Lior Wolf

Most adversarial threats in artificial intelligence (AI) target the computational behavior of models rather than the humans who rely on them. Yet modern AI systems increasingly operate within human decision loops, where users interpret and…

人工智能 · 计算机科学 2026-05-18 Shutong Fan , Lan Zhang , Xiaoyong Yuan

Large language models (LLMs) are capable of generating plausible explanations of how they arrived at an answer to a question. However, these explanations can misrepresent the model's "reasoning" process, i.e., they can be unfaithful. This,…

计算与语言 · 计算机科学 2025-05-21 Katie Matton , Robert Osazuwa Ness , John Guttag , Emre Kıcıman

Large Language Models (LLMs) can produce verbalized self-explanations, yet prior studies suggest that such rationales may not reliably reflect the model's true decision process. We ask whether these explanations nevertheless help users…

计算与语言 · 计算机科学 2026-01-08 Pingjun Hong , Benjamin Roth

Large Language Models (LLMs) are extensively used today across various sectors, including academia, research, business, and finance, for tasks such as text generation, summarization, and translation. Despite their widespread adoption, these…

计算与语言 · 计算机科学 2024-04-26 Yash Saxena , Sarthak Chopra , Arunendra Mani Tripathi

Large language models (LLMs) have shown considerable potential in supporting medical diagnosis. However, their effective integration into clinical workflows is hindered by physicians' difficulties in perceiving and trusting LLM…

人机交互 · 计算机科学 2026-01-28 Yuansong Xu , Yichao Zhu , Haokai Wang , Yuchen Wu , Yang Ouyang , Hanlu Li , Wenzhe Zhou , Xinyu Liu , Chang Jiang , Quan Li

As AI becomes fundamental in sectors like healthcare, explainable AI (XAI) tools are essential for trust and transparency. However, traditional user studies used to evaluate these tools are often costly, time consuming, and difficult to…

This paper investigates the reliability of explanations generated by large language models (LLMs) when prompted to explain their previous output. We evaluate two kinds of such self-explanations - extractive and counterfactual - using three…

计算与语言 · 计算机科学 2025-02-03 Korbinian Randl , John Pavlopoulos , Aron Henriksson , Tony Lindgren

Large Language Models (LLMs) are increasingly used to generate and edit scientific abstracts, yet their integration into academic writing raises questions about trust, quality, and disclosure. Despite growing adoption, little is known about…

计算机与社会 · 计算机科学 2026-01-23 Nil-Jana Akpinar , Sandeep Avula , CJ Lee , Brandon Dang , Kaza Razat , Vanessa Murdock

For AI systems to garner widespread public acceptance, we must develop methods capable of explaining the decisions of black-box models such as neural networks. In this work, we identify two issues of current explanatory methods. First, we…

计算与语言 · 计算机科学 2019-12-06 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

Large language models (LLMs) have delivered significant breakthroughs across diverse domains but can still produce unreliable or misleading outputs, posing critical challenges for real-world applications. While many recent studies focus on…

计算与语言 · 计算机科学 2025-09-08 Yang Nan , Pengfei He , Ravi Tandon , Han Xu

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

In human society, trust is an essential component of social attitude that helps build and maintain long-term, healthy relationships which creates a strong foundation for cooperation, enabling individuals to work together effectively and…

人机交互 · 计算机科学 2025-07-30 Anushka Debnath , Stephen Cranefield , Emiliano Lorini , Bastin Tony Roy Savarimuthu

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and…

机器学习 · 计算机科学 2026-02-02 Marthe Ballon , Brecht Verbeken , Vincent Ginis , Andres Algaba

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

软件工程 · 计算机科学 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Large Language Models (LLMs) often exhibit sycophancy, distorting responses to align with user beliefs, notably by readily agreeing with user counterarguments. Paradoxically, LLMs are increasingly adopted as successful evaluative agents for…

计算与语言 · 计算机科学 2025-09-23 Sungwon Kim , Daniel Khashabi

The perceived quality of the explanations accompanying e-government services is key to gaining trust in these institutions, consequently amplifying further usage of these services. Recent advances in generative AI, and concretely in Large…

计算机与社会 · 计算机科学 2025-05-01 Lior Limonad , Fabiana Fournier , Hadar Mulian , George Manias , Spiros Borotis , Danai Kyrkou

Advanced Artificial Intelligence (AI) systems, specifically large language models (LLMs), have the capability to generate not just misinformation, but also deceptive explanations that can justify and propagate false information and erode…

人工智能 · 计算机科学 2024-08-02 Valdemar Danry , Pat Pataranutaporn , Matthew Groh , Ziv Epstein , Pattie Maes

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

计算与语言 · 计算机科学 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Large Language Models (LLMs) are deployed as powerful tools for several natural language processing (NLP) applications. Recent works show that modern LLMs can generate self-explanations (SEs), which elicit their intermediate reasoning steps…

计算与语言 · 计算机科学 2024-03-15 Chirag Agarwal , Sree Harsha Tanneru , Himabindu Lakkaraju