中文
相关论文

相关论文: Large Language Models Cannot Explain Themselves

200 篇论文

Large language models (LLMs) are proficient at generating fluent text with minimal task-specific supervision. Yet, their ability to provide well-grounded rationalizations for knowledge-intensive tasks remains under-explored. Such tasks,…

计算与语言 · 计算机科学 2024-02-02 Aditi Mishra , Sajjadur Rahman , Hannah Kim , Kushan Mitra , Estevam Hruschka

Large Language Models (LLMs) have made significant advances in natural language processing, but their underlying mechanisms are often misunderstood. Despite exhibiting coherent answers and apparent reasoning behaviors, LLMs rely on…

计算与语言 · 计算机科学 2024-08-05 Bo Zhou , Daniel Geißler , Paul Lukowicz

The widespread public deployment of large language models (LLMs) in recent months has prompted a wave of new attention and engagement from advocates, policymakers, and scholars from many fields. This attention is a timely response to the…

计算与语言 · 计算机科学 2023-04-04 Samuel R. Bowman

While large language models (LLMs) have demonstrated strong capability in structured prediction tasks such as semantic parsing, few amounts of research have explored the underlying mechanisms of their success. Our work studies different…

计算与语言 · 计算机科学 2023-02-01 Daking Rai , Yilun Zhou , Bailin Wang , Ziyu Yao

Our research demonstrates the significant benefits of using fine-tuning with explanations to enhance the performance of language models. Unlike prompting, which maintains the model's parameters, fine-tuning allows the model to learn and…

计算与语言 · 计算机科学 2024-02-13 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kuehnberger

Artificial intelligence and machine learning algorithms have become ubiquitous. Although they offer a wide range of benefits, their adoption in decision-critical fields is limited by their lack of interpretability, particularly with textual…

机器学习 · 计算机科学 2023-01-27 Diego Antognini

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

机器学习 · 计算机科学 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

Instruction-tuned Large Language Models (LLMs) excel at many tasks and will even explain their reasoning, so-called self-explanations. However, convincing and wrong self-explanations can lead to unsupported confidence in LLMs, thus…

计算与语言 · 计算机科学 2024-05-20 Andreas Madsen , Sarath Chandar , Siva Reddy

Large language models have recently demonstrated remarkable abilities to self-correct their responses through iterative refinement, often referred to as self-consistency or self-reflection. However, the dynamics of this self-correction…

计算与语言 · 计算机科学 2025-11-13 Hossein A. Rahmani , Satyapriya Krishna , Xi Wang , Mohammadmehdi Naghiaei , Emine Yilmaz

Are Large language models (LLMs) temporally grounded? Since LLMs cannot perceive and interact with the environment, it is impossible to answer this question directly. Instead, we provide LLMs with textual narratives and probe them with…

计算与语言 · 计算机科学 2023-11-17 Yifu Qiu , Zheng Zhao , Yftah Ziser , Anna Korhonen , Edoardo M. Ponti , Shay B. Cohen

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

机器人学 · 计算机科学 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes

Most large language models (LLMs) are sensitive to prompts, and another synonymous expression or a typo may lead to unexpected results for the model. Composing an optimal prompt for a specific demand lacks theoretical support and relies…

计算与语言 · 计算机科学 2024-06-18 Zhenyu Zhang , Bingguang Hao , Jinpeng Li , Zekai Zhang , Dongyan Zhao

Large language models (LLMs) trained purely on text ostensibly lack any direct perceptual experience, yet their internal representations are implicitly shaped by multimodal regularities encoded in language. We test the hypothesis that…

计算与语言 · 计算机科学 2025-10-06 Sophie L. Wang , Phillip Isola , Brian Cheung

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

计算与语言 · 计算机科学 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Large language models must balance their weight-encoded knowledge with in-context information from prompts to generate accurate responses. This paper investigates this interplay by analyzing how models of varying capacities within the same…

计算与语言 · 计算机科学 2024-12-17 Mohammad Reza Samsami , Mats Leon Richter , Juan Rodriguez , Megh Thakkar , Sarath Chandar , Maxime Gasse

Large Language Models offer new opportunities to devise automated implementation generation methods that can tackle problem solving activities beyond traditional methods, which require algorithmic specifications and can use only static…

计算与语言 · 计算机科学 2025-01-06 Hashmath Shaik , Alex Doboli

In response to the demand for Explainable Artificial Intelligence (XAI), we investigate the use of Large Language Models (LLMs) to transform ML explanations into natural, human-readable narratives. Rather than directly explaining ML models…

人工智能 · 计算机科学 2024-05-13 Alexandra Zytek , Sara Pidò , Kalyan Veeramachaneni

Large language models are powerful systems that excel at many tasks, ranging from translation to mathematical reasoning. Yet, at the same time, these models often show unhuman-like characteristics. In the present paper, we address this gap…

计算与语言 · 计算机科学 2023-06-08 Marcel Binz , Eric Schulz

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

机器学习 · 计算机科学 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Large language models excel on static benchmarks, but their ability as self-learning agents in dynamic environments remains unclear. We evaluate three prompting strategies: self-reflection, heuristic mutation, and planning across dynamic…

人工智能 · 计算机科学 2025-08-12 Annie Wong , Thomas Bäck , Aske Plaat , Niki van Stein , Anna V. Kononova