English
Related papers

Related papers: Evaluating the False Trust Engendered by LLM Expla…

200 papers

Deductive reasoning plays a pivotal role in the formulation of sound and cohesive arguments. It allows individuals to draw conclusions that logically follow, given the truth value of the information provided. Recent progress in the domain…

Computation and Language · Computer Science 2024-06-04 Philipp Mondorf , Barbara Plank

When encountering increasingly frequent performance improvements or cost reductions from a new large language model (LLM), developers of applications leveraging LLMs must decide whether to take advantage of these improvements or stay with…

Computation and Language · Computer Science 2025-02-20 Rubing Li , João Sedoc , Arun Sundararajan

Many large language models (LLMs) use reasoning to generate responses but do not reveal their full reasoning traces (a.k.a. chains of thought), instead outputting only final answers and brief reasoning summaries. To demonstrate that hiding…

Cryptography and Security · Computer Science 2026-05-14 Tingwei Zhang , John X. Morris , Vitaly Shmatikov

Large language models (LLMs) often improve their performance in downstream tasks when they generate Chain of Thought reasoning text before producing an answer. We investigate how LLMs recover from errors in Chain of Thought. Through…

Artificial Intelligence · Computer Science 2024-09-04 Evelyn Yee , Alice Li , Chenyu Tang , Yeon Ho Jung , Ramamohan Paturi , Leon Bergen

Although contemporary large language models (LMs) demonstrate impressive question-answering capabilities, their answers are typically the product of a single call to the model. This entails an unwelcome degree of opacity and compromises…

Artificial Intelligence · Computer Science 2022-08-31 Antonia Creswell , Murray Shanahan

As large language models (LLMs) become integrated into everyday and high-stakes decision-making, they inherit the ambiguity and biases of human language. While they produce fluent and coherent outputs, they rely on statistical pattern…

Artificial Intelligence · Computer Science 2026-04-17 Rikard Rosenbacke , Carl Rosenbacke , Victor Rosenbacke , Martin McKee

Machine learning systems have become popular in fields such as marketing, financing, or data mining. While they are highly accurate, complex machine learning systems pose challenges for engineers and users. Their inherent complexity makes…

Computers and Society · Computer Science 2019-07-31 Andrea Papenmeier , Gwenn Englebienne , Christin Seifert

Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to…

Artificial Intelligence · Computer Science 2025-12-05 Peter B. Walker , Hannah Davidson , Aiden Foster , Matthew Lienert , Thomas Pardue , Dale Russell

Large Language Models (LLMs) are often augmented with external contexts, such as those used in retrieval-augmented generation (RAG). However, these contexts can be inaccurate or intentionally misleading, leading to conflicts with the…

Computation and Language · Computer Science 2025-03-18 Yukun Huang , Sanxing Chen , Hongyi Cai , Bhuwan Dhingra

We investigate whether large language models (LLMs) can generate effective, user-facing explanations from a mathematically interpretable recommendation model. The model is based on constrained matrix factorization, where user types are…

Artificial Intelligence · Computer Science 2025-10-02 Maxime Manderlier , Fabian Lecron , Olivier Vu Thanh , Nicolas Gillis

Large Language Models (LLMs) can achieve strong performance on many tasks by producing step-by-step reasoning before giving a final output, often referred to as chain-of-thought reasoning (CoT). It is tempting to interpret these CoT…

Computation and Language · Computer Science 2023-12-12 Miles Turpin , Julian Michael , Ethan Perez , Samuel R. Bowman

Large language models (LLMs) have become common decision-support tools across educational and professional contexts, raising questions about how their outputs shape human critical thinking. Prior work suggests that the amount of AI…

Artificial Intelligence · Computer Science 2026-03-10 Natalie Friedman , Adelaide Nyanyo , Kevin Weatherwax , Lifei Wang , Chengchao Zhu , Zeshu Zhu , S. Joy Mountford

Instruction-tuned Large Language Models (LLMs) excel at many tasks and will even explain their reasoning, so-called self-explanations. However, convincing and wrong self-explanations can lead to unsupported confidence in LLMs, thus…

Computation and Language · Computer Science 2024-05-20 Andreas Madsen , Sarath Chandar , Siva Reddy

Understanding a program's runtime reasoning behavior, meaning how intermediate states and control flows lead to final execution results, is essential for reliable code generation, debugging, and automated reasoning. Although large language…

Software Engineering · Computer Science 2025-12-02 Mohammad Abdollahi , Khandaker Rifah Tasnia , Soumit Kanti Saha , Jinqiu Yang , Song Wang , Hadi Hemmati

As large language models (LLMs) advance to produce human-like arguments in some contexts, the number of settings applicable for human-AI collaboration broadens. Specifically, we focus on subjective decision-making, where a decision is…

Human-Computer Interaction · Computer Science 2024-04-22 Sharon Ferguson , Paula Akemi Aoyagui , Young-Ho Kim , Anastasia Kuzminykh

Large language models are increasingly integrated into decision-making in areas such as healthcare, law, finance, engineering, and government. Yet they share a critical limitation: they produce fluent outputs even when their internal…

Artificial Intelligence · Computer Science 2026-04-17 Rikard Rosenbacke , Carl Rosenbacke , Victor Rosenbacke , Martin McKee

The integration of generative AI into information access systems often presents users with synthesized answers that lack transparency. This study investigates how different types of explanations can influence user trust in responses from…

Information Retrieval · Computer Science 2026-01-22 Weronika Łajewska , Krisztian Balog

Perceived trustworthiness underpins how users navigate online information, yet it remains unclear whether large language models (LLMs),increasingly embedded in search, recommendation, and conversational systems, represent this construct in…

Artificial Intelligence · Computer Science 2026-01-19 Gerard Yeo , Svetlana Churina , Kokil Jaidka

Large language models (LLMs) are increasingly used as raters for evaluation tasks. However, their reliability is often limited for subjective tasks, when human judgments involve subtle reasoning beyond annotation labels. Thinking traces,…

Artificial Intelligence · Computer Science 2026-02-23 Xingjian Zhang , Tianhong Gao , Suliang Jin , Tianhao Wang , Teng Ye , Eytan Adar , Qiaozhu Mei

This paper explores the evolving relationship between clinician trust in LLMs, the transformation of data sources from predominantly human-generated to AI-generated content, and the subsequent impact on the precision of LLMs and clinician…

Computers and Society · Computer Science 2024-04-02 Avishek Choudhury , Zaria Chaudhry