中文
相关论文

相关论文: Capturing Failures of Large Language Models via Hu…

200 篇论文

Large Language Models (LLMs) are increasingly used in decision-making, yet their susceptibility to cognitive biases remains a pressing challenge. This study explores how personality traits influence these biases and evaluates the…

人工智能 · 计算机科学 2025-02-21 Jiangen He , Jiqun Liu

Humans can learn languages from remarkably little experience. Developing computational models that explain this ability has been a major challenge in cognitive science. Bayesian models that build in strong inductive biases - factors that…

计算与语言 · 计算机科学 2023-05-25 R. Thomas McCoy , Thomas L. Griffiths

Large language models (LLMs) demonstrate the capacity to reconstruct and trace learned content from their training data under specific elicitation conditions, yet this capability does not manifest in standard generation contexts. This…

计算与语言 · 计算机科学 2026-03-20 Toshiyuki Shigemura

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

计算与语言 · 计算机科学 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

While NLP models often seek to capture cognitive states via language, the validity of predicted states is determined by comparing them to annotations created without access the cognitive states of the authors. In behavioral sciences,…

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

人工智能 · 计算机科学 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

Chain-of-thought (CoT) prompting for language models demonstrates impressive performance across reasoning tasks, but typically needs labeled exemplars of the reasoning process. In this work, we introduce a new prompting approach, analogical…

机器学习 · 计算机科学 2024-03-12 Michihiro Yasunaga , Xinyun Chen , Yujia Li , Panupong Pasupat , Jure Leskovec , Percy Liang , Ed H. Chi , Denny Zhou

While a vast collection of explainable AI (XAI) algorithms have been developed in recent years, they are often criticized for significant gaps with how humans produce and consume explanations. As a result, current XAI techniques are often…

人工智能 · 计算机科学 2023-08-08 Vivian Lai , Yiming Zhang , Chacha Chen , Q. Vera Liao , Chenhao Tan

While language models are increasingly more proficient at code generation, they still frequently generate incorrect programs. Many of these programs are obviously wrong, but others are more subtle and pass weaker correctness checks such as…

软件工程 · 计算机科学 2024-03-01 Alex Gu , Wen-Ding Li , Naman Jain , Theo X. Olausson , Celine Lee , Koushik Sen , Armando Solar-Lezama

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Open-domain generative systems have gained significant attention in the field of conversational AI (e.g., generative search engines). This paper presents a comprehensive review of the attribution mechanisms employed by these systems,…

计算与语言 · 计算机科学 2023-12-15 Dongfang Li , Zetian Sun , Xinshuo Hu , Zhenyu Liu , Ziyang Chen , Baotian Hu , Aiguo Wu , Min Zhang

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

计算机与社会 · 计算机科学 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev

This paper examines the role of cognitive biases in the decision-making processes of large language models (LLMs), challenging the conventional goal of eliminating all biases. When properly balanced, we show that certain cognitive biases…

计算与语言 · 计算机科学 2025-04-15 Hanyang Zhong , Liman Wang , Wenting Cao , Zeyuan Sun

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human,…

计算与语言 · 计算机科学 2025-05-29 Tom Kouwenhoven , Max Peeperkorn , Roy de Kleijn , Tessa Verhoef

As AI systems like language models are increasingly integrated into decision-making processes affecting people's lives, it's critical to ensure that these systems have sound moral reasoning. To test whether they do, we need to develop…

计算与语言 · 计算机科学 2024-04-18 Jan-Philipp Fränken , Kanishk Gandhi , Tori Qiu , Ayesha Khawaja , Noah D. Goodman , Tobias Gerstenberg

In computational cognitive modeling, capturing the full spectrum of human judgment and decision-making processes, beyond just optimal behaviors, is a significant challenge. This study explores whether Large Language Models (LLMs) can…

人工智能 · 计算机科学 2025-02-24 Animesh Nighojkar , Bekhzodbek Moydinboyev , My Duong , John Licato

Large language models (LLMs) have been shown to acquire sequence-level planning abilities during training, yet their planning behavior exhibited at inference time often appears short-sighted and inconsistent with these capabilities. We…

人工智能 · 计算机科学 2026-02-04 Haijiang Yan , Jian-Qiao Zhu , Adam Sanborn

Large language models optimized for instruction following and agentic tasks remain poorly aligned with the requirements of high-quality creative writing. Fiction frequently depends on behaviors that assistant-tuned models are explicitly…

人工智能 · 计算机科学 2026-05-19 Jan Zierstek , Matteo Batelic , Maya Medjad , Tim Schönenberger

Automated testing tools typically create test cases that are different from what human testers create. This often makes the tools less effective, the created tests harder to understand, and thus results in tools providing less support to…

软件工程 · 计算机科学 2021-03-09 Eduard Enoiu , Robert Feldt

Large language models (LLMs) are increasingly used in group decision-making, but their influence risks fostering conformity and reducing epistemic vigilance. Drawing on the Argumentative Theory of Reasoning, we argue that confirmation bias,…

人机交互 · 计算机科学 2025-10-02 Sander de Jong , Rune Møberg Jacobsen , Niels van Berkel