English
Related papers

Related papers: Unmasking Conversational Bias in AI Multiagent Sys…

200 papers

Large Language Models (LLMs) often provide chain-of-thought (CoT) reasoning traces that appear plausible, but may hide internal biases. We call these *unverbalized biases*. Monitoring models via their stated reasoning is therefore…

Machine Learning · Computer Science 2026-03-02 Iván Arcuschin , David Chanin , Adrià Garriga-Alonso , Oana-Maria Camburu

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Speech monologues recorded in naturalistic settings provide opportunities to characterize mental illness phenomenology and detect symptom exacerbation. Large language models (LLMs) offer new possibilities for automating this process, as…

The advent of Large Language Models (LLMs) has significantly transformed the fields of natural and social sciences. Generative Agent-Based Models (GABMs), which utilize large language models in place of real subjects, are gaining increasing…

Physics and Society · Physics 2024-08-20 Yikang Lu , Alberto Aleta , Chunpeng Du , Lei Shi , Yamir Moreno

Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and generating human-like text, yet they largely operate as reactive agents, responding only when directly prompted. This passivity creates an…

Computation and Language · Computer Science 2026-05-18 Deep Anil Patel , Iain Melvin , Christopher Malon , Martin Renqiang Min

Large language models (LLMs) have demonstrated remarkable capabilities in simulating human behaviour and social intelligence. However, they risk perpetuating societal biases, especially when demographic information is involved. We introduce…

Computers and Society · Computer Science 2025-06-11 Bryan Chen Zhengyu Tan , Roy Ka-Wei Lee

Large Language Models (LLMs) have shown remarkable promise in communicating with humans. Their potential use as artificial partners with humans in sociological experiments involving conversation is an exciting prospect. But how viable is…

Artificial Intelligence · Computer Science 2025-02-04 James Flamino , Mohammed Shahid Modi , Boleslaw K. Szymanski , Brendan Cross , Colton Mikolajczyk

The conformity bias exhibited by large language models (LLMs) can pose a significant challenge to decision-making in LLM-based multi-agent systems (LLM-MAS). While many prior studies have treated "conformity" simply as a matter of opinion…

Artificial Intelligence · Computer Science 2026-04-22 Mikako Bito , Keita Nishimoto , Kimitaka Asatani , Ichiro Sakata

We examine whether large language models (LLMs) can predict biased decision-making in conversational settings, and whether their predictions capture not only human cognitive biases but also how those effects change under cognitive load. In…

Human-Computer Interaction · Computer Science 2026-02-06 Stephen Pilli , Vivek Nallur

The development of AI agents based on large, open-domain language models (LLMs) has paved the way for the development of general-purpose AI assistants that can support human in tasks such as writing, coding, graphic design, and scientific…

Artificial Intelligence · Computer Science 2025-06-03 Mustafa Mert Çelikok , Saptarashmi Bandyopadhyay , Robert Loftin

Biases and errors in human-labeled data present significant challenges for machine learning, especially in supervised learning reliant on potentially flawed ground truth data. These flaws, including diagnostic errors and societal biases,…

Artificial Intelligence · Computer Science 2024-10-25 Edward Y. Chang

Contemporary research in social sciences increasingly utilizes state-of-the-art generative language models to annotate or generate content. While these models achieve benchmark-leading performance on common language tasks, their application…

Computation and Language · Computer Science 2025-07-15 Simon Münker

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

Computation and Language · Computer Science 2025-06-17 Yan Sun , Stanley Kok

As multi-agent AI systems become more common, users increasingly encounter not a single AI voice but a collective one. This shift introduces social dynamics, such as consensus, dissent, and gradual convergence, that can trigger cognitive…

Human-Computer Interaction · Computer Science 2026-04-27 Soohwan Lee , Kyungho Lee

Large Language Models (LLMs) often exhibit gender bias, resulting in unequal treatment of male and female subjects across different contexts. To address this issue, we propose a novel data generation framework that fosters exploratory…

Computation and Language · Computer Science 2026-01-15 Kangda Wei , Hasnat Md Abdullah , Ruihong Huang

Large Language Models (LLMs) are widely used for text generation, making it crucial to address potential bias. This study investigates ideological framing bias in LLM-generated articles, focusing on the subtle and subjective nature of such…

Computation and Language · Computer Science 2026-01-13 Molly Kennedy , Ayyoob Imani , Timo Spinde , Akiko Aizawa , Hinrich Schütze

Multi-agent systems driven by large language models (LLMs) have shown promising abilities for solving complex tasks in a collaborative manner. This work considers a fundamental problem in multi-agent collaboration: consensus seeking. When…

Computation and Language · Computer Science 2025-01-22 Huaben Chen , Wenkang Ji , Lufeng Xu , Shiyu Zhao

Large Language Models (LLMs) are transforming artificial intelligence, evolving into task-oriented systems capable of autonomous planning and execution. One of the primary applications of LLMs is conversational AI systems, which must…

Computation and Language · Computer Science 2025-01-22 Elad Levi , Ilan Kadar

Multi-agent debate has been shown to improve reasoning in large language models (LLMs). However, it is compute-intensive, requiring generation of long transcripts before answering questions. To address this inefficiency, we develop a…

Artificial Intelligence · Computer Science 2026-04-29 John Seon Keun Yi , Aaron Mueller , Dokyun Lee

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is…

Computation and Language · Computer Science 2026-04-29 Shu Yang , Shenzhe Zhu , Hao Zhu , José Ramón Enríquez , Di Wang , Alex Pentland , Michiel A. Bakker , Jiaxin Pei