English
Related papers

Related papers: When Identity Skews Debate: Anonymization for Bias…

200 papers

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

Multi-Agent Debate (MAD) improves LLM-agent accuracy but suffers from rapid context growth, limiting scalability in larger multi-agent settings. Existing methods prune low-utility communications using prior signals, such as token-level…

Multiagent Systems · Computer Science 2026-05-25 Weifan Jiang , Rana Shahout , Minghao Li , Zhenting Qi , Yilun Du , Michael Mitzenmacher , Minlan Yu

Recent advancements in large language models (LLMs) have given rise to the LLM-as-a-judge paradigm, showcasing their potential to deliver human-like judgments. However, in the field of machine translation (MT) evaluation, current…

Computation and Language · Computer Science 2025-02-21 Zhaopeng Feng , Jiayuan Su , Jiamei Zheng , Jiahan Ren , Yan Zhang , Jian Wu , Hongwei Wang , Zuozhu Liu

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du

Large language models (LLMs) are increasingly used to simulate social behaviour, yet their political biases and interaction dynamics in debates remain underexplored. We investigate how LLM type and agent gender attributes influence…

Artificial Intelligence · Computer Science 2025-06-16 Aishwarya Bandaru , Fabian Bindley , Trevor Bluth , Nandini Chavda , Baixu Chen , Ethan Law

Multi-agent AI systems can be used for simulating collective decision-making in scientific and practical applications. They can also be used to introduce a diverse group discussion step in chatbot pipelines, enhancing the cultural…

Artificial Intelligence · Computer Science 2024-08-16 Razan Baltaji , Babak Hemmatian , Lav R. Varshney

Collaborative reasoning with multiple agents offers the potential for more robust and diverse problem-solving. However, existing approaches often suffer from homogeneous agent behaviors and lack of reflective and rethinking capabilities. We…

Artificial Intelligence · Computer Science 2025-11-13 Jian Zhang , Zhiyuan Wang , Zhangqi Wang , Fangzhi Xu , Qika Lin , Lingling Zhang , Rui Mao , Erik Cambria , Jun Liu

Large language models (LLMs) exhibit systematic Western-centric bias, yet whether prompting in non-Western languages (e.g., Chinese) can mitigate this remains understudied. Answering this question requires rigorous evaluation and effective…

Machine Learning · Computer Science 2026-01-21 Qian Tan , Lei Jiang , Yuting Zeng , Shuoyang Ding , Xiaohua Xu

Recent studies on LLM agent scaling have highlighted the potential of Multi-Agent Debate (MAD) to enhance reasoning abilities. However, the critical aspect of role allocation strategies remains underexplored. In this study, we demonstrate…

Artificial Intelligence · Computer Science 2025-11-17 Qian Zhang , Yan Zheng , Jinyi Liu , Hebin Liang , Lanjun Wang

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

While state-of-the-art language models have achieved impressive results, they remain susceptible to inference-time adversarial attacks, such as adversarial prompts generated by red teams arXiv:2209.07858. One approach proposed to improve…

Computation and Language · Computer Science 2024-01-12 Steffi Chern , Zhen Fan , Andy Liu

Multi-agent debate (MAD) systems leverage collective intelligence to enhance reasoning capabilities, yet existing approaches struggle to simultaneously optimize accuracy, consensus formation, and computational efficiency. Static topology…

Artificial Intelligence · Computer Science 2026-03-02 Chao Wang , Han Lin , Huaze Tang , Huijing Lin , Wenbo Ding

The TRUST democratic discourse analysis pipeline exposes its large language model (LLM) components to peer model identity through multiple structural channels -- a design feature whose bias implications have not previously been empirically…

Computers and Society · Computer Science 2026-04-28 Juergen Dietrich

Modern large language models (LLMs) like ChatGPT have shown remarkable performance on general language tasks but still struggle on complex reasoning tasks, which drives the research on cognitive behaviors of LLMs to explore human-like…

Computation and Language · Computer Science 2024-10-10 Tian Liang , Zhiwei He , Wenxiang Jiao , Xing Wang , Yan Wang , Rui Wang , Yujiu Yang , Shuming Shi , Zhaopeng Tu

Large language models (LLMs) excel in natural language generation but often confidently produce incorrect responses, especially in tasks like mathematical reasoning. Chain-of-thought prompting, self-verification, and multi-agent debate are…

Computation and Language · Computer Science 2026-03-30 Mahmood Hegazy

Multi-agent debate has proven effective in improving large language models quality for reasoning and factuality tasks. While various role-playing strategies in multi-agent debates have been explored, in terms of the communication among…

Computation and Language · Computer Science 2024-06-18 Yunxuan Li , Yibing Du , Jiageng Zhang , Le Hou , Peter Grabowski , Yeqing Li , Eugene Ie

Self-improvement, where models improve beyond their current performance without external supervision, remains a challenge. The core difficulty is sourcing a training signal stronger than what the model itself can currently produce. Majority…

Artificial Intelligence · Computer Science 2026-02-02 Ankur Samanta , Akshayaa Magesh , Runzhe Wu , Ayush Jain , Youliang Yu , Daniel Jiang , Boris Vidolov , Paul Sajda , Yonathan Efroni , Kaveh Hassani

As multi-agent AI systems become more common, users increasingly encounter not a single AI voice but a collective one. This shift introduces social dynamics, such as consensus, dissent, and gradual convergence, that can trigger cognitive…

Human-Computer Interaction · Computer Science 2026-04-27 Soohwan Lee , Kyungho Lee

Bias in large language models (LLMs) remains a persistent challenge, manifesting in stereotyping and unfair treatment across social groups. While prior research has primarily focused on individual models, the rise of multi-agent systems…

Multiagent Systems · Computer Science 2025-10-14 Thi-Nhung Nguyen , Linhao Luo , Thuy-Trang Vu , Dinh Phung

Multi-agent debate, where teams of LLMs iteratively exchange rationales and vote on answers, is widely deployed under the assumption that peer review filters hallucinations. Yet the failure dynamics of homogeneous debate remain poorly…

Multiagent Systems · Computer Science 2026-05-05 Blaž Bertalanič , Carolina Fortuna