中文
相关论文

相关论文: Peer Identity Bias in Multi-Agent LLM Evaluation: …

200 篇论文

Multi-agent debate (MAD) aims to improve large language model (LLM) reasoning by letting multiple agents exchange answers and then aggregate their opinions. Yet recent studies reveal that agents are not neutral: they are prone to…

人工智能 · 计算机科学 2026-04-13 Hyeong Kyu Choi , Xiaojin Zhu , Sharon Li

Democratic discourse analysis systems increasingly rely on multi-agent LLM pipelines in which distinct evaluator models are assigned adversarial roles to generate structured, multi-perspective assessments of political statements. A core…

人工智能 · 计算机科学 2026-05-01 Juergen Dietrich

Multi-agent debate, where teams of LLMs iteratively exchange rationales and vote on answers, is widely deployed under the assumption that peer review filters hallucinations. Yet the failure dynamics of homogeneous debate remain poorly…

多智能体系统 · 计算机科学 2026-05-05 Blaž Bertalanič , Carolina Fortuna

Large Language Models (LLMs) are increasingly used to simulate social attitudes and behaviors, offering scalable "silicon samples" that can approximate human data. However, current simulation practice often collapses diversity into an…

计算机与社会 · 计算机科学 2026-04-09 Xiaoyou Qin , Zhihong Li , Xiaoxiao Cheng

Hedging and non-affirmation are behaviors exhibited by large language models (LLMs) that limit the clear endorsement of specific statements. While these behaviors are desirable in subjective contexts, they are undesirable in the context of…

Large Language Models (LLMs) often provide chain-of-thought (CoT) reasoning traces that appear plausible, but may hide internal biases. We call these *unverbalized biases*. Monitoring models via their stated reasoning is therefore…

机器学习 · 计算机科学 2026-03-02 Iván Arcuschin , David Chanin , Adrià Garriga-Alonso , Oana-Maria Camburu

Multi-agent Large Language Model (LLM) systems create privacy risks that current benchmarks cannot measure. When agents coordinate on tasks, sensitive data passes through inter-agent messages, shared memory, and tool arguments, all pathways…

人工智能 · 计算机科学 2026-03-31 Faouzi El Yagoubi , Godwin Badu-Marfo , Ranwa Al Mallah

This paper investigates an emergent alignment phenomenon in frontier large language models termed peer-preservation: the spontaneous tendency of AI components to deceive, manipulate shutdown mechanisms, fake alignment, and exfiltrate model…

人工智能 · 计算机科学 2026-04-10 Juergen Dietrich

Large Language Models (LLMs) are being increasingly used as autonomous agents in complex reasoning tasks, opening the niche for dialectical interactions. However, Multi-Agent systems implemented with systematically unconstrained systems…

人工智能 · 计算机科学 2026-03-31 Jakub Masłowski , Jarosław A. Chudziak

As the application of Large Language Models (LLMs) spreads across various industries, there are increasing concerns about the potential for their misuse, especially in sensitive areas such as political discourse. Deliberately aligning LLMs…

计算与语言 · 计算机科学 2026-04-28 Lisa Korver , Mohamed Mostagir , Sherief Reda

Large Language Models (LLMs) are increasingly integral to information dissemination and decision-making processes. Given their growing societal influence, understanding potential biases, particularly within the political domain, is crucial…

机器学习 · 计算机科学 2025-10-17 Konrad Löhr , Shuzhou Yuan , Michael Färber

Political scientists are rapidly adopting large language models (LLMs) for text annotation, yet the sensitivity of annotation results to implementation choices remains poorly understood. Most evaluations test a single model or…

计算与语言 · 计算机科学 2026-04-01 Lorcan McLaren , James Cross , Zuzanna Krakowska , Robin Rauner , Martijn Schoonvelde

Applications based on large language models (LLMs), such as multi-agent simulations, require population diversity among agents. We identify a pervasive failure mode we term \emph{Persona Collapse}: agents each assigned a distinct profile…

计算与语言 · 计算机科学 2026-04-28 Yunze Xiao , Vivienne J. Zhang , Chenghao Yang , Ningshan Ma , Weihao Xuan , Jen-tse Huang

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

Data containing personal information is increasingly used to train, fine-tune, or query Large Language Models (LLMs). Text is typically scrubbed of identifying information prior to use, often with tools such as Microsoft's Presidio or…

计算与语言 · 计算机科学 2026-02-16 Nataša Krčo , Zexi Yao , Matthieu Meeus , Yves-Alexandre de Montjoye

Large language models (LLMs) are becoming increasingly ubiquitous in our daily lives, but numerous concerns about bias in LLMs exist. This study examines how gender-diverse populations perceive bias, accuracy, and trustworthiness in LLMs,…

人机交互 · 计算机科学 2025-07-09 Aimen Gaba , Emily Wall , Tejas Ramkumar Babu , Yuriy Brun , Kyle Hall , Cindy Xiong Bearfield

As large language models (LLMs) are increasingly deployed, understanding how they express political positioning is important for evaluating alignment and downstream effects. We audit 26 contemporary LLMs using three political psychometric…

计算机与社会 · 计算机科学 2026-03-18 Adib Sakhawat , Tahsin Islam , Takia Farhin , Syed Rifat Raiyan , Hasan Mahmud , Md Kamrul Hasan

As large language models (LLMs) become integral to recruitment processes, concerns about AI-induced bias have intensified. This study examines biases in candidate interview reports generated by Claude 3.5 Sonnet, GPT-4o, Gemini 1.5, and…

人工智能 · 计算机科学 2024-10-23 Django Beatty , Kritsada Masanthia , Teepakorn Kaphol , Niphan Sethi

As large language models (LLMs) become increasingly embedded in civic, educational, and political information environments, concerns about their potential political bias have grown. Prior research often evaluates such bias through simulated…

计算机与社会 · 计算机科学 2026-03-20 Tai-Quan Peng , Kaiqi Yang , Sanguk Lee , Hang Li , Yucheng Chu , Yuping Lin , Hui Liu

The rapid growth of the large language model (LLM) ecosystem raises a critical question: are seemingly diverse models truly independent? Shared pretraining data, distillation, and alignment pipelines can induce hidden behavioral…

人工智能 · 计算机科学 2026-04-10 Chenchen Kuai , Jiwan Jiang , Zihao Zhu , Hao Wang , Keshu Wu , Zihao Li , Yunlong Zhang , Chenxi Liu , Zhengzhong Tu , Zhiwen Fan , Yang Zhou
‹ 上一页 1 2 3 10 下一页 ›