English
Related papers

Related papers: Peer Identity Bias in Multi-Agent LLM Evaluation: …

200 papers

Large language models (LLMs) often exhibit sycophancy: agreement with user stance even when it conflicts with the model's opinion. While prior work has mostly studied this in single-agent settings, it remains underexplored in collaborative…

Computation and Language · Computer Science 2026-04-06 Vira Kasprova , Amruta Parulekar , Abdulrahman AlRabah , Krishna Agaram , Ritwik Garg , Sagar Jha , Nimet Beyza Bozdag , Dilek Hakkani-Tur

Synthetic personae experiments have become a prominent method in Large Language Model alignment research, yet the representativeness and ecological validity of these personae vary considerably between studies. Through a review of 63…

Computers and Society · Computer Science 2025-12-02 Jan Batzner , Volker Stocker , Bingjun Tang , Anusha Natarajan , Qinhao Chen , Stefan Schmid , Gjergji Kasneci

In an age characterized by the proliferation of mis- and disinformation online, it is critical to empower readers to understand the content they are reading. Important efforts in this direction rely on manual or automatic fact-checking,…

Computation and Language · Computer Science 2025-06-17 Zain Muhammad Mujahid , Dilshod Azizov , Maha Tufail Agro , Preslav Nakov

We study multidimensional opinion dynamics under confirmation bias in social networks. Each agent holds a vector of correlated opinions across multiple topic layers. Peer interaction is modeled through a static, informationally symmetric…

Systems and Control · Electrical Eng. & Systems 2026-03-24 M. Hossein Abedinzadeh , Emrah Akyol

As large language models (LLMs) become increasingly integrated into daily applications, it is essential to ensure they operate fairly across diverse user demographics. In this work, we show that LLMs suffer from personalization bias, where…

Computation and Language · Computer Science 2025-02-12 Anvesh Rao Vijjini , Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

While personalized recommendations are often desired by users, it can be difficult in practice to distinguish cases of bias from cases of personalization: we find that models generate racially stereotypical recommendations regardless of…

Computation and Language · Computer Science 2025-06-03 Anjali Kantharuban , Jeremiah Milbauer , Maarten Sap , Emma Strubell , Graham Neubig

Recent advancements in large language models (LLMs) have extended their capabilities from basic text processing to complex reasoning tasks, including legal interpretation, argumentation, and strategic interaction. However, empirical…

Artificial Intelligence · Computer Science 2025-08-08 Asutosh Hota , Jussi P. P. Jokinen

The analysis of political biases in large language models (LLMs) has primarily examined these systems as single entities with fixed viewpoints. While various methods exist for measuring such biases, the impact of persona-based prompting on…

Computation and Language · Computer Science 2025-02-27 Pietro Bernardelle , Leon Fröhling , Stefano Civelli , Riccardo Lunardi , Kevin Roitero , Gianluca Demartini

Large Language Models (LLMs) excel in diverse tasks such as text generation, data analysis, and software development, making them indispensable across domains like education, business, and creative industries. However, the rapid…

Cryptography and Security · Computer Science 2024-11-19 Kun Li , Shichao Zhuang , Yue Zhang , Minghui Xu , Ruoxi Wang , Kaidi Xu , Xinwen Fu , Xiuzhen Cheng

TRUST Agents is a collaborative multi-agent framework for explainable fact verification and fake news detection. Rather than treating verification as a simple true-or-false classification task, the system identifies verifiable claims,…

Artificial Intelligence · Computer Science 2026-04-15 Gautama Shastry Bulusu Venkata , Santhosh Kakarla , Maheedhar Omtri Mohan , Aishwarya Gaddam

Large Language Models (LLMs) display remarkable capabilities to understand or even produce political discourse but have been found to consistently exhibit a progressive left-leaning bias. At the same time, so-called persona or identity…

Computation and Language · Computer Science 2026-02-20 Maximilian Kreutner , Marlene Lutz , Markus Strohmaier

Conversations transform individual knowledge into collective insight, enabling collaborators to solve problems more accurately than they could alone. Whether dialogues among large language models (LLMs) can replicate the synergistic gains…

Human-Computer Interaction · Computer Science 2025-10-10 Tom Sheffer , Alon Miron , Asael Sklar , Yaniv Dover , Ariel Goldstein

The increasing sophistication of large language models (LLMs) has sparked growing concerns regarding their potential role in exacerbating ideological polarization through the automated generation of persuasive and biased content. This study…

Computation and Language · Computer Science 2025-06-18 . Pazzaglia , V. Vendetti , L. D. Comencini , F. Deriu , V. Modugno

The peer review process is often regarded as the gatekeeper of scientific integrity, yet increasing evidence suggests that it is not immune to bias. Although structural inequities in peer review have been widely debated, much less attention…

Computation and Language · Computer Science 2025-07-22 Maria Sahakyan , Bedoor AlShebli

Multilingual studies of social bias in open-ended LLM generation remain limited: most existing benchmarks are English-centric, template-based, or restricted to recognizing pre-specified stereotypes. We introduce StereoTales, a multilingual…

Computers and Society · Computer Science 2026-05-13 Pierre Le Jeune , Étienne Duchesne , Weixuan Xiao , Stefano Palminteri , Bazire Houssin , Benoît Malézieux , Matteo Dora

Standard safety alignment optimizes Large Language Models (LLMs) for universal helpfulness and honesty, effectively instilling a rigid "Boy Scout" morality. While robust for general-purpose assistants, this one-size-fits-all ethical…

Artificial Intelligence · Computer Science 2026-01-12 Cooper Lin , Maohao Ran , Yanting Zhang , Zhenglin Wan , Hongwei Fan , Yibo Xu , Yike Guo , Wei Xue , Jun Song

Multi-agent LLM pipelines produce contradictory evidence on whether team diversity improves output quality: heterogeneous Mixture-of-Agents teams outperform single models, yet homogeneous Self-MoA teams consistently win under…

Multiagent Systems · Computer Science 2026-03-24 Artem Maryanskyy

Online health resources and large language models (LLMs) are increasingly used as a first point of contact for medical decision-making, yet their reliability in healthcare remains limited by low accuracy, lack of transparency, and…

Artificial Intelligence · Computer Science 2026-04-22 Yujia Liu , Sophia Yu , Hongyue Jin , Jessica Wen , Alexander Qian , Terrence Lee , Mattheus Ramsis , Gi Won Choi , Lianhui Qin , Xin Liu , Edward J. Wang

We present a scalable, modular pipeline for automatic neologism detection that combines rule-based filtering with LLM classification. The pipeline is grounded in two complementary word-formation frameworks, grammatical and extra-grammatical…

Computation and Language · Computer Science 2026-05-08 Diego Rossini , Lonneke van der Plas

Large Reasoning Models (LRMs) and Multi-Agent Systems (MAS) in high-stakes domains demand reliable verification, yet centralized approaches suffer four limitations: (1) Robustness, with single points of failure vulnerable to attacks and…

Artificial Intelligence · Computer Science 2026-05-01 Yu-Chao Huang , Zhen Tan , Mohan Zhang , Pingzhi Li , Zhuo Zhang , Tianlong Chen