English
Related papers

Related papers: DEBATE: A Large-Scale Benchmark for Evaluating Opi…

200 papers

Large Language Models (LLMs) need to adapt their predictions to diverse cultural contexts to benefit diverse communities across the world. While previous efforts have focused on single-LLM, single-turn approaches, we propose to exploit the…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Rachel Rudinger , Tianyi Zhou , Marine Carpuat

Large language models (LLMs) often exhibit sycophancy: agreement with user stance even when it conflicts with the model's opinion. While prior work has mostly studied this in single-agent settings, it remains underexplored in collaborative…

Computation and Language · Computer Science 2026-04-06 Vira Kasprova , Amruta Parulekar , Abdulrahman AlRabah , Krishna Agaram , Ritwik Garg , Sagar Jha , Nimet Beyza Bozdag , Dilek Hakkani-Tur

Recent advancements in Large Language Models offer promising capabilities to simulate complex human social interactions. We investigate whether LLM-based multi-agent simulations can reproduce core human social dynamics observed in online…

Multiagent Systems · Computer Science 2025-07-31 Hsien-Tsung Lin , Pei-Cing Huang , Chan-Tung Ku , Chan Hsu , Pei-Xuan Shieh , Yihuang Kang

Large language model (LLM)-powered chatbots are increasingly used for opinion exploration. Prior research examined how LLMs alter user views, yet little work extended beyond one-way influence to address how user input can affect LLM…

Human-Computer Interaction · Computer Science 2025-10-24 Yuyang Jiang , Longjie Guo , Yuchen Wu , Aylin Caliskan , Tanu Mitra , Hua Shen

We introduce an agent-based model for co-evolving opinion and social dynamics, under the influence of multiplicative noise. In this model, every agent is characterized by a position in a social space and a continuous opinion state variable.…

Dynamical Systems · Mathematics 2022-10-05 Natasa Djurdjevac Conrad , Jonas Köppl , Ana Djurdjevac

Understanding how opinions evolve is crucial for addressing issues such as polarization, radicalization, and consensus in social systems. While much research has focused on identifying factors influencing opinion change, the role of…

Social and Information Networks · Computer Science 2025-02-27 Erica Cau , Valentina Pansanella , Dino Pedreschi , Giulio Rossetti

Making LLMs speak for different, especially minority groups of people, and generate statements supporting their diverse or even controversial perspectives is critical to creating an inclusive environment. However, existing LLMs lack…

Computation and Language · Computer Science 2024-06-11 Ming Li , Jiuhai Chen , Lichang Chen , Tianyi Zhou

Large Language Models are increasingly used to simulate human opinion dynamics, yet the effect of genuine interaction is often obscured by systematic biases. We develop a Bayesian framework to disentangle and quantify three such biases: (i)…

Physics and Society · Physics 2026-05-25 Vincent C. Brockers , David A. Ehrlich , Viola Priesemann

Large Language Models (LLMs) are rapidly evolving and impacting various fields, necessitating the development of effective methods to evaluate and compare their performance. Most current approaches for performance evaluation are either…

Computation and Language · Computer Science 2025-02-11 Behrad Moniri , Hamed Hassani , Edgar Dobriban

Existing dynamic Theory of Mind (ToM) benchmarks mostly place language models in a passive role: the model reads a sequence of connected scenarios and reports what people believe, feel, intend, and do as these states change. In real social…

Artificial Intelligence · Computer Science 2026-01-28 Zhichao Liang , Satoshi Nakamura

As Large Language Models (LLMs) get integrated into diverse workflows, they are increasingly being regarded as "collaborators" with humans, and required to work in coordination with other AI systems. If such AI collaborators are to reliably…

Computation and Language · Computer Science 2026-01-23 Abhijnan Nath , Carine Graff , Nikhil Krishnaswamy

Multi-agent large language model (LLM) and vision-language model (VLM) debate systems employ specialized roles for complex problem-solving, yet model specializations are not leveraged to decide which model should fill which role. We propose…

Computation and Language · Computer Science 2026-01-27 Miao Zhang , Junsik Kim , Siyuan Xiang , Jian Gao , Cheng Cao

Language models (LMs) are increasingly used as simulacra for people, yet their ability to match the distribution of views of a specific demographic group and be \textit{distributionally aligned} remains uncertain. This notion of…

Computation and Language · Computer Science 2024-11-11 Nicole Meister , Carlos Guestrin , Tatsunori Hashimoto

Large language models (LLMs) are increasingly used to simulate social behaviour, yet their political biases and interaction dynamics in debates remain underexplored. We investigate how LLM type and agent gender attributes influence…

Artificial Intelligence · Computer Science 2025-06-16 Aishwarya Bandaru , Fabian Bindley , Trevor Bluth , Nandini Chavda , Baixu Chen , Ethan Law

LLM-based agents are increasingly used to simulate deliberative interactions such as negotiation, conflict resolution, and multi-turn opinion exchange. Yet generated transcripts often do not reveal why an agent's stance changes: movement…

Artificial Intelligence · Computer Science 2026-05-18 Joshua C. Yang , Maurice Flechtner , Damian Dailisan , Michiel A. Bakker

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Computation and Language · Computer Science 2024-10-17 Yun-Shiuan Chuang , Krirk Nirunwiroj , Zach Studdiford , Agam Goyal , Vincent V. Frigo , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers

Large language models (LLMs) have advanced the development of various AI conversational agents, including role-playing conversational agents that mimic diverse characters and human behaviors. While prior research has predominantly focused…

Computation and Language · Computer Science 2024-08-06 Hongzhan Chen , Hehong Chen , Ming Yan , Wenshen Xu , Xing Gao , Weizhou Shen , Xiaojun Quan , Chenliang Li , Ji Zhang , Fei Huang , Jingren Zhou

In the context where social media emerges as a pivotal platform for social movements and shaping public opinion, accurately simulating and predicting the dynamics of user opinions is of significant importance. Such insights are vital for…

Social and Information Networks · Computer Science 2025-05-07 Junchi Yao , Hongjie Zhang , Jie Ou , Dingyi Zuo , Zheng Yang , Zhicheng Dong

Large Language Models (LLMs) have demonstrated an unprecedented ability to simulate human-like social behaviors, making them useful tools for simulating complex social systems. However, it remains unclear to what extent these simulations…

Social and Information Networks · Computer Science 2026-04-16 Erica Cau , Andrea Failla , Giulio Rossetti

Existing Theory of Mind (ToM) benchmarks diverge from real-world scenarios in three aspects: 1) they assess a limited range of mental states such as beliefs, 2) false beliefs are not comprehensively explored, and 3) the diverse personality…

Computation and Language · Computer Science 2025-01-16 Kazutoshi Shinoda , Nobukatsu Hojo , Kyosuke Nishida , Saki Mizuno , Keita Suzuki , Ryo Masumura , Hiroaki Sugiyama , Kuniko Saito