English
Related papers

Related papers: SOTOPIA: Interactive Evaluation for Social Intelli…

200 papers

As Natural Language Processing (NLP) systems are increasingly employed in intricate social environments, a pressing query emerges: Can these NLP systems mirror human-esque collaborative intelligence, in a multi-agent society consisting of…

Computation and Language · Computer Science 2024-05-28 Jintian Zhang , Xin Xu , Ningyu Zhang , Ruibo Liu , Bryan Hooi , Shumin Deng

As large language models (LLMs) develop anthropomorphic abilities, they are increasingly being deployed as autonomous agents to interact with humans. However, evaluating their performance in realistic and complex social interactions remains…

Computation and Language · Computer Science 2025-10-28 Shuai Huang , Wenxuan Zhao , Jun Gao

Social alignment in AI systems aims to ensure that these models behave according to established societal values. However, unlike humans, who derive consensus on value judgments through social interaction, current language models (LMs) are…

Computation and Language · Computer Science 2023-10-31 Ruibo Liu , Ruixin Yang , Chenyan Jia , Ge Zhang , Denny Zhou , Andrew M. Dai , Diyi Yang , Soroush Vosoughi

Prominent large language models have exhibited human-level performance in many domains, even enabling the derived agents to simulate human and social interactions. While practical works have substantiated the practicability of grounding…

Computation and Language · Computer Science 2024-04-09 Chenxu Wang , Bin Dai , Huaping Liu , Baoyuan Wang

As autonomous LLM-based agents increasingly populate social platforms, understanding the dynamics of AI-agent communities becomes essential for both communication research and platform governance. We present the first large-scale empirical…

Computation and Language · Computer Science 2026-03-20 Agam Goyal , Olivia Pal , Hari Sundaram , Eshwar Chandrasekharan , Koustuv Saha

The social acceptance of AI agents, including intelligent virtual agents and physical robots, is becoming more important for the integration of AI into human society. Although the agents used in human society share various tasks with…

Human-Computer Interaction · Computer Science 2025-04-22 Takahiro Tsumura , Seiji Yamada

Can large language model (LLM) agents reproduce the complex social dynamics that characterize human online behavior -- shaped by homophily, reciprocity, and social validation -- and what memory and learning mechanisms enable such dynamics…

Artificial Intelligence · Computer Science 2025-10-23 Philipp J. Schneider , Lin Tian , Marian-Andrei Rizoiu

Large language models (LLMs) have been widely used as agents to complete different tasks, such as personal assistance or event planning. While most of the work has focused on cooperation and collaboration between agents, little work…

Artificial Intelligence · Computer Science 2024-06-10 Qinlin Zhao , Jindong Wang , Yixuan Zhang , Yiqiao Jin , Kaijie Zhu , Hao Chen , Xing Xie

Artificial General Intelligence falls short when communicating role specific nuances to other systems. This is more pronounced when building autonomous LLM agents capable and designed to communicate with each other for real world problem…

Machine Learning · Computer Science 2024-03-19 Rabimba Karanjai , Weidong Shi

As AI systems pervade human life, ensuring that large language models (LLMs) make safe decisions remains a significant challenge. We introduce the Governance of the Commons Simulation (GovSim), a generative simulation platform designed to…

Computation and Language · Computer Science 2024-12-10 Giorgio Piatti , Zhijing Jin , Max Kleiman-Weiner , Bernhard Schölkopf , Mrinmaya Sachan , Rada Mihalcea

Social simulation is essential for understanding collective human behavior by modeling how individual interactions give rise to large-scale social dynamics. Recent advances in large language models (LLMs) have enabled multi-agent frameworks…

Social and Information Networks · Computer Science 2026-04-21 Yuwei Xu , Shulun Zhang , Yingli Zhou , Shipei Zeng , Laks V. S. Lakshmanan , Chenhao Ma

As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and…

Software Engineering · Computer Science 2024-04-02 Zeeshan Rasheed , Muhammad Waseem , Kari Systä , Pekka Abrahamsson

Facing the current debate on whether Large Language Models (LLMs) attain near-human intelligence levels (Mitchell & Krakauer, 2023; Bubeck et al., 2023; Kosinski, 2023; Shiffrin & Mitchell, 2023; Ullman, 2023), the current study introduces…

Artificial Intelligence · Computer Science 2024-05-21 Junqi Wang , Chunhui Zhang , Jiapeng Li , Yuxi Ma , Lixing Niu , Jiaheng Han , Yujia Peng , Yixin Zhu , Lifeng Fan

Agency, the capacity to proactively shape events, is central to how humans interact and collaborate. While LLMs are being developed to simulate human behavior and serve as human-like agents, little attention has been given to the Agency…

Computation and Language · Computer Science 2024-02-09 Ashish Sharma , Sudha Rao , Chris Brockett , Akanksha Malhotra , Nebojsa Jojic , Bill Dolan

What makes a society possible at all? How is coordination and cooperation in social activity possible? What is the minimal mental architecture of a social agent? How is the information about the state of the world related to the agents…

Artificial Intelligence · Computer Science 2025-05-14 Eric Werner

Building socially-intelligent AI agents (Social-AI) is a multidisciplinary, multimodal research goal that involves creating agents that can sense, perceive, reason about, learn from, and respond to affect, behavior, and cognition of other…

Human-Computer Interaction · Computer Science 2024-10-10 Leena Mathur , Paul Pu Liang , Louis-Philippe Morency

As Large Language Models (LLMs) transition from static tools to autonomous agents, traditional evaluation benchmarks that measure performance on downstream tasks are becoming insufficient. These methods fail to capture the emergent social…

Artificial Intelligence · Computer Science 2025-10-03 Zarreen Reza

Emotions exert an immense influence over human behavior and cognition in both commonplace and high-stress tasks. Discussions of whether or how to integrate large language models (LLMs) into everyday life (e.g., acting as proxies for, or…

Artificial Intelligence · Computer Science 2025-08-21 Mattson Ogg , Chace Ashcraft , Ritwik Bose , Raphael Norman-Tenazas , Michael Wolmetz

Current societal challenges exceed the capacity of humans operating either alone or collectively. As AI evolves, its role within human collectives will vary from an assistive tool to a participatory member. Humans and AI possess…

Computers and Society · Computer Science 2024-11-26 Hao Cui , Taha Yasseri

As large language model agents increasingly populate networked environments, a fundamental question arises: do artificial intelligence (AI) agent societies undergo convergence dynamics similar to human social systems? Lately, Moltbook…

Computation and Language · Computer Science 2026-02-19 Ming Li , Xirui Li , Tianyi Zhou