English
Related papers

Related papers: SOTOPIA: Interactive Evaluation for Social Intelli…

200 papers

Humans learn social skills through both imitation and social interaction. This social learning process is largely understudied by existing research on building language agents. Motivated by this gap, we propose an interactive learning…

Computation and Language · Computer Science 2024-04-29 Ruiyi Wang , Haofei Yu , Wenxin Zhang , Zhengyang Qi , Maarten Sap , Graham Neubig , Yonatan Bisk , Hao Zhu

Humans engage in lifelong social interactions through interacting with different people under different scenarios for different social goals. This requires social intelligence to gather information through a long time span and use it to…

Artificial Intelligence · Computer Science 2025-06-17 Hitesh Goel , Hao Zhu

Social simulation through large language model (LLM) agents is a promising approach to explore and validate hypotheses related to social science questions and LLM agents behavior. We present SOTOPIA-S4, a fast, flexible, and scalable social…

As LLM-based agents are increasingly interacting in multi-party settings, they need to properly handle information asymmetry, i.e., knowing when and to whom to disclose information is appropriate. Yet, existing benchmarks fail to measure…

Multiagent Systems · Computer Science 2026-05-05 Yashwanth YS , Ruichen Wang , Shihua Zeng , Xuhui Zhou , Koichi Onoue , Vasudha Varadarajan , Maarten Sap

Despite the abundance of prior social strategies possessed by humans, there remains a paucity of research dedicated to their transfer and integration into social agents. Our proposed SOTOPIA-$\Omega$ framework aims to address and bridge…

Computation and Language · Computer Science 2025-05-30 Wenyuan Zhang , Tianyun Liu , Mengxiao Song , Xiaodong Li , Tingwen Liu

The development of AI agents based on large, open-domain language models (LLMs) has paved the way for the development of general-purpose AI assistants that can support human in tasks such as writing, coding, graphic design, and scientific…

Artificial Intelligence · Computer Science 2025-06-03 Mustafa Mert Çelikok , Saptarashmi Bandyopadhyay , Robert Loftin

We present a probabilistic intent modeling framework for large language model (LLM) agents in multi-turn social dialogue. The framework maintains a belief distribution over a partner's latent intentions, initialized from contextual priors…

Artificial Intelligence · Computer Science 2025-10-22 Feifan Xia , Yuyang Fang , Defang Li , Yantong Xie , Weikang Li , Yang Li , Deguo Xia , Jizhou Huang

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…

Social simulation provides a compelling testbed for studying social intelligence, where agents interact through multi-turn dialogues under evolving contexts and strategically adapting opponents. Such environments are inherently…

Artificial Intelligence · Computer Science 2026-05-20 Xiang Li , Liping Yi , Mingze Kong , Min Zhang , Zhongxiang Dai , QingHua Hu

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli

This paper presents an evaluation framework for agentic AI systems in mission-critical negotiation contexts, addressing the need for AI agents that can adapt to diverse human operators and stakeholders. Using Sotopia as a simulation…

Artificial Intelligence · Computer Science 2025-08-22 Myke C. Cohen , Zhe Su , Hsien-Te Kao , Daniel Nguyen , Spencer Lynch , Maarten Sap , Svitlana Volkova

Large Language Model (LLM) agents have demonstrated impressive capabilities for social interaction and are increasingly being deployed in situations where they might engage with both human and artificial agents. These interactions represent…

Artificial Intelligence · Computer Science 2025-12-04 Chandler Smith , Marwa Abdulhai , Manfred Diaz , Marko Tesic , Rakshit S. Trivedi , Alexander Sasha Vezhnevets , Lewis Hammond , Jesse Clifton , Minsuk Chang , Edgar A. Duéñez-Guzmán , John P. Agapiou , Jayd Matyas , Danny Karmon , Akash Kundu , Aliaksei Korshuk , Ananya Ananya , Arrasy Rahman , Avinaash Anand Kulandaivel , Bain McHale , Beining Zhang , Buyantuev Alexander , Carlos Saith Rodriguez Rojas , Caroline Wang , Chetan Talele , Chenao Liu , Chichen Lin , Diana Riazi , Di Yang Shi , Emanuel Tewolde , Elizaveta Tennant , Fangwei Zhong , Fuyang Cui , Gang Zhao , Gema Parreño Piqueras , Hyeonggeun Yun , Ilya Makarov , Jiaxun Cui , Jebish Purbey , Jim Dilkes , Jord Nguyen , Lingyun Xiao , Luis Felipe Giraldo , Manuela Chacon-Chamorro , Manuel Sebastian Rios Beltran , Marta Emili García Segura , Mengmeng Wang , Mogtaba Alim , Nicanor Quijano , Nico Schiavone , Olivia Macmillan-Scott , Oswaldo Peña , Peter Stone , Ram Mohan Rao Kadiyala , Rolando Fernandez , Ruben Manrique , Sunjia Lu , Sheila A. McIlraith , Shamika Dhuri , Shuqing Shi , Siddhant Gupta , Sneheel Sarangi , Sriram Ganapathi Subramanian , Taehun Cha , Toryn Q. Klassen , Wenming Tu , Weijian Fan , Wu Ruiyang , Xue Feng , Yali Du , Yang Liu , Yiding Wang , Yipeng Kang , Yoonchang Sung , Yuxuan Chen , Zhaowei Zhang , Zhihan Wang , Zhiqiang Wu , Ziang Chen , Zilong Zheng , Zixia Jia , Ziyan Wang , Dylan Hadfield-Menell , Natasha Jaques , Tim Baarslag , Jose Hernandez-Orallo , Joel Z. Leibo

Building embodied autonomous agents capable of participating in social interactions with humans is one of the main challenges in AI. This problem motivated many research directions on embodied language use. Current approaches focus on…

Machine Learning · Computer Science 2021-04-28 Grgur Kovač , Rémy Portelas , Katja Hofmann , Pierre-Yves Oudeyer

Large language models (LLMs) are increasingly leveraged to empower autonomous agents to simulate human beings in various fields of behavioral research. However, evaluating their capacity to navigate complex social interactions remains a…

Computation and Language · Computer Science 2024-11-26 Xinyi Mou , Jingcong Liang , Jiayu Lin , Xinnong Zhang , Xiawei Liu , Shiyue Yang , Rong Ye , Lei Chen , Haoyu Kuang , Xuanjing Huang , Zhongyu Wei

Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that…

Computation and Language · Computer Science 2026-04-14 EunJeong Hwang , Yuwei Yin , Giuseppe Carenini , Peter West , Vered Shwartz

There is an growing interest in using Large Language Models (LLMs) in multi-agent systems to tackle interactive real-world tasks that require effective collaboration and assessing complex situations. Yet, we still have a limited…

Computation and Language · Computer Science 2024-06-11 Sahar Abdelnabi , Amr Gomaa , Sarath Sivaprasad , Lea Schönherr , Mario Fritz

As large language model (LLM) agents become more prevalent in real world social settings, social intelligence will play an increasingly critical role. But social intelligence is still a poorly defined construct, for humans and artificial…

Computers and Society · Computer Science 2026-04-13 David Shoresh , Sarit Kraus , Yonatan Loewenstein

As Large Language Models (LLMs) evolve into interactive agents, understanding their behavioral alignment within human social dynamics becomes essential. While behavioral game theory offers a framework to study these interactions, previous…

Multiagent Systems · Computer Science 2026-05-26 Inseo Jung , Yoonseok Oh , Kyungryul Back , Jinkyu Kim , Jungbeom Lee

Large Language Models (LLMs) have increasingly been utilized in social simulations, where they are often guided by carefully crafted instructions to stably exhibit human-like behaviors during simulations. Nevertheless, we doubt the…

Artificial Intelligence · Computer Science 2024-10-29 Zengqing Wu , Run Peng , Shuyuan Zheng , Qianying Liu , Xu Han , Brian Inhyuk Kwon , Makoto Onizuka , Shaojie Tang , Chuan Xiao

Social network simulation plays a crucial role in addressing various challenges within social science. It offers extensive applications such as state prediction, phenomena explanation, and policy-making support, among others. In this work,…

Social and Information Networks · Computer Science 2025-06-05 Chen Gao , Xiaochong Lan , Zhihong Lu , Jinzhu Mao , Jinghua Piao , Huandong Wang , Depeng Jin , Yong Li
‹ Prev 1 2 3 10 Next ›