English
Related papers

Related papers: PersonaArena: Dynamic Simulation for Evaluating an…

200 papers

Large Language Model (LLM) agents are increasingly deployed in settings where they interact with a wide variety of people, including users who are unclear, impatient, or reluctant to share information. However, collecting real interaction…

Artificial Intelligence · Computer Science 2026-05-14 Harshita Chopra , Kshitish Ghate , Aylin Caliskan , Tadayoshi Kohno , Chirag Shah , Natasha Jaques

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli

Social intelligence is built upon three foundational pillars: cognitive intelligence, situational intelligence, and behavioral intelligence. As large language models (LLMs) become increasingly integrated into our social lives,…

Computation and Language · Computer Science 2025-02-25 Guiyang Hou , Wenqi Zhang , Yongliang Shen , Zeqi Tan , Sihao Shen , Weiming Lu

In recent years, with the rapid advancement of large language models (LLMs), role-playing language agents (RPLAs) have emerged as a prominent research focus at the intersection of natural language processing (NLP) and human-computer…

Computation and Language · Computer Science 2026-01-16 Ye Wang , Jiaxing Chen , Hongjiang Xiao

Large language models (LLMs) have advanced the development of various AI conversational agents, including role-playing conversational agents that mimic diverse characters and human behaviors. While prior research has predominantly focused…

Computation and Language · Computer Science 2024-08-06 Hongzhan Chen , Hehong Chen , Ming Yan , Wenshen Xu , Xing Gao , Weizhou Shen , Xiaojun Quan , Chenliang Li , Ji Zhang , Fei Huang , Jingren Zhou

Negotiation is the basis of social interactions; humans negotiate everything from the price of cars to how to share common resources. With rapidly growing interest in using large language models (LLMs) to act as agents on behalf of human…

Artificial Intelligence · Computer Science 2024-02-14 Federico Bianchi , Patrick John Chia , Mert Yuksekgonul , Jacopo Tagliabue , Dan Jurafsky , James Zou

Role-playing agents (RPA) have been a popular application area for large language models (LLMs), attracting significant interest from both industry and academia.While existing RPAs well portray the characters' knowledge and tones, they face…

Computation and Language · Computer Science 2024-10-16 Yiting Ran , Xintao Wang , Rui Xu , Xinfeng Yuan , Jiaqing Liang , Deqing Yang , Yanghua Xiao

The concept of persona, originally adopted in dialogue literature, has re-surged as a promising framework for tailoring large language models (LLMs) to specific context (e.g., personalized search, LLM-as-a-judge). However, the growing…

Computation and Language · Computer Science 2024-10-08 Yu-Min Tseng , Yu-Chao Huang , Teng-Yun Hsiao , Wei-Lin Chen , Chao-Wei Huang , Yu Meng , Yun-Nung Chen

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

Large language models (LLMs) have evolved into interactive agents that collaborate with users in real-world tasks. Effective collaboration in such settings increasingly depends on understanding the user beyond what is explicitly stated, as…

Artificial Intelligence · Computer Science 2026-05-27 Yuxin Chen , Yi Zhang , Zhengzhou Cai , Yaorui Shi , Zhiyuan Yao , Chenhang Cui , Jingnan Zheng , Yaqi Huo , Xi Su , Qi Gu , Xunliang Cai , Xiang Wang , An Zhang , Tat-Seng Chua

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

Computation and Language · Computer Science 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

Large language models (LLMs), due to their advanced natural language capabilities, have seen significant success in applications where the user interface is usually a conversational artificial intelligence (AI) agent and engages the user…

Computation and Language · Computer Science 2025-03-10 Fei Wei , Yaliang Li , Bolin Ding

Large Language Models (LLMs) have made progress in various real-world tasks, which stimulates requirements for the evaluation of LLMs. Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and…

Computation and Language · Computer Science 2023-09-11 Jiatong Li , Rui Li , Qi Liu

Personalized Large Language Models (LLMs) have been shown to be an effective way to create more engaging and enjoyable user-AI interactions. While previous studies have explored using prompts to elicit specific personality traits in LLMs,…

Computation and Language · Computer Science 2025-11-26 Shi-Wei Dai , Yan-Wei Shie , Tsung-Huan Yang , Lun-Wei Ku , Yung-Hui Li

The recent explosion of large language models (LLMs), each with its own general or specialized strengths, makes scalable, reliable benchmarking more urgent than ever. Standard practices nowadays face fundamental trade-offs: closed-ended…

To improve stock trend predictions and support personalized investment decisions, this paper proposes FinArena, a novel Human-Agent collaboration framework. Inspired by the mixture of experts (MoE) approach, FinArena combines multimodal…

Computational Engineering, Finance, and Science · Computer Science 2025-03-05 Congluo Xu , Zhaobin Liu , Ziyang Li

Customer Relationship Management (CRM) systems are vital for modern enterprises, providing a foundation for managing customer interactions and data. Integrating AI agents into CRM systems can automate routine processes and enhance…

Computation and Language · Computer Science 2025-02-18 Kung-Hsiang Huang , Akshara Prabhakar , Sidharth Dhawan , Yixin Mao , Huan Wang , Silvio Savarese , Caiming Xiong , Philippe Laban , Chien-Sheng Wu

This study presents RoleCraft-GLM, an innovative framework aimed at enhancing personalized role-playing with Large Language Models (LLMs). RoleCraft-GLM addresses the key issue of lacking personalized interactions in conversational AI, and…

Computation and Language · Computer Science 2024-04-05 Meiling Tao , Xuechen Liang , Tianyu Shi , Lei Yu , Yiting Xie

Large Language Models (LLMs) have emerged as personalized assistants for users across a wide range of tasks -- from offering writing support to delivering tailored recommendations or consultations. Over time, the interaction history between…

Computation and Language · Computer Science 2025-10-28 Bowen Jiang , Zhuoqun Hao , Young-Min Cho , Bryan Li , Yuan Yuan , Sihao Chen , Lyle Ungar , Camillo J. Taylor , Dan Roth

The low-intrusion and automated personality assessment is receiving increasing attention in psychology and human-computer interaction fields. This study explores an interactive approach for personality assessment, focusing on the…

Human-Computer Interaction · Computer Science 2026-04-07 Baiqiao Zhang , Xiangxian Li , Chao Zhou , Xinyu Gai , Juan Liu , Xue Yang , Nianlong Li , Shuai Ma , Xiaojuan Ma , Yong-jin Liu , Yulong Bian