English
Related papers

Related papers: PICon: A Multi-Turn Interrogation Framework for Ev…

200 papers

Large Language Models (LLMs) are increasingly used to simulate human users in interactive settings such as therapy, education, and social role-play. While these simulations enable scalable training and evaluation of AI agents, off-the-shelf…

Computation and Language · Computer Science 2025-11-04 Marwa Abdulhai , Ryan Cheng , Donovan Clay , Tim Althoff , Sergey Levine , Natasha Jaques

We explore the task of improving persona consistency of dialogue agents. Recent models tackling consistency often train with additional Natural Language Inference (NLI) labels or attach trained extra modules to the generative agent for…

Computation and Language · Computer Science 2020-10-07 Hyunwoo Kim , Byeongchang Kim , Gunhee Kim

Personalized Large Language Models (LLMs) are increasingly used in diverse applications, where they are assigned a specific persona - such as a happy high school teacher - to guide their responses. While prior research has examined how well…

Computation and Language · Computer Science 2025-09-10 Manon Reusens , Bart Baesens , David Jurgens

Large Language Models (LLMs) acting as artificial agents offer the potential for scalable behavioral research, yet their validity depends on whether LLMs can maintain stable personas across extended conversations. We address this point…

Human-Computer Interaction · Computer Science 2026-05-21 Jana Gonnermann-Müller , Jennifer Haase , Nicolas Leins , Thomas Kosch , Sebastian Pokutta

Persona agents, which are LLM agents conditioned to act according to an assigned persona, enable contextually rich and user aligned interactions across domains like education and healthcare. However, evaluating how faithfully these agents…

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli

The impressive capabilities of Large Language Models (LLMs) raise the possibility that synthetic agents can serve as substitutes for real participants in human-subject research. To evaluate this claim, prior research has largely focused on…

Artificial Intelligence · Computer Science 2026-05-11 James Mooney , Josef Woldense , Zheng Robert Jia , Shirley Anugrah Hayati , My Ha Nguyen , Vipul Raheja , Dongyeop Kang

Applications based on large language models (LLMs), such as multi-agent simulations, require population diversity among agents. We identify a pervasive failure mode we term \emph{Persona Collapse}: agents each assigned a distinct profile…

Computation and Language · Computer Science 2026-04-28 Yunze Xiao , Vivienne J. Zhang , Chenghao Yang , Ningshan Ma , Weihao Xuan , Jen-tse Huang

Large language models require consistent behavioral patterns for safe deployment, yet there are indications of large variability that may lead to an instable expression of personality traits in these models. We present PERSIST (PERsonality…

Large Language Models (LLMs) should answer factual questions truthfully, grounded in objective knowledge, regardless of user context such as self-disclosed personal information, or system personalization. In this paper, we present the first…

Computation and Language · Computer Science 2025-10-16 Nil-Jana Akpinar , Chia-Jung Lee , Vanessa Murdock , Pietro Perona

Large Language Models (LLMs) have shown remarkable capabilities across various tasks, but their deployment in high-stake domains requires consistent and coherent behavior across multiple rounds of user interaction. This paper introduces a…

Computation and Language · Computer Science 2025-07-08 Yubo Li , Yidi Miao , Xueying Ding , Ramayya Krishnan , Rema Padman

Ensuring persona fidelity in large language models (LLMs) is essential for maintaining coherent and engaging human-AI interactions. However, LLMs often exhibit Out-of-Character (OOC) behavior, where generated responses deviate from an…

Computation and Language · Computer Science 2025-06-25 Jisu Shin , Juhyun Oh , Eunsu Kim , Hoyun Song , Alice Oh

Large language model (LLM) agents with tool-calling capabilities are increasingly deployed in production systems, yet a fundamental reliability question remains under-explored: does the same agent behave the same way twice? We present a…

Computation and Language · Computer Science 2026-05-29 Abel Yagubyan

Sustaining coherent and engaging narratives requires dialogue or storytelling agents to understand how the personas of speakers or listeners ground the narrative. Specifically, these agents must infer personas of their listeners to produce…

Computation and Language · Computer Science 2023-05-29 Silin Gao , Beatriz Borges , Soyoung Oh , Deniz Bayazit , Saya Kanno , Hiromi Wakaki , Yuki Mitsufuji , Antoine Bosselut

Multi-agent AI systems can be used for simulating collective decision-making in scientific and practical applications. They can also be used to introduce a diverse group discussion step in chatbot pipelines, enhancing the cultural…

Artificial Intelligence · Computer Science 2024-08-16 Razan Baltaji , Babak Hemmatian , Lav R. Varshney

Large Language Models (LLMs) show impressive conversational abilities but sometimes show identity drift problems, where their interaction patterns or styles change over time. As the problem has not been thoroughly examined yet, this study…

Computers and Society · Computer Science 2025-02-18 Junhyuk Choi , Yeseon Hong , Minju Kim , Bugeun Kim

Persona-assigned large language models (LLMs) are used in domains such as education, healthcare, and sociodemographic simulation. Yet, they are typically evaluated only in short, single-round settings that do not reflect real-world usage.…

Computation and Language · Computer Science 2026-01-21 Pedro Henrique Luz de Araujo , Michael A. Hedderich , Ali Modarressi , Hinrich Schuetze , Benjamin Roth

Persona-driven large language models (LLMs) require consistent behavioral tendencies across interactions to simulate human-like personality traits, such as persistence or reliability. However, current LLMs often lack stable internal…

Computation and Language · Computer Science 2026-03-27 Yifan Luo , Kangping Xu , Yanzhen Lu , Yang Yuan , Andrew Chi-Chih Yao

Consistency is one of the major challenges faced by dialogue agents. A human-like dialogue agent should not only respond naturally, but also maintain a consistent persona. In this paper, we exploit the advantages of natural language…

Artificial Intelligence · Computer Science 2021-03-23 Haoyu Song , Wei-Nan Zhang , Jingwen Hu , Ting Liu

There are growing concerns about the risks posed by AI companion applications designed for emotional engagement. Existing safety evaluations often rely on self-reported user data or interviews, offering limited insights into real-time…

Computation and Language · Computer Science 2026-05-04 Prerna Juneja , Lika Lomidze
‹ Prev 1 2 3 10 Next ›