English
Related papers

Related papers: PersonaBench: Evaluating AI Models on Understandin…

200 papers

Conversational AI has become an increasingly prominent and practical application of machine learning. However, existing conversational AI techniques still suffer from various limitations. One such limitation is a lack of well-developed…

Computation and Language · Computer Science 2025-03-25 Junfeng Liu , Christopher Symons , Ranga Raju Vatsavai

Personalized dialogue generation aims to leverage persona profiles and dialogue history to generate persona-relevant and consistent responses. Mainstream models typically rely on token-level language model training with persona dialogue…

Computation and Language · Computer Science 2025-11-14 Guanrong Li , Xinyu Liu , Zhen Wu , Xinyu Dai

Retrieval Augmented Generation (RAG) has become one of the most popular methods for bringing knowledge-intensive context to large language models (LLM) because of its ability to bring local context at inference time without the cost or data…

Information Retrieval · Computer Science 2025-05-02 Michael J. Ryan , Danmei Xu , Chris Nivera , Daniel Campos

LLM-based and agent-based synthetic personas are increasingly used in design and product decision-making, yet prior work shows that prompt-based personas often produce persuasive but unverifiable responses that obscure their evidentiary…

Human-Computer Interaction · Computer Science 2026-02-02 Mario Truss

Many important decisions in our everyday lives, such as authentication via biometric models, are made by Artificial Intelligence (AI) systems. These can be in poor alignment with human expectations, and testing them on clear-cut existing…

Human-Computer Interaction · Computer Science 2024-09-20 Lukas Mecke , Daniel Buschek , Uwe Gruenefeld , Florian Alt

The rapid advancement of language models (LMs) necessitates robust alignment with diverse user values. However, current preference optimization approaches often fail to capture the plurality of user opinions, instead reinforcing majority…

Computation and Language · Computer Science 2024-07-25 Louis Castricato , Nathan Lile , Rafael Rafailov , Jan-Philipp Fränken , Chelsea Finn

Personalized image generation holds great promise in assisting humans in everyday work and life due to its impressive ability to creatively generate personalized content across various contexts. However, current evaluations either are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuang Peng , Yuxin Cui , Haomiao Tang , Zekun Qi , Runpei Dong , Jing Bai , Chunrui Han , Zheng Ge , Xiangyu Zhang , Shu-Tao Xia

The proliferation of AI agents, with their complex and context-dependent actions, renders conventional privacy paradigms obsolete. This position paper argues that the current model of privacy management, rooted in a user's unilateral…

Human-Computer Interaction · Computer Science 2025-08-12 Shuning Zhang , Ying Ma , Jingruo Chen , Simin Li , Xin Yi , Hewu Li

Personalization is crucial for aligning Large Language Model (LLM) outputs with individual user preferences and background knowledge. State-of-the-art solutions are based on retrieval augmentation, where relevant context from a user profile…

Computation and Language · Computer Science 2026-01-27 Alireza Salemi , Hamed Zamani

Simulating human profiles by instilling personas into large language models (LLMs) is rapidly transforming research in agentic behavioral simulation, LLM personalization, and human-AI alignment. However, most existing synthetic personas…

Artificial Intelligence · Computer Science 2025-12-02 Zhen Wang , Yufan Zhou , Zhongyan Luo , Lyumanshan Ye , Adam Wood , Man Yao , Saab Mansour , Luoshang Pan

We present PersonaConvBench, a large-scale benchmark for evaluating personalized reasoning and generation in multi-turn conversations with large language models (LLMs). Unlike existing work that focuses on either personalization or…

The scarcity of accessible, compliant, and ethically sourced data presents a considerable challenge to the adoption of artificial intelligence (AI) in sensitive fields like healthcare, finance, and biomedical research. Furthermore, access…

Machine Learning · Computer Science 2025-04-02 Kumar Kshitij Patel , Weitong Zhang , Lingxiao Wang

Fairness auditing of AI systems can identify and quantify biases. However, traditional auditing using real-world data raises security and privacy concerns. It exposes auditors to security risks as they become custodians of sensitive…

Computers and Society · Computer Science 2025-05-01 Chih-Cheng Rex Yuan , Bow-Yaw Wang

Previous research has demonstrated the potential of AI agents to act as companions that can provide constant emotional support for humans. In this paper, we emphasize the necessity of autonomous adaptation in personal AI companionship, an…

Computation and Language · Computer Science 2025-06-10 Yi Cheng , Wenge Liu , Kaishuai Xu , Wenjun Hou , Yi Ouyang , Chak Tou Leong , Wenjie Li , Xian Wu , Yefeng Zheng

In modern dialogue systems, the ability to implicitly infer user backgrounds from conversations and leverage this information for personalized assistance is crucial. However, the scarcity of high-quality data remains a fundamental challenge…

Computation and Language · Computer Science 2025-06-04 Bo Peng , Zhiheng Wang , Heyang Gong , Chaochao Lu

Retrieval-augmented generation (RAG) systems improve large language model outputs by incorporating external knowledge, enabling more informed and context-aware responses. However, the effectiveness and trustworthiness of these systems…

Computation and Language · Computer Science 2025-08-27 Ilias Driouich , Hongliu Cao , Eoin Thomas

As Large Language Models (LLMs) evolve into lifelong AI assistants, LLM personalization has become a critical frontier. However, progress is currently bottlenecked by the absence of a gold-standard evaluation benchmark. Existing benchmarks…

Computation and Language · Computer Science 2026-05-12 Jianfei Xiao , Xiang Yu , Chengbing Wang , Wuqiang Zheng , Xinyu Lin , Kaining Liu , Hongxun Ding , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

Person re-identification (re-ID) plays an important role in applications such as public security and video surveillance. Recently, learning from synthetic data, which benefits from the popularity of synthetic data engine, have achieved…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Suncheng Xiang , Yuzhuo Fu , Guanjie You , Ting Liu

The widespread adoption of electronic health records and digital healthcare data has created a demand for data-driven insights to enhance patient outcomes, diagnostics, and treatments. However, using real patient data presents privacy and…

Machine Learning · Computer Science 2023-11-15 Aryan Jadon , Shashank Kumar

The generation of privacy-preserving synthetic datasets is a promising avenue for overcoming data scarcity in medical AI research. Post-hoc privacy filtering techniques, designed to remove samples containing personally identifiable…

Machine Learning · Computer Science 2025-10-03 Adil Koeken , Alexander Ziller , Moritz Knolle , Daniel Rueckert