English
Related papers

Related papers: Dynamic Evaluation Framework for Personalized and …

200 papers

The rapid evolution of neural architectures - from multilayer perceptrons to large-scale Transformer-based models - has enabled language models (LLMs) to exhibit emergent agentic behaviours when equipped with memory, planning, and external…

Artificial Intelligence · Computer Science 2025-09-22 Andrejs Sorstkins , Josh Bailey , Dr Alistair Baron

Large Language Model (LLM)-based multi-agent systems are increasingly used to simulate human interactions and solve collaborative tasks. A common practice is to assign agents with personas to encourage behavioral diversity. However, this…

Multiagent Systems · Computer Science 2025-11-18 Jiayi Li , Xiao Liu , Yansong Feng

While there is significant interest in using generative AI tools as general-purpose models for specific ML applications, discriminative models are much more widely deployed currently. One of the key shortcomings of these discriminative AI…

Artificial Intelligence · Computer Science 2023-12-13 Son The Nguyen , Theja Tulabandhula , Mary Beth Watson-Manheim

While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is…

Information Retrieval · Computer Science 2025-02-18 Yi Fang , Wenjie Wang , Yang Zhang , Fengbin Zhu , Qifan Wang , Fuli Feng , Xiangnan He

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

Computational Engineering, Finance, and Science · Computer Science 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet…

Information Retrieval · Computer Science 2026-01-06 Nicolas Bougie , Gian Maria Marconi , Tony Yip , Narimasa Watanabe

Deep Research agents driven by LLMs have automated the scholarly discovery pipeline, from planning and query formulation to iterative web exploration. Yet they remain constrained by a static, ``one-size-fits-all'' retrieval paradigm.…

Information Retrieval · Computer Science 2026-05-12 Xiaopeng Li , Wenlin Zhang , Yingyi Zhang , Pengyue Jia , Yejing Wang , Yichao Wang , Yong Liu , Huifeng Guo , Xiangyu Zhao

Large Language Model (LLM) based multi-agent systems (MAS) have shown promise in tackling complex tasks, but often rely on predefined roles and centralized coordination, limiting their adaptability to evolving challenges. This paper…

Artificial Intelligence · Computer Science 2025-09-04 Siyuan Lu , Jiaqi Shao , Bing Luo , Tao Lin

As LLMs become capable of complex tasks, there is growing potential for personalized interactions tailored to the subtle and idiosyncratic preferences of the user. We present a public benchmark, PersonalLLM, focusing on adapting LLMs to…

Machine Learning · Computer Science 2025-02-25 Thomas P. Zollo , Andrew Wei Tung Siah , Naimeng Ye , Ang Li , Hongseok Namkoong

The low-intrusion and automated personality assessment is receiving increasing attention in psychology and human-computer interaction fields. This study explores an interactive approach for personality assessment, focusing on the…

Human-Computer Interaction · Computer Science 2026-04-07 Baiqiao Zhang , Xiangxian Li , Chao Zhou , Xinyu Gai , Juan Liu , Xue Yang , Nianlong Li , Shuai Ma , Xiaojuan Ma , Yong-jin Liu , Yulong Bian

Large language models (LLMs) have enabled remarkable advances in automated task-solving with multi-agent systems. However, most existing LLM-based multi-agent approaches rely on predefined agents to handle simple tasks, limiting the…

Artificial Intelligence · Computer Science 2024-05-01 Guangyao Chen , Siwei Dong , Yu Shu , Ge Zhang , Jaward Sesay , Börje F. Karlsson , Jie Fu , Yemin Shi

Information technology has profoundly altered the way humans interact with information. The vast amount of content created, shared, and disseminated online has made it increasingly difficult to access relevant information. Over the past two…

Information Retrieval · Computer Science 2025-04-14 Yu Zhang , Shutong Qiao , Jiaqi Zhang , Tzu-Heng Lin , Chen Gao , Yong Li

Effectively modeling the dynamic nature of user preferences is crucial for enhancing recommendation accuracy and fostering transparency in recommender systems. Traditional user profiling often overlooks the distinction between transitory…

Information Retrieval · Computer Science 2025-11-04 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

Agentic AI systems are rapidly advancing toward real-world applications, yet their readiness in complex and personalized environments remains insufficiently characterized. To address this gap, we introduce PersonalHomeBench, a benchmark for…

Artificial Intelligence · Computer Science 2026-05-15 Manasa Bharadwaj , Yolanda Liu , InJung Yang , Sungil Kim , Nikhil Verma , KoKeun Kim , Kevin Ferreira , YoungJoon Kim

The proliferation of AI agents, with their complex and context-dependent actions, renders conventional privacy paradigms obsolete. This position paper argues that the current model of privacy management, rooted in a user's unilateral…

Human-Computer Interaction · Computer Science 2025-08-12 Shuning Zhang , Ying Ma , Jingruo Chen , Simin Li , Xin Yi , Hewu Li

The utility of Role-Playing Language Agents in sociological research is growing alongside the adoption of Large Language Models. For realism in social simulation, these agents must adhere to their personas defined by character profiles, yet…

Computation and Language · Computer Science 2026-03-03 Yuxin Liu , Mingye Zhu , Siyuan Liu , Bo Hu , Lei Zhang

Usability is a key factor in the effectiveness of recommender systems. However, the analysis of user interfaces is a time-consuming process that requires expertise. Recent advances in multimodal large language models (LLMs) offer promising…

Human-Computer Interaction · Computer Science 2025-11-19 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Thi Ngoc Trang Tran

Recommender systems play a central role in numerous real-life applications, yet evaluating their performance remains a significant challenge due to the gap between offline metrics and online behaviors. Given the scarcity and limits (e.g.,…

Information Retrieval · Computer Science 2025-04-18 Nicolas Bougie , Narimasa Watanabe

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

Information Retrieval · Computer Science 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

Effective conversational agents like large language models (LLMs) must personalize their interactions to adapt to user preferences, personalities, and attributes across diverse domains like education and healthcare. Current methods like…

Computation and Language · Computer Science 2025-10-03 Yanming Wan , Jiaxing Wu , Marwa Abdulhai , Lior Shani , Natasha Jaques