English
Related papers

Related papers: User-centric Subjective Leaderboard by Customizabl…

200 papers

Reward models (RM) capture the values and preferences of humans and play a central role in Reinforcement Learning with Human Feedback (RLHF) to align pretrained large language models (LLMs). Traditionally, training these models relies on…

Machine Learning · Computer Science 2024-09-12 Yifei He , Haoxiang Wang , Ziyan Jiang , Alexandros Papangelis , Han Zhao

Accurately modeling user preferences is vital not only for improving recommendation performance but also for enhancing transparency in recommender systems. Conventional user profiling methods, such as averaging item embeddings, often…

Information Retrieval · Computer Science 2025-05-05 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

Large language model (LLM) personalization aims to align model outputs with individuals' unique preferences and opinions. While recent efforts have implemented various personalization methods, a unified theoretical framework that can…

Computation and Language · Computer Science 2025-09-30 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional performance across a wide range of tasks, generating significant interest in their application to recommendation systems. However, existing methods have not…

Computation and Language · Computer Science 2025-04-28 Jieyong Kim , Hyunseo Kim , Hyunjin Cho , SeongKu Kang , Buru Chang , Jinyoung Yeo , Dongha Lee

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

We study whether self-learning can scale LLM-based agents without relying on human-curated datasets or predefined rule-based rewards. Through controlled experiments in a search-agent setting, we identify two key determinants of scalable…

Artificial Intelligence · Computer Science 2025-10-22 Wangtao Sun , Xiang Cheng , Jialin Fan , Yao Xu , Xing Yu , Shizhu He , Jun Zhao , Kang Liu

Conversational Recommender Systems (CRSs) engage users in multi-turn interactions to deliver personalized recommendations. The emergence of large language models (LLMs) further enhances these systems by enabling more natural and dynamic…

Computation and Language · Computer Science 2025-04-18 Xiaoyan Zhao , Yang Deng , Wenjie Wang , Hongzhan lin , Hong Cheng , Rui Zhang , See-Kiong Ng , Tat-Seng Chua

Aligning large language models (LLMs) to human preferences is challenging in domains where preference data is unavailable. We address the problem of learning reward models for such target domains by leveraging feedback collected from…

Machine Learning · Computer Science 2025-01-03 David Wu , Sanjiban Choudhury

Effective conversational agents like large language models (LLMs) must personalize their interactions to adapt to user preferences, personalities, and attributes across diverse domains like education and healthcare. Current methods like…

Computation and Language · Computer Science 2025-10-03 Yanming Wan , Jiaxing Wu , Marwa Abdulhai , Lior Shani , Natasha Jaques

Reinforcement learning based fine-tuning of large language models (LLMs) on human preferences has been shown to enhance both their capabilities and safety behavior. However, in cases related to safety, without precise instructions to human…

Artificial Intelligence · Computer Science 2024-11-05 Tong Mu , Alec Helyar , Johannes Heidecke , Joshua Achiam , Andrea Vallone , Ian Kivlichan , Molly Lin , Alex Beutel , John Schulman , Lilian Weng

The integration of large language models (LLMs) into medical practice offers transformative potential, yet their real-world clinical applicability remains constrained by critical alignment issues: (1) a misalignment between static…

Artificial Intelligence · Computer Science 2025-12-05 Yongnan Jin , Xurui Li , Feng Cao , Liucun Gao , Juanjuan Yao

The reward model (RM) that represents human preferences plays a crucial role in optimizing the outputs of large language models (LLMs), e.g., through reinforcement learning from human feedback (RLHF) or rejection sampling. However, a long…

Artificial Intelligence · Computer Science 2025-04-22 Yizhou Chen , Yawen Liu , Xuesi Wang , Qingtao Yu , Guangda Huzhang , Anxiang Zeng , Han Yu , Zhiming Zhou

Conversational recommender systems (CRS) enhance user experience through multi-turn interactions, yet evaluating CRS remains challenging. User simulators can provide comprehensive evaluations through interactions with CRS, but building…

Human-Computer Interaction · Computer Science 2025-08-01 Luyu Chen , Quanyu Dai , Zeyu Zhang , Xueyang Feng , Mingyu Zhang , Pengcheng Tang , Xu Chen , Yue Zhu , Zhenhua Dong

Recent years have witnessed a growing interest in personalizing the responses of large language models (LLMs). While existing evaluations primarily focus on whether a response aligns with a user's preferences, we argue that factuality is an…

Computation and Language · Computer Science 2025-09-25 Chimaobi Okite , Naihao Deng , Kiran Bodipati , Huaidian Hou , Joyce Chai , Rada Mihalcea

In sequential recommendation, models recommend items based on user's interaction history. To this end, current models usually incorporate information such as item descriptions and user intent or preferences. User preferences are usually not…

Properly defining a reward signal to efficiently train a reinforcement learning (RL) agent is a challenging task. Designing balanced objective functions from which a desired behavior can emerge requires expert knowledge, especially for…

Machine Learning · Computer Science 2024-06-25 Timo Kaufmann , Jannis Blüml , Antonia Wüst , Quentin Delfosse , Kristian Kersting , Eyke Hüllermeier

Recent advances in reasoning with large language models (LLMs) have demonstrated strong performance on complex mathematical tasks, including combinatorial optimization. Techniques such as Chain-of-Thought and In-Context Learning have…

Artificial Intelligence · Computer Science 2025-09-17 Marylou Fauchard , Florian Carichon , Margarida Carvalho , Golnoosh Farnadi

Product review generation is an important task in recommender systems, which could provide explanation and persuasiveness for the recommendation. Recently, Large Language Models (LLMs, e.g., ChatGPT) have shown superior text modeling and…

Computation and Language · Computer Science 2024-07-11 Qiyao Peng , Hongtao Liu , Hongyan Xu , Qing Yang , Minglai Shao , Wenjun Wang

The emergence of agentic recommender systems powered by Large Language Models (LLMs) represents a paradigm shift in personalized recommendations, leveraging LLMs' advanced reasoning and role-playing capabilities to enable autonomous,…

Information Retrieval · Computer Science 2025-05-29 Yu Shang , Peijie Liu , Yuwei Yan , Zijing Wu , Leheng Sheng , Yuanqing Yu , Chumeng Jiang , An Zhang , Fengli Xu , Yu Wang , Min Zhang , Yong Li

Recent approaches in personalized reward modeling have primarily focused on leveraging user interaction history to align model judgments with individual preferences. However, existing approaches largely treat user context as a static or…

Computation and Language · Computer Science 2026-04-21 Kwangwook Seo , Dongha Lee