English
Related papers

Related papers: Shielded RecRL: Explanation Generation for Recomme…

200 papers

Reinforcement learning (RL) has recently emerged as a promising approach for aligning text-to-image generative models with human preferences. A key challenge, however, lies in designing effective and interpretable rewards. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xuelu Feng , Yunsheng Li , Ziyu Wan , Zixuan Gao , Junsong Yuan , Dongdong Chen , Chunming Qiao

Recommender systems influence many of our interactions in the digital world -- impacting how we shop for clothes, sorting what we see when browsing YouTube or TikTok, and determining which restaurants and hotels we are shown when using…

Information Retrieval · Computer Science 2023-08-31 Sahil Verma , Chirag Shah , John P. Dickerson , Anurag Beniwal , Narayanan Sadagopan , Arjun Seshadri

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning Large Language Models (LLMs) for text generation. In particular, recent LLMs such as ChatGPT and GPT-4 can engage in fluent conversations with users after…

Machine Learning · Computer Science 2023-11-14 Jonathan D. Chang , Kiante Brantley , Rajkumar Ramamurthy , Dipendra Misra , Wen Sun

Personalized interior decoration design often incurs high labor costs. Recent efforts in developing intelligent interior design systems have focused on generating textual requirement-based decoration designs while neglecting the problem of…

Multimedia · Computer Science 2023-10-12 He Zhang , Ying Sun , Weiyu Guo , Yafei Liu , Haonan Lu , Xiaodong Lin , Hui Xiong

This study deeply explores the application of large language model (LLM) in personalized recommendation system of e-commerce. Aiming at the limitations of traditional recommendation algorithms in processing large-scale and multi-dimensional…

Information Retrieval · Computer Science 2024-10-18 Wei Xu , Jue Xiao , Jianlong Chen

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

In this paper, we propose a theoretically founded sequential strategy for training large-scale Recommender Systems (RS) over implicit feedback, mainly in the form of clicks. The proposed approach consists in minimizing pairwise ranking loss…

Information Retrieval · Computer Science 2020-12-15 Aleksandra Burashnikova , Marianne Clausel , Charlotte Laclau , Frack Iutzeller , Yury Maximov , Massih-Reza Amini

The integration of large language models (LLMs) into information retrieval systems introduces new attack surfaces, particularly for adversarial ranking manipulations. We present $\textbf{StealthRank}$, a novel adversarial attack method that…

Information Retrieval · Computer Science 2025-05-26 Yiming Tang , Yi Fan , Chenxiao Yu , Tiankai Yang , Yue Zhao , Xiyang Hu

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

Computation and Language · Computer Science 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Interactive Recommendation (IR) has gained significant attention recently for its capability to quickly capture dynamic interest and optimize both short and long term objectives. IR agents are typically implemented through Deep…

Information Retrieval · Computer Science 2025-06-17 Jingyu Li , Zhiyong Feng , Dongxiao He , Hongqi Chen , Qinghang Gao , Guoli Wu

Explaining to users why some items are recommended is critical, as it can help users to make better decisions, increase their satisfaction, and gain their trust in recommender systems (RS). However, existing explainable RS usually consider…

Information Retrieval · Computer Science 2022-10-25 Lei Li , Yongfeng Zhang , Li Chen

Reinforcement learning from human feedback (RLHF) has emerged as an effective approach to aligning large language models (LLMs) to human preferences. RLHF contains three steps, i.e., human preference collecting, reward learning, and policy…

Computation and Language · Computer Science 2024-03-29 Hao Lang , Fei Huang , Yongbin Li

Reinforcement learning from human feedback (RLHF) has proven effective in aligning large language models with human preferences, inspiring the development of reward-centric diffusion reinforcement learning (RDRL) to achieve similar…

Machine Learning · Computer Science 2026-03-24 Kwanyoung Kim , Byeongsu Sim

This paper presents ReasoningRec, a reasoning-based recommendation framework that leverages Large Language Models (LLMs) to bridge the gap between recommendations and human-interpretable explanations. In contrast to conventional…

Information Retrieval · Computer Science 2024-10-31 Millennium Bismay , Xiangjue Dong , James Caverlee

Autonomous spacecraft control via Shielded Deep Reinforcement Learning (SDRL) has become a rapidly growing research area. However, the construction of shields and the definition of tasking remains informal, resulting in policies with no…

Machine Learning · Computer Science 2024-03-15 Robert Reed , Hanspeter Schaub , Morteza Lahijanian

Sequential recommendation aims to predict a user's next action in large-scale recommender systems. While traditional methods often suffer from insufficient information interaction, recent generative recommendation models partially address…

Information Retrieval · Computer Science 2026-02-10 Haibo Xing , Hao Deng , Yucheng Mao , Lingyu Mu , Jinxin Hu , Yi Xu , Hao Zhang , Jiahao Wang , Shizhun Wang , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Large Language Models (LLMs) often struggle with problems that require multi-step reasoning. For small-scale open-source models, Reinforcement Learning with Verifiable Rewards (RLVR) fails when correct solutions are rarely sampled even…

Computation and Language · Computer Science 2026-03-02 Yihe Deng , I-Hung Hsu , Jun Yan , Zifeng Wang , Rujun Han , Gufeng Zhang , Yanfei Chen , Wei Wang , Tomas Pfister , Chen-Yu Lee

We propose FlowRL: matching the full reward distribution via flow balancing instead of maximizing rewards in large language model (LLM) reinforcement learning (RL). Recent advanced reasoning models adopt reward-maximizing methods (\eg, PPO…

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

Machine Learning · Computer Science 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy