English
Related papers

Related papers: Optimizing Novelty of Top-k Recommendations using …

200 papers

Language models must be adapted to understand and follow user instructions. Reinforcement learning is widely used to facilitate this -- typically using fixed criteria such as "helpfulness" and "harmfulness". In our work, we instead propose…

Computation and Language · Computer Science 2025-12-02 Vijay Viswanathan , Yanchao Sun , Shuang Ma , Xiang Kong , Meng Cao , Graham Neubig , Tongshuang Wu

Recently, large language models (LLMs) have been widely used as recommender systems, owing to their reasoning capability and effectiveness in handling cold-start items. A common approach prompts an LLM with a target user's purchase history…

Information Retrieval · Computer Science 2026-04-23 Sunwoo Kim , Geon Lee , Kyungho Kim , Jaemin Yoo , Kijung Shin

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

Machine Learning · Computer Science 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

The long-tail recommendation is a challenging task for traditional recommender systems, due to data sparsity and data imbalance issues. The recent development of large language models (LLMs) has shown their abilities in complex reasoning,…

Information Retrieval · Computer Science 2024-03-12 Junda Wu , Cheng-Chun Chang , Tong Yu , Zhankui He , Jianing Wang , Yupeng Hou , Julian McAuley

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Reinforcement learning (RL) algorithms assume that users specify tasks by manually writing down a reward function. However, this process can be laborious and demands considerable technical expertise. Can we devise RL algorithms that instead…

Machine Learning · Computer Science 2022-01-03 Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

To support complex search tasks, where the initial information requirements are complex or may change during the search, a search engine must adapt the information delivery as the user's information requirements evolve. To support this…

Information Retrieval · Computer Science 2021-05-24 Jianghong Zhou , Eugene Agichtein

Reinforcement Learning (RL) traditionally relies on scalar reward signals, limiting its ability to leverage the rich semantic knowledge often available in real-world tasks. In contrast, humans learn efficiently by combining numerical…

Search engines answer users' queries by listing relevant items (e.g. documents, songs, products, web pages, ...). These engines rely on algorithms that learn to rank items so as to present an ordered list maximizing the probability that it…

Machine Learning · Computer Science 2021-09-14 Stefan Magureanu , Alexandre Proutiere , Marcus Isaksson , Boxun Zhang

E-commerce search engines often rely solely on product titles as input for ranking models with latency constraints. However, this approach can result in suboptimal relevance predictions, as product titles often lack sufficient detail to…

Information Retrieval · Computer Science 2025-08-13 Nitin Yadav , Changsung Kang , Hongwei Shang , Ming Sun

Reranking is fundamental to information retrieval and retrieval-augmented generation, with recent Large Language Models (LLMs) significantly advancing reranking quality. Most current works rely on large-scale LLMs (>7B parameters),…

Information Retrieval · Computer Science 2026-04-17 Xianming Li , Aamir Shakir , Rui Huang , Tsz-fung Andrew Lee , Julius Lipp , Benjamin Clavié , Jing Li

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou

Large Language Models (LLMs) have been widely adopted in ranking systems such as information retrieval (IR) systems and recommender systems (RSs). To alleviate the latency of auto-regressive decoding, some studies explore the single (first)…

Artificial Intelligence · Computer Science 2025-05-28 Yingpeng Du , Tianjun Wei , Zhu Sun , Jie Zhang

Deep neural networks have achieved significant improvements in information retrieval (IR). However, most existing models are computational costly and can not efficiently scale to long documents. This paper proposes a novel End-to-End neural…

Computation and Language · Computer Science 2019-08-13 Chen Zheng , Yu Sun , Shengxian Wan , Dianhai Yu

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

Machine Learning · Computer Science 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

Planning for both immediate and long-term benefits becomes increasingly important in recommendation. Existing methods apply Reinforcement Learning (RL) to learn planning capacity by maximizing cumulative reward for long-term recommendation.…

Information Retrieval · Computer Science 2024-04-29 Wentao Shi , Xiangnan He , Yang Zhang , Chongming Gao , Xinyue Li , Jizhi Zhang , Qifan Wang , Fuli Feng

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples, inadvertently overlooking the needs of diverse user populations. The performance disparity among various…

Information Retrieval · Computer Science 2025-10-21 Kirandeep Kaur , Vinayak Gupta , Manya Chadha , Chirag Shah