English
Related papers

Related papers: Fine-Tuning Diffusion-Based Recommender Systems vi…

200 papers

Reinforcement Learning-based recommender systems (RLRS) offer an effective way to handle sequential recommendation tasks but often face difficulties in real-world settings, where user feedback data can be sub-optimal or sparse. In this…

Information Retrieval · Computer Science 2025-10-16 Xiaocong Chen , Siyu Wang , Lina Yao

Modern recommender systems aim to improve user experience. As reinforcement learning (RL) naturally fits this objective -- maximizing an user's reward per session -- it has become an emerging topic in recommender systems. Developing…

Information Retrieval · Computer Science 2022-06-16 Xin Xin , Tiago Pimentel , Alexandros Karatzoglou , Pengjie Ren , Konstantina Christakopoulou , Zhaochun Ren

Classifier free guidance has shown strong potential in diffusion-based reinforcement learning. However, existing methods rely on joint training of the guidance module and the diffusion model, which can be suboptimal during the early stages…

Machine Learning · Computer Science 2025-06-05 Zhaoyang Chen , Cody Fleming

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

Diffusion models have shown strong competitiveness in offline reinforcement learning tasks by formulating decision-making as sequential generation. However, the practicality of these methods is limited due to the lengthy inference processes…

Machine Learning · Computer Science 2024-07-24 Renming Huang , Yunqiang Pei , Guoqing Wang , Yangming Zhang , Yang Yang , Peng Wang , Hengtao Shen

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Recent advancements in large language models (LLMs) have enabled understanding webpage contexts, product details, and human instructions. Utilizing LLMs as the foundational architecture for either reward models or policies in reinforcement…

Machine Learning · Computer Science 2024-08-30 Shuang Feng , Grace Feng

Diffusion and flow policies are gaining prominence in online reinforcement learning (RL) due to their expressive power, yet training them efficiently remains a critical challenge. A fundamental difficulty in online RL is the lack of direct…

Machine Learning · Computer Science 2026-01-14 Zeyang Li , Sunbochen Tang , Navid Azizan

Recommender systems need to optimize various types of user feedback, e.g., clicks, likes, and shares. A typical recommender system handling multiple types of feedback has two components: a multi-task learning (MTL) module, predicting…

Information Retrieval · Computer Science 2025-04-09 Yang Cao , Changhao Zhang , Xiaoshuang Chen , Kaiqiao Zhan , Ben Wang

Recent breakthroughs in large language models (LLMs) have fundamentally shifted recommender systems from discriminative to generative paradigms, where user behavior modeling is achieved by generating target items conditioned on historical…

Information Retrieval · Computer Science 2025-10-15 Junfei Tan , Yuxin Chen , An Zhang , Junguang Jiang , Bin Liu , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng , Xiang Wang

Reinforcement finetuning (RFT) has shown great potential for enhancing the mathematical reasoning capabilities of large language models (LLMs), but it is often sample- and compute-inefficient, requiring extensive training. In this work, we…

Machine Learning · Computer Science 2026-02-03 Taiwei Shi , Yiyang Wu , Linxin Song , Tianyi Zhou , Jieyu Zhao

Reinforcement Learning (RL) in environments with complex, history-dependent reward structures poses significant challenges for traditional methods. In this work, we introduce a novel approach that leverages automaton-based feedback to guide…

Machine Learning · Computer Science 2025-10-20 Mahyar Alinejad , Alvaro Velasquez , Yue Wang , George Atia

Maximum entropy reinforcement learning (MaxEnt-RL) has become the standard approach to RL due to its beneficial exploration properties. Traditionally, policies are parameterized using Gaussian distributions, which significantly limits their…

Machine Learning · Computer Science 2025-06-11 Onur Celik , Zechu Li , Denis Blessing , Ge Li , Daniel Palenicek , Jan Peters , Georgia Chalvatzaki , Gerhard Neumann

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

Existing web-scale recommendation systems commonly use supervised learning methods that prioritize immediate user feedback. Although reinforcement learning (RL) offers a solution to optimize longer-term goals, such as in-session engagement,…

Machine Learning · Computer Science 2025-08-04 Mehdi Ben Ayed , Fei Feng , Jay Adams , Vishwakarma Singh , Kritarth Anand , Jiajing Xu

In this paper, we introduce DiffusionMat, a novel image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes. Diverging from conventional methods that utilize trimaps merely as loose…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yangyang Xu , Shengfeng He , Wenqi Shao , Kwan-Yee K. Wong , Yu Qiao , Ping Luo

Decision-focused learning (DFL) integrates predictive modeling and optimization by training predictors to optimize the downstream decision target rather than merely minimizing prediction error. To date, existing DFL methods typically rely…

Machine Learning · Computer Science 2025-10-14 Zihao Zhao , Christopher Yeh , Lingkai Kong , Kai Wang

Test-time scaling through reward-guided generation remains largely unexplored for discrete diffusion models despite its potential as a promising alternative. In this work, we introduce Iterative Reward-Guided Refinement (IterRef), a novel…

Machine Learning · Computer Science 2025-11-11 Sanghyun Lee , Sunwoo Kim , Seungryong Kim , Jongho Park , Dongmin Park

Reinforcement learning has been widely applied to diffusion and flow models for visual tasks such as text-to-image generation. However, these tasks remain challenging because diffusion models have intractable likelihoods, which creates a…

Machine Learning · Computer Science 2026-05-20 Jaemoo Choi , Yuchen Zhu , Wei Guo , Petr Molodyk , Bo Yuan , Jinbin Bai , Yi Xin , Molei Tao , Yongxin Chen