English
Related papers

Related papers: Energy-Guided Diffusion Sampling for Long-Term Use…

200 papers

There are great interests as well as many challenges in applying reinforcement learning (RL) to recommendation systems. In this setting, an online user is the environment; neither the reward function nor the environment dynamics are clearly…

Machine Learning · Computer Science 2020-01-03 Xinshi Chen , Shuang Li , Hui Li , Shaohua Jiang , Yuan Qi , Le Song

Diversity control is an important task to alleviate bias amplification and filter bubble problems. The desired degree of diversity may fluctuate based on users' daily moods or business strategies. However, existing methods for controlling…

Information Retrieval · Computer Science 2024-11-22 Gwangseok Han , Wonbin Kweon , Minsoo Kim , Hwanjo Yu

Active Reconfigurable Intelligent Surfaces (RIS) are a promising technology for 6G wireless networks. This paper investigates a novel hybrid deep reinforcement learning (DRL) framework for resource allocation in a multi-user uplink system…

Signal Processing · Electrical Eng. & Systems 2025-12-29 Mohamed Shalma , Engy Aly Maher , Ahmed El-Mahdy

Actor-critic methods constitute a central paradigm in reinforcement learning (RL), coupling policy evaluation with policy improvement. While effective across many domains, these methods rely on separate actor and critic networks, which…

Machine Learning · Computer Science 2025-09-26 Donghyeon Ki , Hee-Jun Ahn , Kyungyoon Kim , Byung-Jun Lee

Reinforcement learning based recommender systems (RL-based RS) aim at learning a good policy from a batch of collected data, by casting recommendations to multi-step decision-making tasks. However, current RL-based RS research commonly has…

Information Retrieval · Computer Science 2023-04-18 Kai Wang , Zhene Zou , Minghao Zhao , Qilin Deng , Yue Shang , Yile Liang , Runze Wu , Xudong Shen , Tangjie Lyu , Changjie Fan

Reinforcement learning has emerged as a powerful tool for improving diffusion-based text-to-image models, but existing methods are largely limited to single-task optimization. Extending RL to multiple tasks is challenging: joint…

Machine Learning · Computer Science 2026-05-15 Quanhao Li , Junqiu Yu , Kaixun Jiang , Yujie Wei , Zhen Xing , Pandeng Li , Ruihang Chu , Shiwei Zhang , Yu Liu , Zuxuan Wu

At the core of reinforcement learning is the idea of learning beyond the performance in the data. However, scaling such systems has proven notoriously tricky. In contrast, techniques from generative modeling have proven remarkably scalable…

Machine Learning · Computer Science 2025-05-30 Kevin Frans , Seohong Park , Pieter Abbeel , Sergey Levine

Thanks to their remarkable flexibility, diffusion models and flow models have emerged as promising candidates for policy representation. However, efficient reinforcement learning (RL) upon these policies remains a challenge due to the lack…

Machine Learning · Computer Science 2026-03-31 Chenxiao Gao , Edward Chen , Tianyi Chen , Bo Dai

Precise user and item embedding learning is the key to building a successful recommender system. Traditionally, Collaborative Filtering(CF) provides a way to learn user and item embeddings from the user-item interaction history. However,…

Information Retrieval · Computer Science 2019-04-24 Le Wu , Peijie Sun , Yanjie Fu , Richang Hong , Xiting Wang , Meng Wang

Recently, motivated by the outstanding achievements of diffusion models, the diffusion process has been employed to strengthen representation learning in recommendation systems. Most diffusion-based recommendation models typically utilize…

Information Retrieval · Computer Science 2025-08-19 Yongchun Zhu , Guanyu Jiang , Jingwu Chen , Feng Zhang , Xiao Yang , Zuotao Liu

Existing Conversational Recommender Systems (CRS) predominantly utilize user simulators for training and evaluating recommendation policies. These simulators often oversimplify the complexity of user interactions by focusing solely on…

Information Retrieval · Computer Science 2024-09-10 Gangyi Zhang , Chongming Gao , Hang Pan , Runzhe Teng , Ruizhe Li

Offline Reinforcement Learning (RL) learns optimal policies from fixed datasets, training a policy once and deploying it at inference time without further refinement. Inspired by model predictive control (MPC), we introduce an inference…

Machine Learning · Computer Science 2026-05-21 Rohan Deb , Stephen J. Wright , Arindam Banerjee

In many real-world settings, agents must learn from an offline dataset gathered by some prior behavior policy. Such a setting naturally leads to distribution shift between the behavior policy and the target policy being trained - requiring…

Machine Learning · Computer Science 2024-04-10 Matthew Thomas Jackson , Michael Tryfan Matthews , Cong Lu , Benjamin Ellis , Shimon Whiteson , Jakob Foerster

With the great success of diffusion models (DMs) in generating realistic synthetic vision data, many researchers have investigated their potential in decision-making and control. Most of these works utilized DMs to sample directly from the…

Machine Learning · Computer Science 2026-05-19 Hanye Zhao , Xiaoshen Han , Zhengbang Zhu , Minghuan Liu , Yong Yu , De-Chuan Zhan , Weinan Zhang

Many reinforcement learning (RL) problems in practice are offline, learning purely from observational data. A key challenge is how to ensure the learned policy is safe, which requires quantifying the risk associated with different actions.…

Machine Learning · Computer Science 2021-10-28 Yecheng Jason Ma , Dinesh Jayaraman , Osbert Bastani

Sequential decision-making is desired to align with human intents and exhibit versatility across various tasks. Previous methods formulate it as a conditional generation process, utilizing return-conditioned diffusion models to directly…

Machine Learning · Computer Science 2024-10-11 Xudong Yu , Chenjia Bai , Haoran He , Changhong Wang , Xuelong Li

Offline reinforcement learning (RL) faces a critical challenge of overestimating the value of out-of-distribution (OOD) actions. Existing methods mitigate this issue by penalizing unseen samples, yet they fail to accurately identify OOD…

Machine Learning · Computer Science 2026-05-12 Qingjun Wang , Hongtu Zhou , Hang Yu , Junqiao Zhao , Yanping Zhao , Chen Ye , Ziqiao Wang , Guang Chen

In offline reinforcement learning, weighted regression is a common method to ensure the learned policy stays close to the behavior policy and to prevent selecting out-of-sample actions. In this work, we show that due to the limited…

Machine Learning · Computer Science 2023-03-01 Huayu Chen , Cheng Lu , Chengyang Ying , Hang Su , Jun Zhu

Diffusion models excel at modeling complex data distributions, including those of images, proteins, and small molecules. However, in many cases, our goal is to model parts of the distribution that maximize certain properties: for example,…

The recent advances in information technology and artificial intelligence have fueled a rapid expansion of the data center (DC) industry worldwide, accompanied by an immense appetite for electricity to power the DCs. In a typical DC, around…

Artificial Intelligence · Computer Science 2025-02-17 Xianyuan Zhan , Xiangyu Zhu , Peng Cheng , Xiao Hu , Ziteng He , Hanfei Geng , Jichao Leng , Huiwen Zheng , Chenhui Liu , Tianshun Hong , Yan Liang , Yunxin Liu , Feng Zhao