English
Related papers

Related papers: Preference Diffusion for Recommendation

200 papers

This work addresses the challenge of personalizing trajectories generated in automated decision-making systems by introducing a resource-efficient approach that enables rapid adaptation to individual users' preferences. Our method leverages…

Machine Learning · Computer Science 2025-03-25 Wen Zheng Terence Ng , Jianda Chen , Yuan Xu , Tianwei Zhang

Debiased recommender models have recently attracted increasing attention from the academic and industry communities. Existing models are mostly based on the technique of inverse propensity score (IPS). However, in the recommendation domain,…

Information Retrieval · Computer Science 2022-08-16 Quanyu Dai , Zhenhua Dong , Xu Chen

Denoising diffusion probabilistic models (DDPMs) are a recent family of generative models that achieve state-of-the-art results. In order to obtain class-conditional generation, it was suggested to guide the diffusion process by gradients…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Bahjat Kawar , Roy Ganz , Michael Elad

Recent years have witnessed a rapid growth of deep generative models, with text-to-image models gaining significant attention from the public. However, existing models often generate images that do not align well with human preferences,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xiaoshi Wu , Keqiang Sun , Feng Zhu , Rui Zhao , Hongsheng Li

Recommender systems use users' historical interactions to learn their preferences and deliver personalized recommendations from a vast array of candidate items. Current recommender systems primarily rely on the assumption that the training…

Information Retrieval · Computer Science 2024-04-24 Zhuhang Li , Ning Yang

Adapting the Diffusion Probabilistic Model (DPM) for direct image super-resolution is wasteful, given that a simple Convolutional Neural Network (CNN) can recover the main low-frequency content. Therefore, we present ResDiff, a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Shuyao Shang , Zhengyang Shan , Guangxing Liu , LunQian Wang , XingHua Wang , Zekai Zhang , Jinglin Zhang

Feature-based knowledge distillation has been applied to compress modern recommendation models, usually with projectors that align student (small) recommendation models' dimensions with teacher dimensions. However, existing studies have…

Information Retrieval · Computer Science 2025-01-14 Zhangchi Zhu , Wei Zhang

Preference learning algorithms (e.g., RLHF and DPO) are frequently used to steer LLMs to produce generations that are more preferred by humans, but our understanding of their inner workings is still limited. In this work, we study the…

Machine Learning · Computer Science 2024-11-01 Angelica Chen , Sadhika Malladi , Lily H. Zhang , Xinyi Chen , Qiuyi Zhang , Rajesh Ranganath , Kyunghyun Cho

Sequential recommendation aims to infer user preferences from historical interaction sequences and predict the next item that users may be interested in the future. The current mainstream design approach is to represent items as fixed…

Information Retrieval · Computer Science 2023-12-21 Yong Niu , Xing Xing , Zhichun Jia , Ruidi Liu , Mindong Xin

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face challenges, including posterior collapse and limited…

Machine Learning · Computer Science 2024-10-28 Sharare Zolghadr , Ole Winther , Paul Jeha

Controllable diffusion generation often relies on various heuristics that are seemingly disconnected without a unified understanding. We bridge this gap with Diffusion Controller (DiffCon), a unified control-theoretic view that casts…

Machine Learning · Computer Science 2026-03-10 Tong Yang , Moonkyung Ryu , Chih-Wei Hsu , Guy Tennenholtz , Yuejie Chi , Craig Boutilier , Bo Dai

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Diffusion Probabilistic Models (DPMs) have achieved significant success in generative tasks. However, their training and sampling processes suffer from the issue of distribution mismatch. During the denoising process, the input data…

Machine Learning · Computer Science 2025-02-25 Zekun Wang , Mingyang Yi , Shuchen Xue , Zhenguo Li , Ming Liu , Bing Qin , Zhi-Ming Ma

In spite of the tremendous development of recommender system owing to the progressive capability of machine learning recently, the current recommender system is still vulnerable to the distribution shift of users and items in realistic…

Machine Learning · Computer Science 2022-02-10 Yue He , Zimu Wang , Peng Cui , Hao Zou , Yafeng Zhang , Qiang Cui , Yong Jiang

Recently, motivated by the outstanding achievements of diffusion models, the diffusion process has been employed to strengthen representation learning in recommendation systems. Most diffusion-based recommendation models typically utilize…

Information Retrieval · Computer Science 2025-08-19 Yongchun Zhu , Guanyu Jiang , Jingwu Chen , Feng Zhang , Xiao Yang , Zuotao Liu

The Diffusion Probabilistic Model (DPM) has emerged as a highly effective generative model in the field of computer vision. Its intermediate latent vectors offer rich semantic information, making it an attractive option for various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Haipeng Zhou , Lei Zhu , Yuyin Zhou

We propose a diffusion-based framework for prompt optimization that leverages Diffusion Language Models (DLMs) to iteratively refine system prompts through masked denoising. By conditioning on interaction traces, including user queries,…

Computation and Language · Computer Science 2026-02-24 Shiyu Wang , Haolin Chen , Liangwei Yang , Jielin Qiu , Rithesh Murthy , Ming Zhu , Zixiang Chen , Silvio Savarese , Caiming Xiong , Shelby Heinecke , Huan Wang

Preference alignment methods are increasingly critical for steering large language models (LLMs) to generate outputs consistent with human values. While recent approaches often rely on synthetic data generated by LLMs for scalability and…

Computation and Language · Computer Science 2025-10-21 Mingye Zhu , Yi Liu , Zheren Fu , Yongdong Zhang , Zhendong Mao

Many real-world machine learning tasks require outputs that satisfy hard constraints, such as physical conservation laws, structured dependencies in graphs, or column-level relationships in tabular data. Existing approaches rely either on…

Artificial Intelligence · Computer Science 2025-11-21 Pantelis Dogoulis , Fabien Bernier , Félix Fourreau , Karim Tit , Maxime Cordy