English
Related papers

Related papers: Listwise Preference Diffusion Optimization for Use…

200 papers

Modeling the evolution of user preference is essential in recommender systems. Recently, dynamic graph-based methods have been studied and achieved SOTA for recommendation, majority of which focus on user's stable long-term preference.…

Information Retrieval · Computer Science 2022-08-02 Huixuan Chi , Hao Xu , Hao Fu , Mengya Liu , Mengdi Zhang , Yuji Yang , Qinfen Hao , Wei Wu

This study addresses the challenge of noise in training datasets for Direct Preference Optimization (DPO), a method for aligning Large Language Models (LLMs) with human preferences. We categorize noise into pointwise noise, which includes…

Machine Learning · Computer Science 2025-04-21 Junkang Wu , Yuexiang Xie , Zhengyi Yang , Jiancan Wu , Jiawei Chen , Jinyang Gao , Bolin Ding , Xiang Wang , Xiangnan He

We propose DiTTO, a novel diffusion-based framework for generating realistic, precisely configurable, and diverse multi-device storage traces. Leveraging advanced diffusion techniques, DiTTO enables the synthesis of high-fidelity continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Seohyun Kim , Junyoung Lee , Jongho Park , Jinhyung Koo , Sungjin Lee , Yeseong Kim

Diversified recommendation has attracted increasing attention from both researchers and practitioners, which can effectively address the homogeneity of recommended items. Existing approaches predominantly aim to infer the diversity of user…

Information Retrieval · Computer Science 2026-01-07 Hanyang Yuan , Ning Tang , Tongya Zheng , Jiarong Xu , Xintong Hu , Renhong Huang , Shunyu Liu , Jiacong Hu , Jiawei Chen , Mingli Song

CTR (Click-Through Rate) prediction, crucial for recommender systems and online advertising, etc., has been confirmed to benefit from modeling long-term user behaviors. Nonetheless, the vast number of behaviors and complexity of noise…

Information Retrieval · Computer Science 2025-09-22 Weijiang Lai , Beihong Jin , Yapeng Zhang , Yiyuan Zheng , Rui Zhao , Jian Dong , Jun Lei , Xingxing Wang

Instruction data selection aims to identify a high-quality subset from the training set that matches or exceeds the performance of the full dataset on target tasks. Existing methods focus on the instruction-to-response mapping, but neglect…

Machine Learning · Computer Science 2025-05-20 Wenya Guo , Zhengkun Zhang , Xumeng Liu , Ying Zhang , Ziyu Lu , Haoze Zhu , Xubo Liu , Ruxue Yan

Cross-domain recommendation (CDR) has been proven as a promising way to alleviate the cold-start issue, in which the most critical problem is how to draw an informative user representation in the target domain via the transfer of user…

Information Retrieval · Computer Science 2025-01-22 Xiaodong Li , Hengzhu Tang , Jiawei Sheng , Xinghua Zhang , Li Gao , Suqi Cheng , Dawei Yin , Tingwen Liu

Social agents powered by large language models (LLMs) can simulate human social behaviors but fall short in handling complex social dialogues. Direct Preference Optimization (DPO) has proven effective in aligning LLM behavior with human…

Artificial Intelligence · Computer Science 2025-02-28 Aobo Kong , Wentao Ma , Shiwan Zhao , Yongbin Li , Yuchuan Wu , Ke Wang , Xiaoqian Liu , Qicheng Li , Yong Qin , Fei Huang

Aligning language models (LMs) with curated human feedback is critical to control their behaviors in real-world applications. Several recent policy optimization methods, such as DPO and SLiC, serve as promising alternatives to the…

Computation and Language · Computer Science 2025-01-28 Tianqi Liu , Zhen Qin , Junru Wu , Jiaming Shen , Misha Khalman , Rishabh Joshi , Yao Zhao , Mohammad Saleh , Simon Baumgartner , Jialu Liu , Peter J. Liu , Xuanhui Wang

The application of diffusion models in 3D LiDAR scene completion is limited due to diffusion's slow sampling speed. Score distillation accelerates diffusion sampling but with performance degradation, while post-training with direct policy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 An Zhao , Shengyuan Zhang , Ling Yang , Zejian Li , Jiale Wu , Haoran Xu , AnYang Wei , Perry Pengyun GU , Lingyun Sun

The recommendation methods based on network diffusion have been shown to perform well in both recommendation accuracy and diversity. Nowdays, numerous extensions have been made to further improve the performance of such methods. However, to…

Physics and Society · Physics 2019-08-13 Peng Zhang , Leyang Xue , An Zeng

Direct Preference Optimization (DPO) has emerged as a de-facto approach for aligning language models with human preferences. Recent work has shown DPO's effectiveness relies on training data quality. In particular, clear quality differences…

Machine Learning · Computer Science 2025-01-28 Nirav Diwan , Tolga Ergen , Dongsub Shim , Honglak Lee

Diffusion policies, widely adopted in decision-making scenarios such as robotics, gaming and autonomous driving, are capable of learning diverse skills from demonstration data due to their high representation power. However, the sub-optimal…

Machine Learning · Computer Science 2025-09-30 Ningyuan Yang , Jiaxuan Gao , Feng Gao , Yi Wu , Chao Yu

User profiling is pivotal for recommendation systems, as it transforms raw user interaction data into concise and structured representations that drive personalized recommendations. While traditional embedding-based profiles lack…

Information Retrieval · Computer Science 2025-06-24 Lu Wang , Di Zhang , Fangkai Yang , Pu Zhao , Jianfeng Liu , Yuefeng Zhan , Hao Sun , Qingwei Lin , Weiwei Deng , Dongmei Zhang , Feng Sun , Qi Zhang

Predicting pedestrian motion trajectories is critical for path planning and motion control of autonomous vehicles. However, accurately forecasting crowd trajectories remains a challenging task due to the inherently multimodal and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yu Liu , Zhijie Liu , Xiao Ren , You-Fu Li , He Kong

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking…

Information Retrieval · Computer Science 2026-04-20 Zhongyu Ouyang , Qianlong Wen , Chunhui Zhang , Yanfang Ye , Soroush Vosoughi

Human behavior has the nature of indeterminacy, which requires the pedestrian trajectory prediction system to model the multi-modality of future motion states. Unlike existing stochastic trajectory prediction methods which usually use a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Tianpei Gu , Guangyi Chen , Junlong Li , Chunze Lin , Yongming Rao , Jie Zhou , Jiwen Lu

In the field of large language models (LLMs), aligning models with the diverse preferences of users is a critical challenge. Direct Preference Optimization (DPO) has played a key role in this area. It works by using pairs of preferences…

Computation and Language · Computer Science 2024-05-29 Yueqin Yin , Zhendong Wang , Yi Gu , Hai Huang , Weizhu Chen , Mingyuan Zhou

Performative prediction aims to model scenarios where predictive outcomes subsequently influence the very systems they target. The pursuit of a performative optimum (PO) -- minimizing performative risk -- is generally reliant on modeling of…

Machine Learning · Computer Science 2025-02-11 Songkai Xue , Yuekai Sun

Click-through rate (CTR) prediction plays a key role in modern online personalization services. In practice, it is necessary to capture user's drifting interests by modeling sequential user behaviors to build an accurate CTR prediction…

Information Retrieval · Computer Science 2020-05-29 Jiarui Qin , Weinan Zhang , Xin Wu , Jiarui Jin , Yuchen Fang , Yong Yu
‹ Prev 1 3 4 5 6 7 10 Next ›