English
Related papers

Related papers: Exploiting Negative Preference in Content-based Mu…

200 papers

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Top-N recommendation, which aims to learn user ranking-based preference, has long been a fundamental problem in a wide range of applications. Traditional models usually motivate themselves by designing complex or tailored architectures…

Information Retrieval · Computer Science 2021-09-14 Mengyue Yang , Quanyu Dai , Zhenhua Dong , Xu Chen , Xiuqiang He , Jun Wang

In large language model (LLM)-based recommendation systems, direct preference optimization (DPO) effectively aligns recommendations with user preferences, requiring multi-negative objective functions to leverage abundant implicit-feedback…

Information Retrieval · Computer Science 2026-05-04 Xingyu Hu , Kai Zhang , Jiancan Wu , Shuli Wang , Chi Wang , Wenshuai Chen , Yinhua Zhu , Haitao Wang , Xingxing Wang , Xiang Wang

Standard methods in preference learning involve estimating the parameters of discrete choice models from data of selections (choices) made by individuals from a discrete set of alternatives (the choice set). While there are many models for…

Machine Learning · Computer Science 2021-08-18 Kiran Tomlinson , Johan Ugander , Austin R. Benson

One of the challenges in contrastive learning is the selection of appropriate \textit{hard negative} examples, in the absence of label information. Random sampling or importance sampling methods based on feature similarity often lead to…

Machine Learning · Computer Science 2022-06-03 Afrina Tabassum , Muntasir Wahed , Hoda Eldardiry , Ismini Lourentzou

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Online music services are increasing in popularity. They enable us to analyze people's music listening behavior based on play logs. Although it is known that people listen to music based on topic (e.g., rock or jazz), we assume that when a…

Artificial Intelligence · Computer Science 2017-05-29 Kosetsu Tsukuda , Masataka Goto

Aligning AI systems with human preferences typically suffers from the infamous reward hacking problem, where optimization of an imperfect reward model leads to undesired behaviors. In this paper, we investigate reward hacking in offline…

Machine Learning · Computer Science 2024-12-13 Paria Rashidinejad , Yuandong Tian

Increasing users' positive interactions, such as purchases or clicks, is an important objective of recommender systems. Recommenders typically aim to select items that users will interact with. If the recommended items are purchased, an…

Machine Learning · Computer Science 2020-09-24 Masahiro Sato , Sho Takemori , Janmajay Singh , Tomoko Ohkuma

One particularly promising use case of Large Language Models (LLMs) for recommendation is the automatic generation of Natural Language (NL) user taste profiles from consumption data. These profiles offer interpretable and editable…

Information Retrieval · Computer Science 2025-07-23 Bruno Sguerra , Elena V. Epure , Harin Lee , Manuel Moussallam

Offline preference optimization is a key method for enhancing and controlling the quality of Large Language Model (LLM) outputs. Typically, preference optimization is approached as an offline supervised learning task using manually-crafted…

Machine Learning · Computer Science 2024-11-05 Chris Lu , Samuel Holt , Claudio Fanconi , Alex J. Chan , Jakob Foerster , Mihaela van der Schaar , Robert Tjarko Lange

Deep models have been widely and successfully used in image manipulation detection, which aims to classify tampered images and localize tampered regions. Most existing methods mainly focus on extracting global features from tampered images,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Yuyuan Zeng , Bowen Zhao , Shanzhao Qiu , Tao Dai , Shu-Tao Xia

Contrastive learning has been applied to Human Activity Recognition (HAR) based on sensor data owing to its ability to achieve performance comparable to supervised learning with a large amount of unlabeled data and a small amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Jinqiang Wang , Tao Zhu , Liming Chen , Huansheng Ning , Yaping Wan

With the rapid increase of micro-video creators and viewers, how to make personalized recommendations from a large number of candidates to viewers begins to attract more and more attention. However, existing micro-video recommendation…

Information Retrieval · Computer Science 2022-05-20 Beibei Li , Beihong Jin , Jiageng Song , Yisong Yu , Yiyuan Zheng , Wei Zhuo

Deep Candidate Generation plays an important role in large-scale recommender systems. It takes user history behaviors as inputs and learns user and item latent embeddings for candidate generation. In the literature, conventional methods…

Information Retrieval · Computer Science 2022-11-24 Ningning Li , Qunwei Li , Xichen Ding , Shaohu Chen , Wenliang Zhong

Online streaming services have become the most popular way of listening to music. The majority of these services are endowed with recommendation mechanisms that help users to discover songs and artists that may interest them from the vast…

Information Retrieval · Computer Science 2020-08-27 Diego Sánchez-Moreno , Yong Zheng , María N. Moreno-García

We introduce the novel approach towards fake text reviews detection in collaborative filtering recommender systems. The existing algorithms concentrate on detecting the fake reviews, generated by language models and ignore the texts,…

Artificial Intelligence · Computer Science 2023-01-10 Yuliya Tukmacheva , Ivan Oseledets , Evgeny Frolov

Algorithms have an increasing influence on the music that we consume and understanding their behavior is fundamental to make sure they give a fair exposure to all artists across different styles. In this on-going work we contribute to this…

Information Retrieval · Computer Science 2019-11-13 Andres Ferraro , Dmitry Bogdanov , Xavier Serra , Jason Yoon

Preference-based reinforcement learning (PbRL) bypasses explicit reward engineering by inferring reward functions from human preference comparisons, enabling better alignment with human intentions. However, humans often struggle to label a…

Machine Learning · Computer Science 2025-06-11 Ni Mu , Hao Hu , Xiao Hu , Yiqin Yang , Bo Xu , Qing-Shan Jia

Sequential recommendation methods play a pivotal role in modern recommendation systems. A key challenge lies in accurately modeling user preferences in the face of data sparsity. To tackle this challenge, recent methods leverage contrastive…

Information Retrieval · Computer Science 2024-04-18 Shaowei Wei , Zhengwei Wu , Xin Li , Qintong Wu , Zhiqiang Zhang , Jun Zhou , Lihong Gu , Jinjie Gu