English
Related papers

Related papers: Exploiting Negative Preference in Content-based Mu…

200 papers

Reinforcement Learning from Human Feedback (RLHF) has emerged as a popular paradigm for aligning models with human intent. Typically RLHF algorithms operate in two phases: first, use human preferences to learn a reward function and second,…

Machine Learning · Computer Science 2024-05-01 Joey Hejna , Rafael Rafailov , Harshit Sikchi , Chelsea Finn , Scott Niekum , W. Bradley Knox , Dorsa Sadigh

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

Personalized outfit recommendation has recently been in the spotlight with the rapid growth of the online fashion industry. However, recommending outfits has two significant challenges that should be addressed. The first challenge is that…

Information Retrieval · Computer Science 2021-10-14 Seongjae Kim , Jinseok Seol , Holim Lim , Sang-goo Lee

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

Information Retrieval · Computer Science 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

Recommender systems guide users through vast amounts of information by suggesting items based on their predicted preferences. Collaborative filtering-based deep learning techniques have regained popularity due to their straightforward…

Machine Learning · Computer Science 2024-09-11 Makbule Gulcin Ozsoy

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

Convolutional Neural Networks (CNNs) provide excellent performance when used for image classification. The classical method of training CNNs is by labeling images in a supervised manner as in "input image belongs to this label" (Positive…

Machine Learning · Computer Science 2019-08-21 Youngdong Kim , Junho Yim , Juseung Yun , Junmo Kim

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Recent works of music representation learning mainly focus on learning acoustic music representations with unlabeled audios or further attempt to acquire multi-modal music representations with scarce annotated audio-text pairs. They either…

Sound · Computer Science 2025-05-30 Xiaofeng Pan , Jing Chen , Haitong Zhang , Menglin Xing , Jiayi Wei , Xuefeng Mu , Zhongqian Xie

Sequential recommenders have been widely used in industry due to their strength in modeling user preferences. While these models excel at learning a user's positive interests, less attention has been paid to learning from negative user…

Learning from preference labels plays a crucial role in fine-tuning large language models. There are several distinct approaches for preference fine-tuning, including supervised learning, on-policy reinforcement learning (RL), and…

Neural ranking models (NRMs) have become one of the most important techniques in information retrieval (IR). Due to the limitation of relevance labels, the training of NRMs heavily relies on negative sampling over unlabeled data. In general…

Information Retrieval · Computer Science 2022-09-13 Yinqiong Cai , Jiafeng Guo , Yixing Fan , Qingyao Ai , Ruqing Zhang , Xueqi Cheng

Recent empirical results have demonstrated that training large language models (LLMs) with negative-only feedback can match or exceed standard reinforcement learning from human feedback (RLHF). Negative Sample Reinforcement achieves parity…

Artificial Intelligence · Computer Science 2026-03-18 Quan Cheng

Recommender systems and search are both indispensable in facilitating personalization and ease of browsing in online fashion platforms. However, the two tools often operate independently, failing to combine the strengths of recommender…

Information Retrieval · Computer Science 2022-07-26 Karin Sevegnani , Arjun Seshadri , Tian Wang , Anurag Beniwal , Julian McAuley , Alan Lu , Gerard Medioni

In recommender systems, popularity and conformity biases undermine recommender effectiveness by disproportionately favouring popular items, leading to their over-representation in recommendation lists and causing an unbalanced distribution…

Information Retrieval · Computer Science 2024-08-20 Zhirong Huang , Shichao Zhang , Debo Cheng , Jiuyong Li , Lin Liu , Guixian Zhang

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

Machine Learning · Computer Science 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling…

Information Retrieval · Computer Science 2022-05-10 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Lizhen Cui , Quoc Viet Hung Nguyen

Content creators often use music to enhance their videos, from soundtracks in movies to background music in video blogs and social media content. However, identifying the best music for a video can be a difficult and time-consuming task. To…

Multimedia · Computer Science 2024-12-24 Shanti Stewart , Gouthaman KV , Lie Lu , Andrea Fanelli

A well-designed recommender system can accurately capture the attributes of users and items, reflecting the unique preferences of individuals. Traditional recommendation techniques usually focus on modeling the singular type of behaviors…

Information Retrieval · Computer Science 2023-03-06 Hongrui Xuan , Yi Liu , Bohan Li , Hongzhi Yin