English
Related papers

Related papers: Cold-Start Personalization via Training-Free Prior…

200 papers

Reinforcement learning (RL) with verifiable rewards has recently catalyzed a wave of "MLLM-r1" approaches that bring RL to vision language models. Most representative paradigms begin with a cold start, typically employing supervised…

Machine Learning · Computer Science 2026-02-02 Kun Chen , Peng Shi , Haibo Qiu , Zhixiong Zeng , Siqi Yang , Wenji Mao , Lin Ma

Click-Through Rate (CTR) prediction on cold users is a challenging task in recommender systems. Recent researches have resorted to meta-learning to tackle the cold-user challenge, which either perform few-shot user representation learning…

Information Retrieval · Computer Science 2022-10-31 Yanyan Shen , Lifan Zhao , Weiyu Cheng , Zibin Zhang , Wenwen Zhou , Kangyi Lin

With the global transformation of the fashion industry and a rise in the demand for fashion items worldwide, the need for an effectual fashion recommendation has never been more. Despite various cutting-edge solutions proposed in the past…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Dhruv Verma , Kshitij Gulati , Rajiv Ratn Shah

Reward functions are difficult to design and often hard to align with human intent. Preference-based Reinforcement Learning (RL) algorithms address these problems by learning reward functions from human feedback. However, the majority of…

Machine Learning · Computer Science 2023-11-28 Joey Hejna , Dorsa Sadigh

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

Machine Learning · Computer Science 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Many sequential recommender systems suffer from the cold start problem, where items with few or no interactions cannot be effectively used by the model due to the absence of a trained embedding. Content-based approaches, which leverage item…

Information Retrieval · Computer Science 2025-07-28 Anton Pembek , Artem Fatkulin , Anton Klenitskiy , Alexey Vasilev

Cold-start is a notoriously difficult problem which can occur in recommendation systems, and arises when there is insufficient information to draw inferences for users or items. To address this challenge, a contextual bandit algorithm --…

Machine Learning · Statistics 2021-01-13 Jack R. McKenzie , Peter A. Appleby , Thomas House , Neil Walton

Preference learning from human feedback has the ability to align generative models with the needs of end-users. Human feedback is costly and time-consuming to obtain, which creates demand for data-efficient query selection methods. This…

Machine Learning · Computer Science 2026-02-18 Guy Schacht , Ziyad Sheebaelhamd , Riccardo De Santi , Mojmír Mutný , Andreas Krause

Recommender systems have become fundamental building blocks of modern online products and services, and have a substantial impact on user experience. In the past few years, deep learning methods have attracted a lot of research, and are now…

Information Retrieval · Computer Science 2023-08-17 Davide Buffelli , Ashish Gupta , Agnieszka Strzalka , Vassilis Plachouras

In recommender systems, cold-start issues are situations where no previous events, e.g. ratings, are known for certain users or items. In this paper, we focus on the item cold-start problem. Both content information (e.g. item attributes)…

Information Retrieval · Computer Science 2018-05-24 Yu Zhu , Jinhao Lin , Shibi He , Beidou Wang , Ziyu Guan , Haifeng Liu , Deng Cai

A key distinguishing feature of conversational recommender systems over traditional recommender systems is their ability to elicit user preferences using natural language. Currently, the predominant approach to preference elicitation is to…

Information Retrieval · Computer Science 2025-04-09 Ivica Kostric , Krisztian Balog , Filip Radlinski

Personalizing large language models (LLMs) to individual user preferences is a critical step beyond generating generically helpful responses. However, current personalization methods are ill-suited for new users, as they typically require…

Machine Learning · Computer Science 2025-09-30 Zikun Qu , Min Zhang , Mingze Kong , Xiang Li , Zhiwei Shang , Zhiyong Wang , Yikun Ban , Shuang Qiu , Yao Shu , Zhongxiang Dai

When a new user just signs up on a website, we usually have no information about him/her, i.e. no interaction with items, no user profile and no social links with other users. Under such circumstances, we still expect our recommender…

Information Retrieval · Computer Science 2020-10-28 Yitong Meng , Jie Liu , Xiao Yan , James Cheng

A common challenge for most current recommender systems is the cold-start problem. Due to the lack of user-item interactions, the fine-tuned recommender systems are unable to handle situations with new users or new items. Recently, some…

Information Retrieval · Computer Science 2020-07-08 Manqing Dong , Feng Yuan , Lina Yao , Xiwei Xu , Liming Zhu

With the rise of e-commerce and short videos, online recommender systems that can capture users' interests and update new items in real-time play an increasingly important role. In both online and offline recommendation systems, the…

Information Retrieval · Computer Science 2025-05-07 Yunze Luo , Yuezihan Jiang , Yinjie Jiang , Gaode Chen , Jingchi Wang , Kaigui Bian , Peiyi Li , Qi Zhang

Sequential recommenders have made great strides in capturing a user's preferences. Nevertheless, the cold-start recommendation remains a fundamental challenge as they typically involve limited user-item interactions for personalization.…

Information Retrieval · Computer Science 2023-08-22 Minchang Kim , Yongjin Yang , Jung Hyun Ryu , Taesup Kim

Third-party libraries (TPLs) have become an integral part of modern software development, enhancing developer productivity and accelerating time-to-market. However, identifying suitable candidates from a rapidly growing and continuously…

Software Engineering · Computer Science 2025-04-21 Minh Hoang Vuong , Anh M. T. Bui , Phuong T. Nguyen , Davide Di Ruscio

Large foundation models pretrained on raw web-scale data are not readily deployable without additional step of extensive alignment to human preferences. Such alignment is typically done by collecting large amounts of pairwise comparisons…

Machine Learning · Computer Science 2024-06-13 Daiwei Chen , Yi Chen , Aniket Rege , Ramya Korlakai Vinayak

In this paper, we investigate the problem of offline Preference-based Reinforcement Learning (PbRL) with human feedback where feedback is available in the form of preference between trajectory pairs rather than explicit rewards. Our…

Machine Learning · Computer Science 2023-10-03 Wenhao Zhan , Masatoshi Uehara , Nathan Kallus , Jason D. Lee , Wen Sun

In recommender systems, one common challenge is the cold-start problem, where interactions are very limited for fresh users in the systems. To address this challenge, recently, many works introduce the meta-optimization idea into the…

Information Retrieval · Computer Science 2022-06-13 Tianxin Wei , Jingrui He