English
Related papers

Related papers: Exploiting Preferences in Loss Functions for Seque…

200 papers

We consider the problem of constructing probabilistic predictions that lead to accurate decisions when employed by downstream users to inform actions. For a single decision maker, designing an optimal predictor is equivalent to minimizing a…

Machine Learning · Computer Science 2025-10-15 Isaac Gibbs , Ryan J. Tibshirani

Recommender systems predict personalized item rankings based on user preference distributions derived from historical behavior data. Recently, diffusion models (DMs) have gained attention in recommendation for their ability to model complex…

Information Retrieval · Computer Science 2025-04-22 Shuo Liu , An Zhang , Guoqing Hu , Hong Qian , Tat-seng Chua

The effectiveness of single-model sequential recommendation architectures, while scalable, is often limited when catering to "power users" in sparse or niche domains. Our previous research, PinnerFormerLite, addressed this by using a fixed…

Machine Learning · Computer Science 2025-10-07 Akshay Mittal , Vinay Venkatesh , Krishna Kandi , Shalini Sudarshan

Most recommender systems optimize the model on observed interaction data, which is affected by the previous exposure mechanism and exhibits many biases like popularity bias. The loss functions, such as the mostly used pointwise Binary…

Information Retrieval · Computer Science 2022-04-27 Qi Wan , Xiangnan He , Xiang Wang , Jiancan Wu , Wei Guo , Ruiming Tang

Relevance and diversity are both important to the success of recommender systems, as they help users to discover from a large pool of items a compact set of candidates that are not only interesting but exploratory as well. The challenge is…

Machine Learning · Computer Science 2020-09-29 Yifang Liu , Zhentao Xu , Qiyuan An , Yang Yi , Yanzhi Wang , Trevor Hastie

Incorrectly labelled training data are frustratingly ubiquitous in both benchmark and specially curated datasets. Such mislabelling clearly adversely affects the performance and generalizability of models trained through supervised learning…

Machine Learning · Computer Science 2025-11-27 Nicholas Pellegrino , David Szczecina , Paul Fieguth

We introduce a new loss function for the weakly-supervised training of semantic image segmentation models based on three guiding principles: to seed with weak localization cues, to expand objects based on the information about which classes…

Computer Vision and Pattern Recognition · Computer Science 2016-08-09 Alexander Kolesnikov , Christoph H. Lampert

Estimating consumer preferences is central to many problems in economics and marketing. This paper develops a flexible framework for learning individual preferences from partial ranking information by interpreting observed rankings as…

Machine Learning · Statistics 2026-02-19 Yu-Chang Chen , Chen Chian Fuh , Shang En Tsai

We address the problem of aggregating an ensemble of predictors with known loss bounds in a semi-supervised binary classification setting, to minimize prediction loss incurred on the unlabeled data. We find the minimax optimal predictions…

Machine Learning · Computer Science 2016-11-08 Akshay Balsubramani , Yoav Freund

Many real-world problems require trading off multiple competing objectives. However, these objectives are often in different units and/or scales, which can make it challenging for practitioners to express numerical preferences over…

Object detection often suffers from a plenty of bootless proposals, selecting high quality proposals remains a great challenge. In this paper, we propose a semantic, class-specific approach to re-rank object proposals, which can…

Computer Vision and Pattern Recognition · Computer Science 2016-05-23 Zhun Zhong , Mingyi Lei , Shaozi Li , Jianping Fan

The recent development of online recommender systems has a focus on collaborative ranking from implicit feedback, such as user clicks and purchases. Different from explicit ratings, which reflect graded user preferences, the implicit…

Information Retrieval · Computer Science 2020-02-25 Chao Wang , Hengshu Zhu , Chen Zhu , Chuan Qin , Hui Xiong

Learning from preference labels plays a crucial role in fine-tuning large language models. There are several distinct approaches for preference fine-tuning, including supervised learning, on-policy reinforcement learning (RL), and…

There has been a growing interest in benchmarking sequential recommendation models and reproducing/improving existing models. For example, Rendle et al. improved matrix factorization models by tuning their parameters and hyperparameters.…

Information Retrieval · Computer Science 2023-05-23 Fangyu Li , Shenbao Yu , Feng Zeng , Fang Yang

In hierarchical multi-label classification, a persistent challenge is enabling model predictions to reach deeper levels of the hierarchy for more detailed or fine-grained classifications. This difficulty partly arises from the natural…

Machine Learning · Computer Science 2026-02-10 Isaac Xu , Martin Gillis , Ayushi Sharma , Benjamin Misiuk , Craig J. Brown , Thomas Trappenberg

Well-calibrated predictions of user preferences are essential for many applications. Since recommender systems typically select the top-N items for users, calibration for those top-N items, rather than for all items, is important. We show…

Information Retrieval · Computer Science 2024-08-22 Masahiro Sato

This work presents a new strategy for multi-class classification that requires no class-specific labels, but instead leverages pairwise similarity between examples, which is a weaker form of annotation. The proposed method, meta…

Machine Learning · Computer Science 2019-01-04 Yen-Chang Hsu , Zhaoyang Lv , Joel Schlosser , Phillip Odom , Zsolt Kira

Learning reward models from pairwise comparisons is a fundamental component in a number of domains, including autonomous control, conversational agents, and recommendation systems, as part of a broad goal of aligning automated decisions…

Machine Learning · Computer Science 2024-10-10 Junlin Wu , Jiongxiao Wang , Chaowei Xiao , Chenguang Wang , Ning Zhang , Yevgeniy Vorobeychik

Recommender systems (RecSys) have been well developed to assist user decision making. Traditional RecSys usually optimize a single objective (e.g., rating prediction errors or ranking quality) in the model. There is an emerging demand in…

Information Retrieval · Computer Science 2023-06-13 Yong Zheng , David , Wang

Current alignment pipelines presume a single, universal notion of desirable behavior. However, human preferences often diverge across users, contexts, and cultures. As a result, disagreement collapses into the majority signal and minority…

Machine Learning · Computer Science 2025-06-10 Daniel Halpern , Evi Micha , Ariel D. Procaccia , Itai Shapira