English
Related papers

Related papers: Online Learning to Rank with Top-k Feedback

200 papers

Ranking temporal data has not been studied until recently, even though ranking is an important operator (being promoted as a firstclass citizen) in database systems. However, only the instant top-k queries on temporal data were studied in,…

Databases · Computer Science 2012-08-02 Jeffrey Jestes , Jeff M. Phillips , Feifei Li , Mingwang Tang

Consider a binary classification problem in which the learner is given a labeled training set, an unlabeled test set, and is restricted to choosing exactly $k$ test points to output as positive predictions. Problems of this kind---{\it…

Machine Learning · Computer Science 2015-10-21 Li-Ping Liu , Thomas G. Dietterich , Nan Li , Zhi-Hua Zhou

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

Machine Learning · Computer Science 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

This paper addresses online learning with ``corrupted'' feedback. Our learner is provided with potentially corrupted gradients $\tilde g_t$ instead of the ``true'' gradients $g_t$. We make no assumptions about how the corruptions arise:…

Machine Learning · Computer Science 2025-06-17 Jiujia Zhang , Ashok Cutkosky

We consider the problem of online multiclass classification with partial feedback, where an algorithm predicts a class for a new instance in each round and only receives its correctness. Although several methods have been developed for this…

Machine Learning · Computer Science 2019-02-05 Takuo Kaneko , Issei Sato , Masashi Sugiyama

We consider the problem of sequential evaluation, in which an evaluator observes candidates in a sequence and assigns scores to these candidates in an online, irrevocable fashion. Motivated by the psychology literature that has studied…

Machine Learning · Statistics 2023-11-20 Jingyan Wang , Ashwin Pananjady

In the online (time-series) search problem, a player is presented with a sequence of prices which are revealed in an online manner. In the standard definition of the problem, for each revealed price, the player must decide irrevocably…

Data Structures and Algorithms · Computer Science 2021-12-06 Spyros Angelopoulos , Shahin Kamali , Dehou Zhang

While implicit feedback (e.g., clicks, dwell times, etc.) is an abundant and attractive source of data for learning to rank, it can produce unfair ranking policies for both exogenous and endogenous reasons. Exogenous reasons typically…

Machine Learning · Computer Science 2021-05-11 Himank Yadav , Zhengxiao Du , Thorsten Joachims

Clinicians need ranking systems that work in real time and still justify their choices. Motivated by the need for a low-latency, decoder-based reranker, we present OG-Rank, a single-decoder approach that pairs a pooled first-token scoring…

Artificial Intelligence · Computer Science 2025-10-21 Praphul Singh , Corey Barrett , Sumana Srivasta , Irfan Bulu , Sri Gadde , Krishnaram Kenthapadi

Recommender systems play an essential role in the choices people make in domains such as entertainment, shopping, food, news, employment, and education. The machine learning models underlying these recommender systems are often enormously…

Information Retrieval · Computer Science 2023-08-30 Sahil Verma , Ashudeep Singh , Varich Boonsanong , John P. Dickerson , Chirag Shah

Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is…

Information Retrieval · Computer Science 2021-02-22 Tao Yang , Qingyao Ai

We present the Learned Ranking Function (LRF), a system that takes short-term user-item behavior predictions as input and outputs a slate of recommendations that directly optimizes for long-term user satisfaction. Most previous work is…

Machine Learning · Computer Science 2024-08-14 Yi Wu , Daryl Chang , Jennifer She , Zhe Zhao , Li Wei , Lukasz Heldt

User-generated reviews serve as crucial references in shopper's decision-making process. Moreover, they improve product sales and validate the reputation of the website as a whole. Thus, it becomes important to design reviews ranking…

Information Retrieval · Computer Science 2020-09-08 Akhil Sai Peddireddy

The feedback that users provide through their choices (e.g., clicks, purchases) is one of the most common types of data readily available for training search and recommendation algorithms. However, myopically training systems based on…

Information Retrieval · Computer Science 2024-01-09 Kianté Brantley , Zhichong Fang , Sarah Dean , Thorsten Joachims

We consider an online learning problem with one-sided feedback, in which the learner is able to observe the true label only for positively predicted instances. On each round, $k$ instances arrive and receive classification outcomes…

Machine Learning · Computer Science 2022-06-10 Yahav Bechavod , Aaron Roth

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

Online Learning to Rank (OLTR) optimises ranking models using implicit user feedback, such as clicks. Unlike traditional Learning to Rank (LTR) methods that rely on a static set of training data with relevance judgements to learn a ranking…

Machine Learning · Computer Science 2024-12-30 Shuyi Wang

We consider online learning problems where the aim is to achieve regret which is efficient in the sense that it is the same order as the lowest regret amongst K experts. This is a substantially stronger requirement that achieving…

Machine Learning · Computer Science 2019-11-12 Daron Anderson , Douglas J. Leith

In this paper, we explore and evaluate the use of ranking-based objective functions for learning simultaneously a word string and a word image encoder. We consider retrieval frameworks in which the user expects a retrieval list ranked…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Pau Riba , Adrià Molina , Lluis Gomez , Oriol Ramos-Terrades , Josep Lladós