English
Related papers

Related papers: On Sampling Top-K Recommendation Evaluation

200 papers

Sampling is ubiquitous in machine learning methodologies. Due to the growth of large datasets and model complexity, we want to learn and adapt the sampling process while training a representation. Towards achieving this grand goal, a…

Machine Learning · Computer Science 2022-12-14 Jason Xiaotian Dou , Alvin Qingkai Pan , Runxue Bao , Haiyi Harry Mao , Lei Luo , Zhi-Hong Mao

Feature importance scores are ubiquitous tools for understanding the predictions of machine learning models. However, many popular attribution methods suffer from high instability due to random sampling. Leveraging novel ideas from…

Machine Learning · Statistics 2025-07-08 Jeremy Goldwasser , Giles Hooker

Learning-to-rank techniques have proven to be extremely useful for prioritization problems, where we rank items in order of their estimated probabilities, and dedicate our limited resources to the top-ranked items. This work exposes a…

Machine Learning · Statistics 2018-02-22 Cynthia Rudin , Yining Wang

Recommendation systems (RS) aim to retrieve the top-K items most relevant to users, with metrics such as Precision@K and Recall@K commonly used to assess effectiveness. The architecture of an RS model acts as an inductive bias, shaping the…

Information Retrieval · Computer Science 2026-01-27 Sirui Chen , Jiawei Chen , Canghong Jin , Sheng Zhou , Jingbang Chen , Wujie Sun , Can Wang

Best-of-N (BoN) sampling is a widely used inference-time alignment method for language models, whereby N candidate responses are sampled from a reference model and the one with the highest predicted reward according to a learned reward…

Machine Learning · Computer Science 2026-03-09 Ved Sriraman , Adam Block

We study the top-$K$ ranking problem where the goal is to recover the set of top-$K$ ranked items out of a large collection of items based on partially revealed preferences. We consider an adversarial crowdsourced setting where there are…

Information Retrieval · Computer Science 2016-02-16 Changho Suh , Vincent Y. F. Tan , Renbo Zhao

Online food ordering marketplaces are multi-stakeholder systems where recommendations impact the experience and growth of each participant in the system. A recommender system in this setting has to encapsulate the objectives and constraints…

Machine Learning · Computer Science 2020-08-25 Abhay Shukla , Jairaj Sathyanarayana , Dipyaman Banerjee

Selecting a subset of the $k$ "best" items from a dataset of $n$ items, based on a scoring function, is a key task in decision-making. Given the rise of automated decision-making software, it is important that the outcome of this process,…

Databases · Computer Science 2026-03-31 Guangya Cai

In classification problems, sampling bias between training data and testing data is critical to the ranking performance of classification scores. Such bias can be both unintentionally introduced by data collection and intentionally…

Methodology · Statistics 2017-11-02 Chandler Zuo

We introduce the problem of ranking with slot constraints, which can be used to model a wide range of application problems -- from college admission with limited slots for different majors, to composing a stratified cohort of eligible…

Information Retrieval · Computer Science 2023-10-30 Wentao Guo , Andrew Wang , Bradon Thymes , Thorsten Joachims

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

Information Retrieval · Computer Science 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

We consider the Top-$K$ selection problem, which aims to identify the largest $K$ elements in an array. Top-$K$ selection arises in many machine learning algorithms and often becomes a bottleneck on accelerators, which are optimized for…

Machine Learning · Computer Science 2026-05-14 Yashas Samaga , Varun Yerram , Spandana Raj Babbula , Prateek Jain , Praneeth Netrapalli

Bike sharing provides an environment-friendly way for traveling and is booming all over the world. Yet, due to the high similarity of user travel patterns, the bike imbalance problem constantly occurs, especially for dockless bike sharing…

Artificial Intelligence · Computer Science 2018-12-04 Ling Pan , Qingpeng Cai , Zhixuan Fang , Pingzhong Tang , Longbo Huang

In recent years, deep learning has gained an indisputable success in computer vision, speech recognition, and natural language processing. After its rising success on these challenging areas, it has been studied on recommender systems as…

Information Retrieval · Computer Science 2019-10-01 Ezgi Yıldırım , Payam Azad , Şule Gündüz Öğüdücü

Reinforcement Learning (RL) has shown promise for aligning Large Language Models (LLMs) to follow instructions with various constraints. Despite the encouraging results, RL improvement inevitably relies on sampling successful, high-quality…

Artificial Intelligence · Computer Science 2025-12-30 Kongcheng Zhang , Qi Yao , Shunyu Liu , Wenjian Zhang , Min Cen , Yang Zhou , Wenkai Fang , Yiru Zhao , Baisheng Lai , Mingli Song

Collecting the most informative data from a large dataset distributed over a network is a fundamental problem in many fields, including control, signal processing and machine learning. In this paper, we establish a connection between…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Xu Zhang , Marcos M. Vasconcelos

At the present time, sequential item recommendation models are compared by calculating metrics on a small item subset (target set) to speed up computation. The target set contains the relevant item and a set of negative items that are…

Information Retrieval · Computer Science 2021-07-29 Alexander Dallmann , Daniel Zoller , Andreas Hotho

Deep reinforcement learning (DRL) has significantly advanced the field of combinatorial optimization (CO). However, its practicality is hindered by the necessity for a large number of reward evaluations, especially in scenarios involving…

Machine Learning · Computer Science 2024-07-18 Hyeonah Kim , Minsu Kim , Sungsoo Ahn , Jinkyoo Park

This paper targets to a novel but practical recommendation problem named exact-K recommendation. It is different from traditional top-K recommendation, as it focuses more on (constrained) combinatorial optimization which will optimize to…

Information Retrieval · Computer Science 2019-05-20 Yu Gong , Yu Zhu , Lu Duan , Qingwen Liu , Ziyu Guan , Fei Sun , Wenwu Ou , Kenny Q. Zhu

We study the approximation of a square-integrable function from a finite number of evaluations on a random set of nodes according to a well-chosen distribution. This is particularly relevant when the function is assumed to belong to a…

Machine Learning · Statistics 2024-11-13 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais