English
Related papers

Related papers: On Sampling Top-K Recommendation Evaluation

200 papers

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

We consider the problem of determining the top-$k$ largest measurements from a dataset distributed among a network of $n$ agents with noisy communication links. We show that this scenario can be cast as a distributed convex optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-02 Xu Zhang , Marcos Vasconcelos

In the realm of recommender systems (RS), Top-$K$ ranking metrics such as NDCG@$K$ are the gold standard for evaluating recommendation performance. However, during the training of recommendation models, optimizing NDCG@$K$ poses significant…

Information Retrieval · Computer Science 2025-08-11 Weiqin Yang , Jiawei Chen , Shengjia Zhang , Peng Wu , Yuegang Sun , Yan Feng , Chun Chen , Can Wang

Many complex multi-target prediction problems that concern large target spaces are characterised by a need for efficient prediction strategies that avoid the computation of predictions for all targets explicitly. Examples of such problems…

Information Retrieval · Computer Science 2018-03-06 Michiel Stock , Krzysztof Dembczynski , Bernard De Baets , Willem Waegeman

We consider the sorted top-$k$ problem whose goal is to recover the top-$k$ items with the correct order out of $n$ items using pairwise comparisons. In many applications, multiple rounds of interaction can be costly. We restrict our…

Data Structures and Algorithms · Computer Science 2019-06-13 Mark Braverman , Jieming Mao , Yuval Peres

Retrieve-and-rerank is a prevalent framework in neural information retrieval, wherein a bi-encoder network initially retrieves a pre-defined number of candidates (e.g., K=100), which are then reranked by a more powerful cross-encoder model.…

Information Retrieval · Computer Science 2024-05-29 Revanth Gangi Reddy , Pradeep Dasigi , Md Arafat Sultan , Arman Cohan , Avirup Sil , Heng Ji , Hannaneh Hajishirzi

Fairness has emerged as a formidable challenge in data-driven decisions. Many of the data problems, such as creating compact data summaries for approximate query processing, can be effectively tackled using concepts from computational…

Data Structures and Algorithms · Computer Science 2025-07-14 Mohsen Dehghankar , Stavros Sintos , Abolfazl Asudeh

In this paper, we investigate the recommendation task in the most common scenario with implicit feedback (e.g., clicks, purchases). State-of-the-art methods in this direction usually cast the problem as to learn a personalized ranking on a…

Information Retrieval · Computer Science 2020-12-29 Yan Gao , Jiafeng Guo , Yanyan Lan , Huaming Liao

This paper is concerned with the problem of top-$K$ ranking from pairwise comparisons. Given a collection of $n$ items and a few pairwise comparisons across them, one wishes to identify the set of $K$ items that receive the highest ranks.…

Machine Learning · Statistics 2019-06-13 Yuxin Chen , Jianqing Fan , Cong Ma , Kaizheng Wang

Implicit feedback is frequently used for developing personalized recommendation services due to its ubiquity and accessibility in real-world systems. In order to effectively utilize such information, most research adopts the pairwise…

Information Retrieval · Computer Science 2022-12-20 Haolun Wu , Chen Ma , Yingxue Zhang , Xue Liu , Ruiming Tang , Mark Coates

Recommendation systems usually involve exploiting the relations among known features and content that describe items (content-based filtering) or the overlap of similar users who interacted with or rated the target item (collaborative…

Artificial Intelligence · Computer Science 2016-07-06 Shuo Yang , Mohammed Korayem , Khalifeh AlJadda , Trey Grainger , Sriraam Natarajan

The top-k classification accuracy is one of the core metrics in machine learning. Here, k is conventionally a positive integer, such as 1 or 5, leading to top-1 or top-5 training objectives. In this work, we relax this assumption and…

Machine Learning · Computer Science 2022-06-16 Felix Petersen , Hilde Kuehne , Christian Borgelt , Oliver Deussen

Selecting the best items in a dataset is a common task in data exploration. However, the concept of "best" lies in the eyes of the beholder: different users may consider different attributes more important, and hence arrive at different…

Databases · Computer Science 2023-04-27 Abolfazl Asudeh , Azade Nazi , Nan Zhang , Gautam Das , H. V. Jagadish

Graphs are fundamental data structures and have been employed for centuries to model real-world systems and phenomena. Random walk with restart (RWR) provides a good proximity score between two nodes in a graph, and it has been successfully…

Databases · Computer Science 2012-02-01 Yasuhiro Fujiwara , Makoto Nakatsuji , Makoto Onizuka , Masaru Kitsuregawa

The importance of accurate recommender systems has been widely recognized by academia and industry. However, the recommendation quality is still rather low. Recently, a linear sparse and low-rank representation of the user-item matrix has…

Information Retrieval · Computer Science 2016-02-29 Zhao Kang , Qiang Cheng

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

Patent examiners and inventors face significant pressure to verify the originality and non-obviousness of inventions, and the intricate nature of patent data intensifies the challenges of patent retrieval. Therefore, there is a pressing…

Information Retrieval · Computer Science 2025-07-22 Amna Ali , Liyanage C. De Silva , Pg Emeroylariffion Abas

Known-item search (KIS) involves only a single search target, making relevance feedback-typically a powerful technique for efficiently identifying multiple positive examples to infer user intent-inapplicable. PicHunter addresses this issue…

Information Retrieval · Computer Science 2025-05-22 Zhixin Ma , Chong-Wah Ngo

We propose Top-N-Rank, a novel family of list-wise Learning-to-Rank models for reliably recommending the N top-ranked items. The proposed models optimize a variant of the widely used discounted cumulative gain (DCG) objective function which…

Information Retrieval · Computer Science 2018-12-20 Junjie Liang , Jinlong Hu , Shoubin Dong , Vasant Honavar

We propose a novel way to train ranking models, such as recommender systems, that are both effective and efficient. Knowledge distillation (KD) was shown to be successful in image recognition to achieve both effectiveness and efficiency. We…

Machine Learning · Computer Science 2018-09-21 Jiaxi Tang , Ke Wang