English
Related papers

Related papers: Ranking Under Uncertainty

200 papers

We consider the problem of search through comparisons, where a user is presented with two candidate objects and reveals which is closer to her intended target. We study adaptive strategies for finding the target, that require knowledge of…

Machine Learning · Computer Science 2012-06-22 Amin Karbasi , Stratis Ioannidis , laurent Massoulie

Many applications motivate the distance measure between rankings, such as comparing top-k lists and rank aggregation for voting, and intrigue great interest to researchers. For example, for a search engine, the use of different ranking…

Discrete Mathematics · Computer Science 2012-07-17 Jianwen Chen , Yiping Li , Ling Feng

Search engines answer users' queries by listing relevant items (e.g. documents, songs, products, web pages, ...). These engines rely on algorithms that learn to rank items so as to present an ordered list maximizing the probability that it…

Machine Learning · Computer Science 2021-09-14 Stefan Magureanu , Alexandre Proutiere , Marcus Isaksson , Boxun Zhang

We address the problem of learning a ranking by using adaptively chosen pairwise comparisons. Our goal is to recover the ranking accurately but to sample the comparisons sparingly. If all comparison outcomes are consistent with the ranking,…

Machine Learning · Statistics 2017-06-16 Lucas Maystre , Matthias Grossglauser

In this paper we suggest a new algorithm for determination of signal-to-noise ratio (SNR). SNR is a quantitative measure widely used in science and engineering. Generally, methods for determination of SNR are based on using of…

Data Analysis, Statistics and Probability · Physics 2016-09-30 Z. Zh. Zhanabaev , S. N. Akhtanov , E. T. Kozhagulov , B. A Karibayev

Evaluating performance across optimization algorithms on many problems presents a complex challenge due to the diversity of numerical scales involved. Traditional data processing methods, such as hypothesis testing and Bayesian inference,…

Optimization and Control · Mathematics 2024-09-10 Yunpeng Jinng , Qunfeng Liu

The existing methods for image search reranking suffer from the unfaithfulness of the assumptions under which the text-based images search result. The resulting images contain more irrelevant images. Hence the re ranking concept arises to…

Information Retrieval · Computer Science 2014-02-11 V Rajakumar , Vipeen V Bopche

Crowdsourcing systems aggregate decisions of many people to help users quickly identify high-quality options, such as the best answers to questions or interesting news stories. A long-standing issue in crowdsourcing is how option quality…

Social and Information Networks · Computer Science 2020-10-28 Keith Burghardt , Tad Hogg , Raissa M. D'Souza , Kristina Lerman , Marton Posfai

We explore the fundamental problem of sorting through the lens of learning-augmented algorithms, where algorithms can leverage possibly erroneous predictions to improve their efficiency. We consider two different settings: In the first…

Data Structures and Algorithms · Computer Science 2023-11-03 Xingjian Bai , Christian Coester

We consider an online learning to rank setting in which, at each round, an oblivious adversary generates a list of $m$ documents, pertaining to a query, and the learner produces scores to rank the documents. The adversary then generates a…

Machine Learning · Computer Science 2016-08-24 Sougata Chaudhuri , Ambuj Tewari

We introduce a method based on Conformal Prediction (CP) to quantify the uncertainty of full ranking algorithms. We focus on a specific scenario where $n+m$ items are to be ranked by some ``black box'' algorithm. It is assumed that the…

Machine Learning · Computer Science 2025-12-04 Jean-Baptiste Fermanian , Pierre Humbert , Gilles Blanchard

Rankings of people and items are at the heart of selection-making, match-making, and recommender systems, ranging from employment sites to sharing economy platforms. As ranking positions influence the amount of attention the ranked subjects…

Information Retrieval · Computer Science 2018-05-07 Asia J. Biega , Krishna P. Gummadi , Gerhard Weikum

User-generated reviews serve as crucial references in shopper's decision-making process. Moreover, they improve product sales and validate the reputation of the website as a whole. Thus, it becomes important to design reviews ranking…

Information Retrieval · Computer Science 2020-09-08 Akhil Sai Peddireddy

We introduce an ordinate method for noisy data analysis, based solely on rank information and thus insensitive to outliers. The method is nonparametric, objective, and the required data processing is parsimonious. Main ingredients are a…

Data Analysis, Statistics and Probability · Physics 2019-09-11 Glenn Ierley , Alex Kostinski

Assessing the blurriness of an object image is fundamentally important to improve the performance for object recognition and retrieval. The main challenge lies in the lack of abundant images with reliable labels and effective learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Qiang Li , Zhaoliang Yao , Jingjing Wang , Ye Tian , Pengju Yang , Di Xie , Shiliang Pu

Rank estimation is a classical model order selection problem that arises in a variety of important statistical signal and array processing systems, yet is addressed relatively infrequently in the extant literature. Here we present sample…

Methodology · Statistics 2011-08-25 Patrick O. Perry , Patrick J. Wolfe

Quantitative characterizations and estimations of uncertainty are of fundamental importance in optimization and decision-making processes. Herein, we propose intuitive scores, which we call certainty and doubt, that can be used in both a…

Ranking a set of objects involves establishing an order allowing for comparisons between any pair of objects in the set. Oftentimes, due to the unavailability of a ground truth of ranked orders, researchers resort to obtaining judgments…

Machine Learning · Statistics 2016-12-19 Rahul Gupta , Shrikanth Narayanan

We propose a new data mining approach in ranking documents based on the concept of cone-based generalized inequalities between vectors. A partial ordering between two vectors is made with respect to a proper cone and thus learning the…

Machine Learning · Computer Science 2012-06-21 Truyen T. Tran , Duc Son Pham

Attribution and fact verification are critical challenges in natural language processing for assessing information reliability. While automated systems and Large Language Models (LLMs) aim to retrieve and select concise evidence to support…

Computation and Language · Computer Science 2026-01-30 Guy Alt , Eran Hirsch , Serwar Basch , Ido Dagan , Oren Glickman