English
Related papers

Related papers: Ranking Abuse via Strategic Pairwise Data Perturba…

200 papers

In this paper, we propose a listwise approach for constructing user-specific rankings in recommendation systems in a collaborative fashion. We contrast the listwise approach to previous pointwise and pairwise approaches, which are based on…

Machine Learning · Statistics 2019-02-08 Liwei Wu , Cho-Jui Hsieh , James Sharpnack

We consider the problem of top-k subset selection in Dueling Bandit problems with score information. Real-world pairwise ranking problems often exhibit a high degree of transitivity and prior work has suggested sampling methods that exploit…

Machine Learning · Computer Science 2021-01-01 Matthew Groves , Juergen Branke

The rating of items based on pairwise comparisons has been a topic of statistical investigation for many decades. Numerous approaches have been proposed. One of the best known is the Bradley-Terry model. This paper seeks to assemble and…

Statistics Theory · Mathematics 2025-08-08 Ian Hamilton , Nick Tawn , David Firth

Ranking and comparing items is crucial for collecting information about preferences in many areas, from marketing to politics. The Mallows rank model is among the most successful approaches to analyse rank data, but its computational…

Methodology · Statistics 2017-04-28 Valeria Vitelli , Øystein Sørensen , Marta Crispino , Arnoldo Frigessi , Elja Arjas

Recently, Multi-Scenario Learning (MSL) is widely used in recommendation and retrieval systems in the industry because it facilitates transfer learning from different scenarios, mitigating data sparsity and reducing maintenance cost. These…

Information Retrieval · Computer Science 2023-06-30 Yu Tian , Bofang Li , Si Chen , Xubin Li , Hongbo Deng , Jian Xu , Bo Zheng , Qian Wang , Chenliang Li

Evaluating the pedagogical quality of AI tutors remains challenging: standard NLG metrics do not determine whether responses identify mistakes, scaffold reasoning, or avoid revealing the answers. For the task of mistake remediation, we…

Computation and Language · Computer Science 2026-03-26 Kseniia Petukhova , Ekaterina Kochmar

Reinforcement Learning (RL) has achieved remarkable success in sequential decision tasks. However, recent studies have revealed the vulnerability of RL policies to different perturbations, raising concerns about their effectiveness and…

Machine Learning · Computer Science 2025-07-08 Buqing Nie , Yangqing Fu , Jingtian Ji , Yue Gao

Strategic classification studies the design of a classifier robust to the manipulation of input by strategic individuals. However, the existing literature does not consider the effect of competition among individuals as induced by the…

Computer Science and Game Theory · Computer Science 2022-02-23 Lydia T. Liu , Nikhil Garg , Christian Borgs

In the celebrated stable-matching problem, there are two sets of agents M and W, and the members of M only have preferences over the members of W and vice versa. It is usually assumed that each member of M and W is a single entity. However,…

Computer Science and Game Theory · Computer Science 2024-08-21 Leora Schmerler , Noam Hazon , Sarit Kraus

Success in modeling complex phenomena such as human perception hinges critically on the availability of data and computational power. Significant progress has been made in modeling such phenomena using probabilistic methods, particularly in…

Data Analysis, Statistics and Probability · Physics 2019-02-20 Danh-Tai Hoang , Juyong Song , Vipul Periwal , Junghyo Jo

Large Language Models (LLMs) are increasingly used in applications where the model selects from competing third-party content, such as in LLM-powered search engines or chatbot plugins. In this paper, we introduce Preference Manipulation…

Cryptography and Security · Computer Science 2024-07-03 Fredrik Nestaas , Edoardo Debenedetti , Florian Tramèr

Large language models (LLMs) are increasingly used as judges to replace costly human preference labels in pairwise evaluation. Despite their practicality, LLM judges remain prone to miscalibration and systematic biases. This paper proposes…

Computation and Language · Computer Science 2026-02-20 Sher Badshah , Ali Emami , Hassan Sajjad

As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual…

Machine Learning · Computer Science 2025-12-02 Dereck Piche , Mohammed Muqeeth , Milad Aghajohari , Juan Duque , Michael Noukhovitch , Aaron Courville

Pairwise comparison data arises in many domains, including tournament rankings, web search, and preference elicitation. Given noisy comparisons of a fixed subset of pairs of items, we study the problem of estimating the underlying…

Machine Learning · Computer Science 2017-07-20 Ashwin Pananjady , Cheng Mao , Vidya Muthukumar , Martin J. Wainwright , Thomas A. Courtade

We consider the problem of selecting confounders for adjustment from a potentially large set of covariates, when estimating a causal effect. Recently, the high-dimensional Propensity Score (hdPS) method was developed for this task; hdPS…

Methodology · Statistics 2021-12-17 Asad Haris , Robert Platt

News recommendation is a challenging task that involves personalization based on the interaction history and preferences of each user. Recent works have leveraged the power of pretrained language models (PLMs) to directly rank news items by…

Information Retrieval · Computer Science 2024-09-27 Nithish Kannen , Yao Ma , Gerrit J. J. van den Burg , Jean Baptiste Faddoul

In multi-domain learning (MDL) scenarios, high labeling effort is required due to the complexity of collecting data from various domains. Active Learning (AL) presents an encouraging solution to this issue by annotating a smaller number of…

Machine Learning · Computer Science 2023-06-21 Rui He , Zeyu Dai , Shan He , Ke Tang

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

We propose a topic modeling approach to the prediction of preferences in pairwise comparisons. We develop a new generative model for pairwise comparisons that accounts for multiple shared latent rankings that are prevalent in a population…

Machine Learning · Computer Science 2015-01-27 Weicong Ding , Prakash Ishwar , Venkatesh Saligrama

Many applications such as recommendation systems or sports tournaments involve pairwise comparisons within a collection of $n$ items, the goal being to aggregate the binary outcomes of the comparisons in order to recover the latent strength…

Statistics Theory · Mathematics 2023-07-13 Eglantine Karlé , Hemant Tyagi