English
Related papers

Related papers: Contextual Search in the Presence of Adversarial C…

200 papers

The query suggestion or auto-completion mechanisms help users to type less while interacting with a search engine. A basic approach that ranks suggestions according to their frequency in the query logs is suboptimal. Firstly, many candidate…

Information Retrieval · Computer Science 2013-12-06 Eugene Kharitonov , Craig Macdonald , Pavel Serdyukov , Iadh Ounis

Contextual bandit algorithms often estimate reward models to inform decision-making. However, true rewards can contain action-independent redundancies that are not relevant for decision-making. We show it is more data-efficient to estimate…

Machine Learning · Computer Science 2023-02-27 Aldo Gael Carranza , Sanath Kumar Krishnamurthy , Susan Athey

This paper considers a contextual bandit problem involving multiple agents, where a learner sequentially observes the contexts and the agent's reported arms, and then selects the arm that maximizes the system's overall reward. Existing work…

Machine Learning · Computer Science 2025-05-30 Arun Verma , Indrajit Saha , Makoto Yokoo , Bryan Kian Hsiang Low

The generation of feasible adversarial examples is necessary for properly assessing models that work in constrained feature space. However, it remains a challenging task to enforce constraints into attacks that were designed for computer…

Artificial Intelligence · Computer Science 2022-05-04 Thibault Simonetto , Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy , Yves Le Traon

In this work we explore the intersection fairness and robustness in the context of ranking: when a ranking model has been calibrated to achieve some definition of fairness, is it possible for an external adversary to make the ranking model…

Machine Learning · Computer Science 2022-05-10 Avijit Ghosh , Matthew Jagielski , Christo Wilson

Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for parallel…

Machine Learning · Statistics 2023-02-07 Jeffrey Chan , Aldo Pacchiano , Nilesh Tripuraneni , Yun S. Song , Peter Bartlett , Michael I. Jordan

Contextual bandit algorithms are extremely popular and widely used in recommendation systems to provide online personalised recommendations. A recurrent assumption is the stationarity of the reward function, which is rather unrealistic in…

Machine Learning · Statistics 2020-04-29 Giuseppe Di Benedetto , Vito Bellini , Giovanni Zappella

Conjoint analysis, an application of factorial experimental design, is a popular tool in social science research for studying multidimensional preferences. In such political analysis experiments, respondents are often asked to choose…

Methodology · Statistics 2025-05-06 Connor T. Jerzak , Priyanshi Chandra , Rishi Hazra

Estimating causal interactions in complex dynamical systems is an important problem encountered in many fields of current science. While a theoretical solution for detecting the causal interactions has been previously formulated in the…

Data Analysis, Statistics and Probability · Physics 2020-01-20 Jakub Kořenek , Jaroslav Hlinka

Many approaches for optimizing decision making models rely on gradient based methods requiring informative feedback from the environment. However, in the case where such feedback is sparse or uninformative, such approaches may result in…

Machine Learning · Computer Science 2024-11-12 Mohit Rajpal , Lac Gia Tran , Yehong Zhang , Bryan Kian Hsiang Low

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

In Web retrieval, there are many cases of competition between authors of Web documents: their incentive is to have their documents highly ranked for queries of interest. As such, the Web is a prominent example of a competitive search…

Information Retrieval · Computer Science 2025-01-28 Tommy Mordo , Itamar Reinman , Moshe Tennenholtz , Oren Kurland

We study the problem of multi-agent multi-armed bandits with adversarial corruption in a heterogeneous setting, where each agent accesses a subset of arms. The adversary can corrupt the reward observations for all agents. Agents share these…

Machine Learning · Computer Science 2024-11-14 Fatemeh Ghaffari , Xuchuang Wang , Jinhang Zuo , Mohammad Hajiesmaili

We introduce a framework for comparing the privacy of different mechanisms. A mechanism designer employs a dynamic protocol to elicit agents' private information. Protocols produce a set of contextual privacy violations -- information…

Theoretical Economics · Economics 2025-12-29 Andreas Haupt , Zoë Hitzig

We propose an adversarial contextual model for detecting moving objects in images. A deep neural network is trained to predict the optical flow in a region using information from everywhere else but that region (context), while another…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Yanchao Yang , Antonio Loquercio , Davide Scaramuzza , Stefano Soatto

We study a generalization of the problem of online learning in adversarial linear contextual bandits by incorporating loss functions that belong to a reproducing kernel Hilbert space, which allows for a more flexible modeling of complex…

Machine Learning · Statistics 2023-10-04 Gergely Neu , Julia Olkhovskaya , Sattar Vakili

Model selection in supervised learning provides costless guarantees as if the model that best balances bias and variance was known a priori. We study the feasibility of similar guarantees for cumulative regret minimization in the stochastic…

Machine Learning · Computer Science 2023-10-25 Sanath Kumar Krishnamurthy , Adrienne Margaret Propp , Susan Athey

We study contextual bandits in the presence of a stage-wise constraint when the constraint must be satisfied both with high probability and in expectation. We start with the linear case where both the reward function and the stage-wise…

Machine Learning · Computer Science 2025-08-22 Aldo Pacchiano , Mohammad Ghavamzadeh , Peter Bartlett

In recent years, preference-based human feedback mechanisms have become essential for enhancing model performance across diverse applications, including conversational AI systems such as ChatGPT. However, existing approaches often neglect…

Artificial Intelligence · Computer Science 2025-02-14 Raihan Seraj , Lili Meng , Tristan Sylvain

Causal discovery from data with unmeasured confounding factors is a challenging problem. This paper proposes an approach based on the f-GAN framework, learning the binary causal structure independent of specific weight values. We…

Machine Learning · Computer Science 2026-01-06 Mujin Zhou , Junzhe Zhang