English
Related papers

Related papers: Blackwell's Approachability for Sequential Conform…

200 papers

We study multi-objective reinforcement learning (RL) where an agent's reward is represented as a vector. In settings where an agent competes against opponents, its performance is measured by the distance of its average return vector to a…

Machine Learning · Computer Science 2021-02-08 Tiancheng Yu , Yi Tian , Jingzhao Zhang , Suvrit Sra

Blackwell approachability is a framework for reasoning about repeated games with vector-valued payoffs. We introduce predictive Blackwell approachability, where an estimate of the next payoff vector is given, and the decision maker tries to…

Computer Science and Game Theory · Computer Science 2021-03-09 Gabriele Farina , Christian Kroer , Tuomas Sandholm

Omniprediction is a learning problem that requires suboptimality bounds for each of a family of losses $\mathcal{L}$ against a family of comparator predictors $\mathcal{C}$. We initiate the study of omniprediction in a multiclass setting,…

Data Structures and Algorithms · Computer Science 2026-02-20 Lunjia Hu , Kevin Tian , Chutong Yang

We develop methods for forming prediction sets in an online setting where the data generating distribution is allowed to vary over time in an unknown fashion. Our framework builds on ideas from conformal inference to provide a general…

Methodology · Statistics 2021-12-10 Isaac Gibbs , Emmanuel Candès

We provide yet another proof of the existence of calibrated forecasters; it has two merits. First, it is valid for an arbitrary finite number of outcomes. Second, it is short and simple and it follows from a direct application of…

Machine Learning · Statistics 2010-10-05 Shie Mannor , Gilles Stoltz

We study approachability theory in the presence of constraints. Given a repeated game with vector payoffs, we characterize the pairs of sets (A,D) in the payoff space such that Player 1 can guarantee that the long-run average payoff…

Optimization and Control · Mathematics 2017-12-05 Gaëtan Fournier , Eden Kuperwasser , Orin Munk , Eilon Solan , Avishay Weinbaum

Adaptive designs dynamically update treatment probabilities using information accumulated during the experiment. Existing theory for causal inference from adaptive experiments primarily assumes the superpopulation framework with independent…

Methodology · Statistics 2026-02-26 Xinran Li , Anqi Zhao

This paper reframes approachability theory within the context of population games. Thus, whilst one player aims at driving her average payoff to a predefined set, her opponent is not malevolent but rather extracted randomly from a…

Optimization and Control · Mathematics 2014-07-16 Dario Bauso , Thomas W L Norman

Interpretability has arisen as a key desideratum of machine learning models alongside performance. Approaches so far have been primarily concerned with fixed dimensional inputs emphasizing feature relevance or selection. In contrast, we…

Machine Learning · Computer Science 2018-07-03 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola

Admissibility has been studied for games of infinite duration with Boolean objectives. We extend here this study to games of infinite duration with quantitative objectives. First, we show that, un- der the assumption that optimal worst-case…

Logic in Computer Science · Computer Science 2016-11-29 Romain Brenguier , Guillermo A. Pérez , Jean-François Raskin , Ocan Sankur

This paper introduces the first theoretical framework for quantifying the efficiency and performance gain opportunity size of adaptive inference algorithms. We provide new approximate and exact bounds for the achievable efficiency and…

Machine Learning · Computer Science 2024-02-08 Soheil Hor , Ying Qian , Mert Pilanci , Amin Arbabian

Blackwell's celebrated approachability theory provides a general framework for a variety of learning problems, including regret minimization. However, Blackwell's proof and implicit algorithm measure approachability using the $\ell_2$…

Machine Learning · Computer Science 2023-02-06 Christoph Dann , Yishay Mansour , Mehryar Mohri , Jon Schneider , Balasubramanian Sivan

In the standard setting of approachability there are two players and a target set. The players play repeatedly a known vector-valued game where the first player wants to have the average vector-valued payoff converge to the target set which…

Machine Learning · Statistics 2016-06-20 Shie Mannor , Vianney Perchet , Gilles Stoltz

We consider a repeated sequential game between a learner, who plays first, and an opponent who responds to the chosen action. We seek to design strategies for the learner to successfully interact with the opponent. While most previous…

Machine Learning · Computer Science 2020-07-13 Pier Giuseppe Sessa , Ilija Bogunovic , Maryam Kamgarpour , Andreas Krause

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

In this paper, we introduce the first algorithmic framework for Blackwell approachability on the sequence-form polytope, the class of convex polytopes capturing the strategies of players in extensive-form games (EFGs). This leads to a new…

Computer Science and Game Theory · Computer Science 2024-03-08 Darshan Chakrabarti , Julien Grand-Clément , Christian Kroer

We study the problem of sequential prediction of categorical data and discuss a generalisation of Blackwell's algorithm on 0-1 data. The arguments are based on Blackwell's approachability results given in Blackwell, D. (1956): An Analog of…

Statistics Theory · Mathematics 2011-02-15 Hans Rudolf Lerche

Agents rarely act in isolation -- their behavioral history, in particular, is public to others. We seek a non-asymptotic understanding of how a leader agent should shape this history to its maximal advantage, knowing that follower agent(s)…

Computer Science and Game Theory · Computer Science 2019-05-29 Vidya Muthukumar , Anant Sahai

We present a causality-based algorithm for solving two-player reachability games represented by logical constraints. These games are a useful formalism to model a wide array of problems arising, e.g., in program synthesis. Our technique for…

Logic in Computer Science · Computer Science 2021-06-01 Christel Baier , Norine Coenen , Bernd Finkbeiner , Florian Funke , Simon Jantsch , Julian Siber

Conformal Inference (CI) is a popular approach for generating finite sample prediction intervals based on the output of any point prediction method when data are exchangeable. Adaptive Conformal Inference (ACI) algorithms extend CI to the…

Computation · Statistics 2023-12-04 Herbert Susmann , Antoine Chambaz , Julie Josse