English
Related papers

Related papers: Minimax decision rules for planning under uncertai…

200 papers

We study the problem of online learning with dynamics, where a learner interacts with a stateful environment over multiple rounds. In each round of the interaction, the learner selects a policy to deploy and incurs a cost that depends on…

Machine Learning · Computer Science 2020-12-04 Kush Bhatia , Karthik Sridharan

We consider how an agent should update her uncertainty when it is represented by a set P of probability distributions and the agent observes that a random variable X takes on value x, given that the agent makes decisions using the minimax…

Artificial Intelligence · Computer Science 2014-07-29 Peter D. Grunwald , Joseph Y. Halpern

Finding numerical approximations to minimax regret treatment rules is of key interest. To do so when potential outcomes are in {0,1} we discretize the action space of nature and apply a variant of Robinson's (1951) algorithm for iterative…

Econometrics · Economics 2025-03-17 Patrik Guggenberger , Jiaqi Huang

It is common to encounter the situation with uncertainty for decision makers (DMs) in dealing with a complex decision making problem. The existing evidence shows that people usually fear the extreme uncertainty named as the unknown. This…

Theoretical Economics · Economics 2021-08-05 Fang Liu

In this paper we study how to optimally balance cheap inflexible resources with more expensive, reconfigurable resources despite uncertainty in the input problem. Specifically, we introduce the MinEMax model to study "build versus rent"…

Data Structures and Algorithms · Computer Science 2019-07-23 D Ellis Hershkowitz , R. Ravi , Sahil Singla

The scenario-based optimization approach (`scenario approach') provides an intuitive way of approximating the solution to chance-constrained optimization programs, based on finding the optimal solution under a finite number of sampled…

Optimization and Control · Mathematics 2025-10-02 Georg Schildbach , Lorenzo Fagiano , Manfred Morari

For linear time-invariant systems with uncertain parameters belonging to a finite set, we present a purely deterministic approach to multiple-model estimation and propose an algorithm based on the minimax criterion using constrained…

Optimization and Control · Mathematics 2022-07-18 Olle Kjellqvist , Anders Rantzer

We consider how an agent should update her uncertainty when it is represented by a set $\P$ of probability distributions and the agent observes that a random variable $X$ takes on value $x$, given that the agent makes decisions using the…

Artificial Intelligence · Computer Science 2007-11-27 Peter D. Grunwald , Joseph Y. Halpern

A decision rule is epsilon-minimax if it is minimax up to an additive factor epsilon. We present an algorithm for provably obtaining epsilon-minimax solutions for a class of statistical decision problems. In particular, we are interested in…

Randomized controlled trials are often run in settings with many subpopulations that may have differential benefits from the treatment being evaluated. We consider the problem of sample selection, i.e., whom to enroll in a randomized trial,…

Methodology · Statistics 2024-06-26 Yuchen Hu , Henry Zhu , Emma Brunskill , Stefan Wager

In cooperative multiagent planning, it can often be beneficial for an agent to make commitments about aspects of its behavior to others, allowing them in turn to plan their own behaviors without taking the agent's detailed behavior into…

Artificial Intelligence · Computer Science 2017-03-16 Qi Zhang , Satinder Singh , Edmund Durfee

We consider control of uncertain linear time-varying stochastic systems from the perspective of regret minimization. Specifically, we focus on the problem of designing a feedback controller that minimizes the loss relative to a clairvoyant…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Andrea Martin , Luca Furieri , Florian Dörfler , John Lygeros , Giancarlo Ferrari-Trecate

We present a new decision rule, \emph{maximin safety}, that seeks to maintain a large margin from the worst outcome, in much the same way minimax regret seeks to minimize distance from the best. We argue that maximin safety is valuable both…

Artificial Intelligence · Computer Science 2015-01-22 Brad Gulko , Samantha Leung

For statistical decision problems with finite parameter space, it is well-known that the upper value (minimax value) agrees with the lower value (maximin value). Only under a generalized notion of prior does such an equivalence carry over…

Statistics Theory · Mathematics 2022-12-27 Haosui Duanmu , Daniel M. Roy , David Schrittesser

In practical applications, data is used to make decisions in two steps: estimation and optimization. First, a machine learning model estimates parameters for a structural model relating decisions to outcomes. Second, a decision is chosen to…

Optimization and Control · Mathematics 2022-10-28 Samuel Tan , Peter I. Frazier

We treat the so-called scenario approach, a popular probabilistic approximation method for robust minmax optimization problems via independent and indentically distributed (i.i.d) sampling from the uncertainty set, from various…

Optimization and Control · Mathematics 2024-09-23 Mishal Assif P K , Debasish Chatterjee , Ravi Banavar

We study agents acting in an unknown environment where the agent's goal is to find a robust policy. We consider robust policies as policies that achieve high cumulative rewards for all possible environments. To this end, we consider agents…

Machine Learning · Computer Science 2024-10-22 Raghav Bongole , Amaury Gouverneur , Borja Rodríguez-Gálvez , Tobias J. Oechtering , Mikael Skoglund

The dynamic portfolio optimization problem in finance frequently requires learning policies that adhere to various constraints, driven by investor preferences and risk. We motivate this problem of finding an allocation policy within a…

Artificial Intelligence · Computer Science 2020-12-23 Nymisha Bandi , Theja Tulabandhula

Some of the most compelling applications of online convex optimization, including online prediction and classification, are unconstrained: the natural feasible set is R^n. Existing algorithms fail to achieve sub-linear regret in this…

Machine Learning · Computer Science 2012-11-13 Matthew Streeter , H. Brendan McMahan

We study the regret of optimal strategies for online convex optimization games. Using von Neumann's minimax theorem, we show that the optimal regret in this adversarial setting is closely related to the behavior of the empirical…

Machine Learning · Computer Science 2009-04-01 Jacob Abernethy , Alekh Agarwal , Peter L. Bartlett , Alexander Rakhlin