English
Related papers

Related papers: Minimax Filtering via Relations between Informatio…

200 papers

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

Statistics Theory · Mathematics 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu

Prediction with experts' advice is one of the most fundamental problems in online learning and captures many of its technical challenges. A recent line of work has looked at online learning through the lens of differential equations and…

Machine Learning · Computer Science 2022-10-04 Victor Sanches Portella , Christopher Liaw , Nicholas J. A. Harvey

We study the problem of testing the goodness of fit of categorical count data to a Poisson distribution uniform over the categories, against a class of alternatives defined by excluding an $\ell_p$ ball, $p \leq 2$, of radius $\epsilon$…

Statistics Theory · Mathematics 2025-12-16 Alon Kipnis

In this paper, we study the contextual multinomial logit (MNL) bandit problem in which a learning agent sequentially selects an assortment based on contextual information, and user feedback follows an MNL choice model. There has been a…

Machine Learning · Statistics 2025-10-17 Joongkyu Lee , Min-hwan Oh

The concept of a minimax classifier is well-established in statistical decision theory, but its implementation via neural networks remains challenging, particularly in scenarios with imbalanced training data having a limited number of…

Machine Learning · Computer Science 2026-01-07 Hansung Choi , Daewon Seo

This is a follow-up paper of Polson and Scott (2012, Bayesian Analysis), which claimed that the half-Cauchy prior is a sensible default prior for a scale parameter in hierarchical models. For estimation of a p-variate normal mean under the…

Statistics Theory · Mathematics 2024-06-14 Yuzo Maruyama , Takeru Matsuda

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

Machine Learning · Computer Science 2021-09-14 Nadav Merlis , Shie Mannor

In multiple importance sampling we combine samples from a finite list of proposal distributions. When those proposal distributions are used to create control variates, it is possible (Owen and Zhou, 2000) to bound the ratio of the resulting…

Computation · Statistics 2014-11-18 Hera Y. He , Art B. Owen

We consider the problem of designing minimax estimators for estimating the parameters of a probability distribution. Unlike classical approaches such as the MLE and minimum distance estimators, we consider an algorithmic approach for…

Machine Learning · Statistics 2020-06-23 Kartik Gupta , Arun Sai Suggala , Adarsh Prasad , Praneeth Netrapalli , Pradeep Ravikumar

We study Model Predictive Control (MPC) and propose a general analysis pipeline to bound its dynamic regret. The pipeline first requires deriving a perturbation bound for a finite-time optimal control problem. Then, the perturbation bound…

Optimization and Control · Mathematics 2022-10-25 Yiheng Lin , Yang Hu , Guannan Qu , Tongxin Li , Adam Wierman

We study episodic reinforcement learning with fixed reward and transition functions, but with episode-dependent admissible action sets that are observed at the start of each episode. Performance is measured by cumulative regret against the…

Machine Learning · Computer Science 2026-05-18 Zijun Chen , Zihan Zhang

This study presents an effective global optimization technique designed for multivariate functions that are H\"older continuous. Unlike traditional methods that construct lower bounding proxy functions, this algorithm employs a…

Machine Learning · Computer Science 2023-03-28 Kaan Gokcesu , Hakan Gokcesu

We consider a setting where a system learns to rank a fixed set of $m$ items. The goal is produce good item rankings for users with diverse interests who interact online with the system for $T$ rounds. We consider a novel top-$1$ feedback…

Machine Learning · Computer Science 2016-08-24 Sougata Chaudhuri , Ambuj Tewari

This paper addresses the problem of minimizing a convex, Lipschitz function $f$ over a convex, compact set $\xset$ under a stochastic bandit feedback model. In this model, the algorithm is allowed to observe noisy realizations of the…

Optimization and Control · Mathematics 2011-10-11 Alekh Agarwal , Dean P. Foster , Daniel Hsu , Sham M. Kakade , Alexander Rakhlin

In this paper, we consider the multi-armed bandit problem with high-dimensional features. First, we prove a minimax lower bound, $\mathcal{O}\big((\log d)^{\frac{\alpha+1}{2}}T^{\frac{1-\alpha}{2}}+\log T\big)$, for the cumulative regret,…

Machine Learning · Computer Science 2021-09-27 Ke Li , Yun Yang , Naveen N. Narisetty

We consider the random design regression model with square loss. We propose a method that aggregates empirical minimizers (ERM) over appropriately chosen random subsets and reduces to ERM in the extreme case, and we establish sharp oracle…

Statistics Theory · Mathematics 2017-07-04 Alexander Rakhlin , Karthik Sridharan , Alexandre B. Tsybakov

In this paper, we address the efficient implementation of moving horizon state estimation of constrained discrete-time linear systems. We propose a novel iteration scheme which employs a proximity-based formulation of the underlying…

Optimization and Control · Mathematics 2021-11-09 Meriem Gharbi , Bahman Gharesifard , Christian Ebenbauer

We study how to learn optimal interventions sequentially given causal information represented as a causal graph along with associated conditional distributions. Causal modeling is useful in real world problems like online advertisement…

Machine Learning · Statistics 2020-06-12 Yangyi Lu , Amirhossein Meisami , Ambuj Tewari , Zhenyu Yan

This paper investigates the robustness of causal bandits (CBs) in the face of temporal model fluctuations. This setting deviates from the existing literature's widely-adopted assumption of constant causal models. The focus is on causal…

Machine Learning · Statistics 2024-05-14 Zirui Yan , Arpan Mukherjee , Burak Varıcı , Ali Tajer