English
Related papers

Related papers: High-probability minimax lower bounds

200 papers

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the utility of the resulting statistical estimators. We prove bounds on information-theoretic…

Statistics Theory · Mathematics 2014-08-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Large data sets often require performing distributed statistical estimation, with a full data set split across multiple machines and limited communication between machines. To study such scenarios, we define and study some refinements of…

Information Theory · Computer Science 2014-06-24 John C. Duchi , Michael I. Jordan , Martin J. Wainwright , Yuchen Zhang

This paper investigates probabilistic robustness of nonconvex-nonconcave minimax problems via the scenario approach. Specifically, under convex strategy sets for all players, inspired by recent advances in scenario optimization, we first…

Computer Science and Game Theory · Computer Science 2026-05-14 Huan Peng , Guanpu Chen , Karl Henrik Johansson

The masses of data now available have opened up the prospect of discovering weak signals using machine-learning algorithms, with a view to predictive or interpretation tasks. As this survey of recent results attempts to show, bringing…

Statistics Theory · Mathematics 2026-05-06 Stephan Clémençon , Anne Sabourin

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Signal Processing · Electrical Eng. & Systems 2017-11-01 Michael Krikheli , Amir Leshem

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

Machine Learning · Statistics 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

A common bottleneck in evaluating extremal performance measures is that, due to their very nature, tail data are often very limited. The conventional approach selects the best probability distribution from tail data using parametric…

Computation · Statistics 2018-01-03 Henry Lam , Clementine Mottet

This paper investigates robust versions of the general empirical risk minimization algorithm, one of the core techniques underlying modern statistical methods. Success of the empirical risk minimization is based on the fact that for a…

Machine Learning · Statistics 2019-10-17 Stanislav Minsker , Timothée Mathieu

Minimax problems have achieved success in machine learning such as adversarial training, robust optimization, reinforcement learning. For theoretical analysis, current optimal excess risk bounds, which are composed by generalization error…

Machine Learning · Computer Science 2024-10-14 Bowei Zhu , Shaojie Li , Yong Liu

Convex sample approximations of chance-constrained optimization problems are considered, in which chance constraints are replaced by sets of sampled constraints. We propose a randomized sample selection strategy that allows tight bounds to…

Optimization and Control · Mathematics 2018-05-22 Mark Cannon

We investigate minimax testing for detecting local signals or linear combinations of such signals when only indirect data is available. Naturally, in the presence of noise, signals that are too small cannot be reliably detected. In a…

Statistics Theory · Mathematics 2023-02-21 Markus Pohlmann , Frank Werner , Axel Munk

We obtain sharp bounds on the performance of Empirical Risk Minimization performed in a convex class and with respect to the squared loss, without assuming that class members and the target are bounded functions or have rapidly decaying…

Machine Learning · Computer Science 2014-10-23 Shahar Mendelson

We study private and robust multi-armed bandits (MABs), where the agent receives Huber's contaminated heavy-tailed rewards and meanwhile needs to ensure differential privacy. We first present its minimax lower bound, characterizing the…

Machine Learning · Computer Science 2023-03-07 Yulian Wu , Xingyu Zhou , Youming Tao , Di Wang

Standard results in stochastic convex optimization bound the number of samples that an algorithm needs to generate a point with small function value in expectation. More nuanced high probability guarantees are rare, and typically either…

Optimization and Control · Mathematics 2019-10-18 Damek Davis , Dmitriy Drusvyatskiy , Lin Xiao , Junyu Zhang

Marginal expected shortfall is unquestionably one of the most popular systemic risk measures. Studying its extreme behaviour is particularly relevant for risk protection against severe global financial market downturns. In this context,…

Statistics Theory · Mathematics 2023-04-18 Simone A. Padoan , Stefano Rizzelli , Matteo Schiavone

We develop an efficient simulation algorithm for computing the tail probabilities of the infinite series $S = \sum_{n \geq 1} a_n X_n$ when random variables $X_n$ are heavy-tailed. As $S$ is the sum of infinitely many random variables, any…

Probability · Mathematics 2016-09-08 Henrik Hult , Sandeep Juneja , Karthyek Murthy

We develop a novel procedure for estimating the optimizer of general convex stochastic optimization problems of the form $\min_{x\in\mathcal{X}} \mathbb{E}[F(x,\xi)]$, when the given data is a finite independent sample selected according to…

Statistics Theory · Mathematics 2022-01-26 Daniel Bartl , Shahar Mendelson

Worst-case bounds on the expected shortfall risk given only limited information on the distribution of the random variables has been studied extensively in the literature. In this paper, we develop a new worst-case bound on the expected…

Risk Management · Quantitative Finance 2017-02-12 Anulekha Dhara , Bikramjit Das , Karthik Natarajan

Model selection is often performed by empirical risk minimization. The quality of selection in a given situation can be assessed by risk bounds, which require assumptions both on the margin and the tails of the losses used. Starting with…

Statistics Theory · Mathematics 2008-12-18 Charles Mitchell , Sara van de Geer

The contribution of this paper is to introduce change of measure based techniques for the rare-event analysis of heavy-tailed stochastic processes. Our changes-of-measure are parameterized by a family of distributions admitting a mixture…

Probability · Mathematics 2010-06-15 Jose Blanchet , Jingchen Liu