English
Related papers

Related papers: Misspecification-Averse Estimation

200 papers

In many parameter estimation problems, the exact model is unknown and is assumed to belong to a set of candidate models. In such cases, a predetermined data-based selection rule selects a parametric model from a set of candidates before the…

Signal Processing · Electrical Eng. & Systems 2025-04-25 Nadav Harel , Tirza Routtenberg

We provide a decision theoretic analysis of bandit experiments under local asymptotics. Working within the framework of diffusion processes, we define suitable notions of asymptotic Bayes and minimax risk for these experiments. For normally…

Econometrics · Economics 2025-05-06 Karun Adusumilli

We provide a comprehensive set of new results on the impact of mis-specifying the short run dynamics in fractionally integrated processes. We show that four alternative parametric estimators - frequency domain maximum likelihood, Whittle,…

Statistics Theory · Mathematics 2018-10-23 Gael M. Martin , Kanchana Nadarajah , D. S. Poskitt

Recently, there has been a significant focus on exploring the theoretical aspects of deep learning, especially regarding its performance in classification tasks. Bayesian deep learning has emerged as a unified probabilistic framework,…

Statistics Theory · Mathematics 2025-01-24 The Tien Mai

The problem of binary hypothesis testing between two probability measures is considered. New sharp bounds are derived for the best achievable error probability of such tests based on independent and identically distributed observations.…

Information Theory · Computer Science 2024-05-30 Valentinian Lungu , Ioannis Kontoyiannis

We generalize the notion of minimax convergence rate. In contrast to the standard definition, we do not assume that the sample size is fixed in advance. Allowing for varying sample size results in time-robust minimax rates and estimators.…

Statistics Theory · Mathematics 2021-06-01 Alisa Kirichenko , Peter Grünwald

In this work we consider a problem of multi-label classification, where each instance is associated with some binary vector. Our focus is to find a classifier which minimizes false negative discoveries under constraints. Depending on the…

Statistics Theory · Mathematics 2019-03-29 Evgenii Chzhen

We propose a method to improve the efficiency and accuracy of amortized Bayesian inference by leveraging universal symmetries in the joint probabilistic model of parameters and data. In a nutshell, we invert Bayes' theorem and estimate the…

Machine Learning · Computer Science 2024-07-24 Marvin Schmitt , Desi R. Ivanova , Daniel Habermann , Ullrich Köthe , Paul-Christian Bürkner , Stefan T. Radev

In recent developments, a novel set of necessary optimality conditions for mixed constrained optimal control problems, termed the asymptotic weak maximum principle, has been formulated. These novel conditions deviate from the classical ones…

Optimization and Control · Mathematics 2026-05-18 Rodrigo B. Moreira , Valeriano A. de Oliveira

We study local asymptotic properties of likelihood ratios of certain Heston models. We distinguish three cases: subcritical, critical and supercritical models. For the drift parameters, local asymptotic normality is proved in the…

Statistics Theory · Mathematics 2019-10-17 János Marcell Benke , Gyula Pap

The problems of optimally estimating a phase, a direction, and the orientation of a Cartesian frame (or trihedron) with general pure states are addressed. Special emphasis is put on estimation schemes that allow for inconclusive answers or…

Quantum Physics · Physics 2013-08-09 B. Gendra , E. Ronco-Bonvehi , J. Calsamiglia , R. Muñoz-Tapia , E. Bagan

Various algorithms in reinforcement learning exhibit dramatic variability in their convergence rates and ultimate accuracy as a function of the problem structure. Such instance-specific behavior is not captured by existing global minimax…

Machine Learning · Statistics 2021-06-29 Koulik Khamaru , Eric Xia , Martin J. Wainwright , Michael I. Jordan

We develop asymptotic approximations that can be applied to sequential estimation and inference problems, adaptive randomized controlled trials, and related settings. In batched adaptive settings where the decision at one stage can affect…

Econometrics · Economics 2025-02-25 Keisuke Hirano , Jack R. Porter

We use decision theory to confront uncertainty that is sufficiently broad to incorporate "models as approximations." We presume the existence of a featured collection of what we call "structured models" that have explicit substantive…

Theoretical Economics · Economics 2022-08-22 Simone Cerreia-Vioglio , Lars Peter Hansen , Fabio Maccheroni , Massimo Marinacci

Local asymptotic minimax risk bounds in a locally asymptotically mixture of normal family of distributions have been investigated under asymmetric loss functions and the asymptotic distribution of the optimal estimator that attains the…

Statistics Theory · Mathematics 2008-12-02 Debasis Bhattacharya , A. K. Basu

We study local complexity measures for stochastic convex optimization problems, providing a local minimax theory analogous to that of H\'{a}jek and Le Cam for classical statistical problems. We give complementary optimality results,…

Statistics Theory · Mathematics 2019-06-05 John Duchi , Feng Ruan

In the pivotal variable selection problem, we derive the exact non-asymptotic minimax selector over the class of all $s$-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in…

Statistics Theory · Mathematics 2022-01-03 Cristina Butucea , Enno Mammen , Mohamed Ndaoud , Alexandre B. Tsybakov

We address the problem of learning to benchmark the best achievable classifier performance. In this problem the objective is to establish statistically consistent estimates of the Bayes misclassification error rate without having to learn a…

Machine Learning · Statistics 2019-09-17 Morteza Noshad , Li Xu , Alfred Hero

Many statistical estimands can expressed as continuous linear functionals of a conditional expectation function. This includes the average treatment effect under unconfoundedness and generalizations for continuous-valued and personalized…

Methodology · Statistics 2020-11-23 David A. Hirshberg , Stefan Wager

We introduce a new concept of approximation applicable to decision problems and functions, inspired by Bayesian probability. From the perspective of a Bayesian reasoner with limited computational resources, the answer to a problem that…

Computational Complexity · Computer Science 2025-06-27 Vanessa Kosoy , Alexander Appel