English
Related papers

Related papers: Wasserstein-based Minimax Estimation of Dependence…

200 papers

For linear time-invariant systems with uncertain parameters belonging to a finite set, we present a purely deterministic approach to multiple-model estimation and propose an algorithm based on the minimax criterion using constrained…

Optimization and Control · Mathematics 2022-07-18 Olle Kjellqvist , Anders Rantzer

Considering two random variables with different laws to which we only have access through finite size iid samples, we address how to reweight the first sample so that its empirical distribution converges towards the true law of the second…

Statistics Theory · Mathematics 2022-06-08 Julien Reygner , Adrien Touboul

The extremal dependence structure of a regularly varying random vector Xis fully described by its limiting spectral measure. In this paper, we investigate how torecover characteristics of the measure, such as extremal coefficients, from the…

Statistics Theory · Mathematics 2024-07-04 Marco Oesting , Olivier Wintenberger

Making sense of Wasserstein distances between discrete measures in high-dimensional settings remains a challenge. Recent work has advocated a two-step approach to improve robustness and facilitate the computation of optimal transport, using…

Machine Learning · Computer Science 2019-09-04 François-Pierre Paty , Marco Cuturi

Marginal expected shortfall is unquestionably one of the most popular systemic risk measures. Studying its extreme behaviour is particularly relevant for risk protection against severe global financial market downturns. In this context,…

Statistics Theory · Mathematics 2023-04-18 Simone A. Padoan , Stefano Rizzelli , Matteo Schiavone

In this paper the problem of retrospective change-point detection and estimation in multivariate linear models is considered. The lower bounds for the error of change-point estimation are proved in different cases (one change-point:…

Statistics Theory · Mathematics 2011-10-27 Boris Brodsky , Boris Darkhovsky

For statistical decision problems with finite parameter space, it is well-known that the upper value (minimax value) agrees with the lower value (maximin value). Only under a generalized notion of prior does such an equivalence carry over…

Statistics Theory · Mathematics 2022-12-27 Haosui Duanmu , Daniel M. Roy , David Schrittesser

We derive uniform convergence rates for the maximum likelihood estimator and minimax lower bounds for parameter estimation in two-component location-scale Gaussian mixture models with unequal variances. We assume the mixing proportions of…

Statistics Theory · Mathematics 2020-06-02 Tudor Manole , Nhat Ho

Computer vision systems that are deployed in safety-critical applications need to quantify their output uncertainty. We study regression from images to parameter values and here it is common to detect uncertainty by predicting probability…

Machine Learning · Computer Science 2024-06-24 Ziliang Xiong , Arvi Jonnarth , Abdelrahman Eldesokey , Joakim Johnander , Bastian Wandt , Per-Erik Forssen

Parameter estimation is a fundamental challenge in machine learning, crucial for tasks such as neural network weight fitting and Bayesian inference. This paper focuses on the complexity of estimating translation $\boldsymbol{\mu} \in…

Machine Learning · Computer Science 2025-01-20 Valentio Iverson , Stephen Vavasis

Consider the problem of joint parameter estimation and prediction in a Markov random field: i.e., the model parameters are estimated on the basis of an initial set of data, and then the fitted model is used to perform prediction (e.g.,…

Machine Learning · Computer Science 2007-07-13 Martin J. Wainwright

In this work we study systems consisting of a group of moving particles. In such systems, often some important parameters are unknown and have to be estimated from observed data. Such parameter estimation problems can often be solved via a…

Applications · Statistics 2023-07-11 Chen Cheng , Linjie Wen , Jinglai Li

The central limit theorem (CLT) is one of the most fundamental results in probability; and establishing its rate of convergence has been a key question since the 1940s. For independent random variables, a series of recent works established…

Probability · Mathematics 2023-09-12 Tianle Liu , Morgane Austern

We develop a projected Wasserstein distance for the two-sample test, a fundamental problem in statistics and machine learning: given two sets of samples, to determine whether they are from the same distribution. In particular, we aim to…

Machine Learning · Statistics 2024-04-01 Jie Wang , Rui Gao , Yao Xie

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

Statistics Theory · Mathematics 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu

The variance of noise plays an important role in many change-point detection procedures and the associated inferences. Most commonly used variance estimators require strong assumptions on the true mean structure or normality of the error…

Methodology · Statistics 2023-11-17 Ning Hao , Yue Selena Niu , Han Xiao

We obtain a Bernstein-type inequality for sums of Banach-valued random variables satisfying a weak dependence assumption of general type and under certain smoothness assumptions of the underlying Banach norm. We use this inequality in order…

Machine Learning · Statistics 2018-12-11 Gilles Blanchard , Oleksandr Zadorozhnyi

Lower bounds involving $f$-divergences between the underlying probability measures are proved for the minimax risk in estimation problems. Our proofs just use simple convexity facts. Special cases and straightforward corollaries of our…

Statistics Theory · Mathematics 2011-02-22 Adityanand Guntuboyina

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

Machine Learning · Statistics 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

The problem of estimating the baseline signal from multisample noisy curves is investigated. We consider the functional mixed effects model, and we suppose that the functional fixed effect belongs to the Besov class. This framework allows…

Methodology · Statistics 2015-11-17 Madison Giacofc , Sophie Lambert-Lacroix , Franck Picard