English
Related papers

Related papers: Minimax adaptive estimation in manifold inference

200 papers

Modern sample points in many applications no longer comprise real vectors in a real vector space but sample points of much more complex structures, which may be represented as points in a space with a certain underlying geometric structure,…

Machine Learning · Statistics 2022-02-07 Zhigang Yao , Bingjie Li , Wee Chin Tan

We study the estimation of the reach, an ubiquitous regularity parameter in manifold estimation and geometric data analysis. Given an i.i.d. sample over an unknown $d$-dimensional $\mathcal{C}^k$-smooth submanifold of $\mathbb{R}^D$, we…

Statistics Theory · Mathematics 2022-07-14 Eddie Aamari , Clément Berenfeld , Clément Levrard

In this paper we are concerned with fully automatic and locally adaptive estimation of functions in a "signal + noise"-model where the regression function may additionally be blurred by a linear operator, e.g. by a convolution. To this end,…

Applications · Statistics 2015-03-17 Klaus Frick , Philipp Marnitz , Axel Munk

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

Statistics Theory · Mathematics 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

High-dimensional data are ubiquitous in contemporary science and finding methods to compress them is one of the primary goals of machine learning. Given a dataset lying in a high-dimensional space (in principle hundreds to several thousands…

Machine Learning · Computer Science 2020-03-24 Vittorio Erba , Marco Gherardi , Pietro Rotondo

Consider the problem of joint parameter estimation and prediction in a Markov random field: i.e., the model parameters are estimated on the basis of an initial set of data, and then the fitted model is used to perform prediction (e.g.,…

Machine Learning · Computer Science 2007-07-13 Martin J. Wainwright

Stochastic minimax optimization on Riemannian manifolds has recently attracted significant attention due to its broad range of applications, such as robust training of neural networks and robust maximum likelihood estimation. Existing…

Optimization and Control · Mathematics 2026-02-11 Hongye Wang , Chang He , Bo Jiang

We study the performances of an adaptive procedure based on a convex combination, with data-driven weights, of term-by-term thresholded wavelet estimators. For the bounded regression model, with random uniform design, and the nonparametric…

Statistics Theory · Mathematics 2016-08-16 Christophe Chesneau , Guillaume Lecué

This work introduces an algorithm for state estimation on manifolds within the framework of the Kalman filter. Its primary objective is to provide a methodology enabling the evaluation of the precision of existing Kalman filter variants…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Svyatoslav Covanov , Cedric Pradalier

Although adaptive optimization algorithms have been successful in many applications, there are still some mysteries in terms of convergence analysis that have not been unraveled. This paper provides a novel non-convex analysis of adaptive…

Optimization and Control · Mathematics 2025-04-08 Zhishuai Guo , Yi Xu , Wotao Yin , Rong Jin , Tianbao Yang

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics,…

Statistics Theory · Mathematics 2023-12-27 Akifumi Okuno , Masaaki Imaizumi

We investigate minimax results for the anisotropic functional deconvolution model when observations are affected by the presence of long-memory. Under specific conditions about the covariance matrices of the errors, we follow a standard…

Statistics Theory · Mathematics 2018-07-31 Rida Benhaddou

The gradient method for minimize a differentiable convex function on Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. The analysis of the method is presented with three different finite procedures for…

Optimization and Control · Mathematics 2018-06-08 O. P. Ferreira , M. S. Louzeiro , L. F. Prudente

It is a common contention that it is an ``impossible mission'' to exactly determine the minimum sample size for the estimation of a binomial parameter with prescribed margin of error and confidence level. In this paper, we investigate such…

Statistics Theory · Mathematics 2007-08-02 Xinjia Chen

Manifold models provide low-dimensional representations that are useful for processing and analyzing data in a transformation-invariant way. In this paper, we study the problem of learning smooth pattern transformation manifolds from image…

Computer Vision and Pattern Recognition · Computer Science 2013-05-20 Elif Vural , Pascal Frossard

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

In adaptive data analysis, the user makes a sequence of queries on the data, where at each step the choice of query may depend on the results in previous steps. The releases are often randomized in order to reduce overfitting for such…

Machine Learning · Statistics 2016-02-16 Yu-Xiang Wang , Jing Lei , Stephen E. Fienberg

We consider non-parametric estimation problems in the presence of dependent data, notably non-parametric regression with random design and non-parametric density estimation. The proposed estimation procedure is based on a dimension…

Statistics Theory · Mathematics 2016-02-02 Nicolas Asin , Jan Johannes

We define two minimum distance estimators for dependent data by minimizing some approximated Maximum Mean Discrepancy distances between the true empirical distribution of observations and their assumed (parametric) model distribution. When…

Methodology · Statistics 2026-01-19 Pierre Alquier , Jean-David Fermanian , Benjamin Poignard
‹ Prev 1 3 4 5 6 7 10 Next ›