中文
相关论文

相关论文: Nonlinear Estimators and Tail Bounds for Dimension…

200 篇论文

Given a single trajectory of a dynamical system, we analyze the performance of the nonparametric least squares estimator (LSE). More precisely, we give nonasymptotic expected $l^2$-distance bounds between the LSE and the true regression…

机器学习 · 计算机科学 2022-02-22 Ingvar Ziemann , Henrik Sandberg , Nikolai Matni

In this paper we are interested in parameters estimation of linear model when number of parameters increases with sample size. Without any assumption about moments of the model error, we propose and study the seamless $L_0$ quantile…

统计理论 · 数学 2015-06-05 Gabriela Ciuperca

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

统计理论 · 数学 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

New local linear estimators are proposed for a wide class of nonparametric regression models. The estimators are uniformly consistent regardless of satisfying traditional conditions of depen\-dence of design elements. The estimators are the…

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

统计理论 · 数学 2013-11-04 Adel Javanmard , Andrea Montanari

We consider a $l_1$-penalization procedure in the non-parametric Gaussian regression model. In many concrete examples, the dimension $d$ of the input variable $X$ is very large (sometimes depending on the number of observations). Estimation…

统计理论 · 数学 2008-12-16 Karine Bertin , Guillaume Lecué

Compared to nonparametric estimators in the multivariate setting, kernel estimators for functional data models have a larger order of bias. This is problematic for constructing confidence regions or statistical tests since the bias might…

统计理论 · 数学 2025-11-21 Melanie Birke , Tim Greger

Randomized dimensionality reduction has been recognized as one of the fundamental techniques in handling high-dimensional data. Starting with the celebrated Johnson-Lindenstrauss Lemma, such reductions have been studied in depth for the…

计算几何 · 计算机科学 2019-09-10 Ioannis Z. Emiris , Vasilis Margonis , Ioannis Psarros

Likelihood-free inference methods typically make use of a distance between simulated and real data. A common example is the maximum mean discrepancy (MMD), which has previously been used for approximate Bayesian computation, minimum…

统计方法学 · 统计学 2023-05-11 Ayush Bharti , Masha Naslidnyk , Oscar Key , Samuel Kaski , François-Xavier Briol

We study high-dimensional signal recovery from non-linear measurements with design vectors having elliptically symmetric distribution. Special attention is devoted to the situation when the unknown signal belongs to a set of low statistical…

统计理论 · 数学 2016-11-14 Larry Goldstein , Stanislav Minsker , Xiaohan Wei

We revisit the problem of mean estimation in the Gaussian sequence model with $\ell_p$ constraints for $p \in [0, \infty]$. We demonstrate two phenomena for the behavior of the maximum likelihood estimator (MLE), which depend on the noise…

统计理论 · 数学 2025-07-02 Liviu Aolaritei , Michael I. Jordan , Reese Pathak , Annie Ulichney

In this paper, we study the properties of robust nonparametric estimation using deep neural networks for regression models with heavy tailed error distributions. We establish the non-asymptotic error bounds for a class of robust…

统计理论 · 数学 2021-07-23 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Jian Huang

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

统计理论 · 数学 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov

We study a statistical model for infinite dimensional Gaussian random variables with unknown parameters. For this model we derive linear estimators for the mean and the variance of the Gaussian distribution. Furthermore, we construct…

统计理论 · 数学 2025-11-21 Stefan Tappe

We study a class of nonlinear nonparametric inverse problems. Specifically, we propose a nonparametric estimator of the dynamics of a monotonically increasing trajectory defined on a finite time interval. Under suitable regularity…

统计理论 · 数学 2014-08-25 Debashis Paul , Jie Peng , Prabir Burman

We propose improvements in numerical evaluation of symmetric stable density and its partial derivatives with respect to the parameters. They are useful for more reliable evaluation of maximum likelihood estimator and its standard error.…

统计理论 · 数学 2007-06-13 Muneya Matsui , Akimichi Takemura

A difficulty in MSE estimation occurs because we do not specify a full distribution for the survey weights. This obfuscates the use of fully parametric bootstrap procedures. To overcome this challenge, we develop a novel MSE estimator. We…

统计方法学 · 统计学 2022-10-25 Yanghyeon Cho , Emily Berg

The $l_2$ flattening lemma of Johnson and Lindenstrauss [JL84] is a powerful tool for dimension reduction. It has been conjectured that the target dimension bounds can be refined and bounded in terms of the intrinsic dimensionality of the…

计算几何 · 计算机科学 2015-06-09 Lee-Ad Gottlieb , Robert Krauthgamer

Concentration inequalities form an essential toolkit in the study of high dimensional (HD) statistical methods. Most of the relevant statistics literature in this regard is based on sub-Gaussian or sub-exponential tail assumptions. In this…

统计理论 · 数学 2023-01-09 Arun Kumar Kuchibhotla , Abhishek Chakrabortty

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

统计方法学 · 统计学 2016-06-03 Marta Martinez-Camara , Michael Muma , Benjamin Bejar , Abdelhak M. Zoubir , Martin Vetterli