中文
相关论文

相关论文: Nonlinear Estimators and Tail Bounds for Dimension…

200 篇论文

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

统计方法学 · 统计学 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri

In this paper we introduce a general theory for nonlinear sufficient dimension reduction, and explore its ramifications and scope. This theory subsumes recent work employing reproducing kernel Hilbert spaces, and reveals many parallels…

统计理论 · 数学 2013-04-03 Kuang-Yao Lee , Bing Li , Francesca Chiaromonte

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

统计理论 · 数学 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

统计理论 · 数学 2025-06-03 Yannick Baraud , Guillaume Maillard

Some quasi-arithmetic means of random variables easily give unbiased strongly consistent closed-form estimators of the joint of the location and scale parameters of the Cauchy distribution. The one-step estimators of those quasi-arithmetic…

统计理论 · 数学 2022-08-19 Yuichi Akaoka , Kazuki Okamura , Yoshiki Otobe

Nonlinear dimensionality reduction or, equivalently, the approximation of high-dimensional data using a low-dimensional nonlinear manifold is an active area of research. In this paper, we will present a thematically different approach to…

机器学习 · 计算机科学 2019-12-21 Kelum Gajamannage , Randy Paffenroth

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small sample. Under standard random design analysis, where the…

机器学习 · 统计学 2022-06-08 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

This paper is concerned with general nonlinear regression models where the predictor variables are subject to Berkson-type measurement errors. The measurement errors are assumed to have a general parametric distribution, which is not…

统计理论 · 数学 2009-08-21 Liqun Wang

This paper proposes a new method for estimating high-dimensional binary choice models. We consider a semiparametric model that places no distributional assumptions on the error term, allows for heteroskedastic errors, and permits endogenous…

计量经济学 · 经济学 2025-07-15 Fu Ouyang , Thomas Tao Yang

This paper proposes a multi-stage projection-based Lasso procedure for the semiparametric sample selection model in high-dimensional settings under a weak nonparametric restriction on the selection correction. In particular, the number of…

统计理论 · 数学 2014-11-13 Ying Zhu

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

统计方法学 · 统计学 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We establish some limit theorems for quasi-arithmetic means of random variables. This class of means contains the arithmetic, geometric and harmonic means. Our feature is that the generators of quasi-arithmetic means are allowed to be…

统计理论 · 数学 2022-05-09 Yuichi Akaoka , Kazuki Okamura , Yoshiki Otobe

We study the sublinear multivariate mean estimation problem in $d$-dimensional Euclidean space. Specifically, we aim to find the mean $\mu$ of a ground point set $A$, which minimizes the sum of squared Euclidean distances of the points in…

数据结构与算法 · 计算机科学 2025-10-07 Beatrice Bertolotti , Matteo Russo , Chris Schwiegelshohn , Sudarshan Shyam

Least squares fitting is in general not useful for high-dimensional linear models, in which the number of predictors is of the same or even larger order of magnitude than the number of samples. Theory developed in recent years has coined a…

统计理论 · 数学 2014-02-13 Martin Slawski , Matthias Hein

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

信息论 · 计算机科学 2016-09-06 Steffen Limmer , Sławomir Stańczak

We introduce a new family of estimators for unnormalized statistical models. Our family of estimators is parameterized by two nonlinear functions and uses a single sample from an auxiliary distribution, generalizing Maximum Likelihood Monte…

机器学习 · 计算机科学 2012-03-19 Miika Pihlaja , Michael Gutmann , Aapo Hyvarinen

We propose and investigate a new estimation method for the parameters of models consisting of smooth density functions on the positive half axis. The procedure is based on a recently introduced characterization result for the respective…

统计理论 · 数学 2021-06-16 Steffen Betsch , Bruno Ebner , Bernhard Klar

We propose a dimension reduction technique for Bayesian inverse problems with nonlinear forward operators, non-Gaussian priors, and non-Gaussian observation noise. The likelihood function is approximated by a ridge function, i.e., a map…

概率论 · 数学 2022-01-31 Olivier Zahm , Tiangang Cui , Kody Law , Alessio Spantini , Youssef Marzouk

Unsupervised machine learning lacks ground truth by definition. This poses a major difficulty when designing metrics to evaluate the performance of such algorithms. In sharp contrast with supervised learning, for which plenty of quality…