English
Related papers

Related papers: Efficient Estimation in Single Index Models throug…

200 papers

We consider the problem of estimating an unknown function f* and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f* except that it is smooth in the sense that it has square integrable…

Machine Learning · Statistics 2024-05-17 Eunji Lim

In this paper we consider the linear regression model $Y =S X+\varepsilon $ with functional regressors and responses. We develop new inference tools to quantify deviations of the true slope $S$ from a hypothesized operator $S_0$ with…

Statistics Theory · Mathematics 2021-08-17 Tim Kutta , Gauthier Dierickx , Holger Dette

In recent years, with the rapid development of science and technology, heterogeneous treatment effects have emerged as a focal research topic in statistics, econometrics, and sociology. This paper investigates HTE through semiparametric…

Methodology · Statistics 2025-07-21 Jichang Yu , Wenjing Chang , Peichao Yu , Lijun Chen , Yuanshan Wu

Motivated by recent work involving the analysis of leveraging spatial correlations in sparsified mean estimation, we present a novel procedure for constructing covariance estimator. The proposed Random-knots (Random-knots-Spatial) and…

Methodology · Statistics 2025-11-25 Sijie Zheng , Fandong Meng , Jie Zhou

This article investigates the least squares estimators (LSE) for the unknown parameters in stochastic differential equations (SDEs) that are affected by L\'evy noise, particularly when the sample paths are sparse. Specifically, given $n$…

Methodology · Statistics 2026-01-01 Brijesh Kumar Jha , Subhra Sankar Dhar , Akash Ashirbad Panda

Attaining reliable profile gradients is of utmost relevance for many physical systems. In most situations, the estimation of gradient can be inaccurate due to noise. It is common practice to first estimate the underlying system and then…

Data Analysis, Statistics and Probability · Physics 2021-05-31 Kushani De Silva , Carlo Cafaro , Adom Giffin

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, additive models consider…

Machine Learning · Statistics 2017-10-18 Sheng Chen , Arindam Banerjee

Quantile regression is a powerful tool capable of offering a richer view of the data as compared to least-squares regression. Quantile regression is typically performed individually on a few quantiles or a grid of quantiles without…

Methodology · Statistics 2026-03-26 Ta-Hsin Li , Nimrod Megiddo

In presence of sparse noise we propose kernel regression for predicting output vectors which are smooth over a given graph. Sparse noise models the training outputs being corrupted either with missing samples or large perturbations. The…

Machine Learning · Statistics 2018-11-07 Arun Venkitaraman , Pascal Frossard , Saikat Chatterjee

A new estimator, named S-LASSO, is proposed for the coefficient function of the Function-on-Function linear regression model. The S-LASSO estimator is shown to be able to increase the interpretability of the model, by better locating…

Methodology · Statistics 2022-07-15 Fabio Centofanti , Matteo Fontana , Antonio Lepore , Simone Vantini

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find…

Statistics Theory · Mathematics 2021-04-12 Arun K. Kuchibhotla , Rohit K. Patra

Generalized partially linear single-index models (GPLSIMs) provide a flexible and interpretable semiparametric framework for longitudinal outcomes by combining a low-dimensional parametric component with a nonparametric index component. For…

Methodology · Statistics 2026-02-19 Tianni Zhang , Yuyao Wang , Yu Lu , Mengfei Ran

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

We consider the efficient estimation of the semiparametric additive transformation model with current status data. A wide range of survival models and econometric models can be incorporated into this general transformation framework. We…

Statistics Theory · Mathematics 2011-05-09 Guang Cheng , Xiao Wang

The focus of modern biomedical studies has gradually shifted to explanation and estimation of joint effects of high dimensional predictors on disease risks. Quantifying uncertainty in these estimates may provide valuable insight into…

Methodology · Statistics 2021-03-09 Zhe Fei , Yi Li

In this article, we study a partially linear single-index model for longitudinal data under a general framework which includes both the sparse and dense longitudinal data cases. A semiparametric estimation method based on a combination of…

Statistics Theory · Mathematics 2015-07-31 Jia Chen , Degui Li , Hua Liang , Suojin Wang

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

We consider the estimation of a regression function with random design and heteroscedastic noise in a nonparametric setting. More precisely, we address the problem of characterizing the optimal penalty when the regression function is…

Statistics Theory · Mathematics 2015-06-29 Adrien Saumard

1. Parameter inference from distorted measurements is discussed. 2. Smeared measurements are unfolded without explicit regularization. The corresponding results are unbiased and permit to fit parameters and to apply quantitative…

Data Analysis, Statistics and Probability · Physics 2016-07-26 Guenter Zech