English
Related papers

Related papers: Efficient Estimation of Multidimensional Regressio…

200 papers

A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the…

Neural and Evolutionary Computing · Computer Science 2014-07-09 Cyril Voyant , Wani W. Tamas , Marie Laure Nivet , Gilles Notton , Christophe Paoli , Aurélia Balu , Marc Muselli

This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. Model parameters are proposed to be estimated by maximizing a pseudo-likelihood. When the data…

Methodology · Statistics 2020-07-28 Yi Zhao , Brian S. Caffo , Xi Luo

The multivariate adaptive regression spline (MARS) is one of the popular estimation methods for nonparametric multivariate regressions. However, as MARS is based on marginal splines, to incorporate interactions of covariates, products of…

Methodology · Statistics 2023-07-06 Yu Liu , Degui Li , Yingcun Xia

Regression trees and their ensemble methods are popular methods for nonparametric regression: they combine strong predictive performance with interpretable estimators. To improve their utility for locally smooth response surfaces, we study…

Methodology · Statistics 2021-09-13 Sören R. Künzel , Theo F. Saarinen , Edward W. Liu , Jasjeet S. Sekhon

Numerical nonlinear algebra is applied to maximum likelihood estimation for Gaussian models defined by linear constraints on the covariance matrix. We examine the generic case as well as special models (e.g. Toeplitz, sparse, trees) that…

Computation · Statistics 2020-10-07 Bernd Sturmfels , Sascha Timme , Piotr Zwiernik

Novel radio map estimation in optical wireless communications is proposed based on ML prediction rather than simulation techniques. ML training is performed on simulation and experimentally generated synthetic data and in both cases,…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Helena Serpi , Christina , Politi

This paper proposes a Lasso-type estimator for a high-dimensional sparse parameter identified by a single index conditional moment restriction (CMR). In addition to this parameter, the moment function can also depend on a nuisance function,…

Statistics Theory · Mathematics 2021-09-14 Denis Nekipelov , Vira Semenova , Vasilis Syrgkanis

A nonparametric model using a sequence of Bernstein polynomials is constructed to approximate arbitrary isotropic covariance functions valid in $\mathbb{R}^\infty$ and related approximation properties are investigated using the popular…

Methodology · Statistics 2026-04-27 Yiming Wang , Sujit K. Ghosh

We study the optimal linear prediction of a random function that takes values in an infinite dimensional Hilbert space. We begin by characterizing the mean square prediction error (MSPE) associated with a linear predictor and discussing the…

Statistics Theory · Mathematics 2025-09-10 Won-Ki Seo

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

The efficient estimation of an approximate model order is very important for real applications with multi-dimensional data if the observed low-rank data is corrupted by additive noise. In this paper, we present a novel robust method for…

Methodology · Statistics 2022-12-21 Alexey A. Korobkov , Marina K. Diugurova , Jens Haueisen , Martin Haardt

Marginal structural models are a popular method for estimating causal effects in the presence of time-varying exposures. In spite of their popularity, no scalable non-parametric estimator exist for marginal structural models with…

Methodology · Statistics 2024-09-30 Axel Martin , Michele Santacatterina , Iván Díaz

Estimating and detecting faults is crucial in ensuring safe and efficient automated systems. In the presence of disturbances, noise or varying system dynamics, such estimation is even more challenging. To address this challenge, this…

Optimization and Control · Mathematics 2021-12-13 Chris van der Ploeg , Emilia Silvas , Nathan van de Wouw , Peyman Mohajerin Esfahani

Multiplicative errors in addition to spatially referenced observations often arise in geodetic applications, particularly in surface estimation with light detection and ranging (LiDAR) measurements. However, spatial regression involving…

Methodology · Statistics 2023-09-06 Hojun You , Wei-Ying Wu , Chae Young Lim , Kyubaek Yoon , Jongeun Choi

In a previous article we developed an approach to the optimal (minimum variance, unbiased) statistical estimation technique for the equilibrium displacement of a damped, harmonic oscillator in the presence of thermal noise. Here, we expand…

Data Analysis, Statistics and Probability · Physics 2009-09-28 Jason H. Steffen , Michael W. Moore , Paul E. Boynton

The article is devoted to the nonparametric estimation of the quadratic covariation of non-synchronously observed It\^o processes in an additive microstructure noise model. In a high-frequency setting, we aim at establishing an asymptotic…

Statistics Theory · Mathematics 2011-06-22 Markus Bibinger

A robust and sparse estimator for multinomial regression is proposed for high dimensional data. Robustness of the estimator is achieved by trimming the observations, and sparsity of the estimator is obtained by the elastic net penalty,…

Methodology · Statistics 2022-05-25 Fatma Sevinç Kurnaz , Peter Filzmoser

We present a neural net algorithm for parameter estimation in the context of large cosmological data sets. Cosmological data sets present a particular challenge to pattern-recognition algorithms since the input patterns (galaxy redshift…

Astrophysics · Physics 2007-05-23 Nicholas G. Phillips , A. Kogut

We consider the problems of variable selection and estimation in nonparametric additive regression models for high-dimensional data. In recent years, several methods have been proposed to model nonlinear relationships when the number of…

Methodology · Statistics 2013-10-07 Linn Cecilie Bergersen , Kukatharmini Tharmaratnam , Ingrid K. Glad

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

Statistics Theory · Mathematics 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao