English
Related papers

Related papers: Efficient Estimation of Multidimensional Regressio…

200 papers

While optimizing convex objective (loss) functions has been a powerhouse for machine learning for at least two decades, non-convex loss functions have attracted fast growing interests recently, due to many desirable properties such as…

Machine Learning · Statistics 2018-02-14 Chao Qu , Yan Li , Huan Xu

In this study, MLP models with dynamic structure are applied to factor models for asset pricing tasks. Concretely, the MLP pyramid model structure was employed on firm-characteristic-sorted portfolio factors for modelling the large-capital…

Pricing of Securities · Quantitative Finance 2025-05-07 Shanyan Lai

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

Recent advances in implicit neural representations show great promise when it comes to generating numerical solutions to partial differential equations. Compared to conventional alternatives, such representations employ parameterized neural…

Machine Learning · Computer Science 2021-11-29 Jonas Zehnder , Yue Li , Stelian Coros , Bernhard Thomaszewski

We study the problem of signal source localization using received signal strength measurements. We begin by presenting verifiable geometric conditions for sensor deployment that ensure the model's asymptotic localizability. Then we…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Shenghua Hu , Guangyang Zeng , Wenchao Xue , Haitao Fang , Junfeng Wu , Biqiang Mu

We consider a semiparametric generalized linear model and study estimation of both marginal and quantile effects in this model. We propose an approximate maximum likelihood estimator, and rigorously establish the consistency, the asymptotic…

Methodology · Statistics 2022-04-06 Seong-ho Lee , Yanyuan Ma , Elvezio Ronchetti

We consider a finite mixture of regressions (FMR) model for high-dimensional inhomogeneous data where the number of covariates may be much larger than sample size. We propose an l1-penalized maximum likelihood estimator in an appropriate…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann , Sara van de Geer

The multivariate adaptive regression spline (MARS) is one of the popular estimation methods for nonparametric multivariate regressions. However, as MARS is based on marginal splines, to incorporate interactions of covariates, products of…

Methodology · Statistics 2023-07-06 Yu Liu , Degui Li , Yingcun Xia

The estimation of high dimensional precision matrices has been a central topic in statistical learning. However, as the number of parameters scales quadratically with the dimension $p$, many state-of-the-art methods do not scale well to…

Computation · Statistics 2019-07-10 Cheng Wang , Binyan Jiang

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

While mixture of linear regressions (MLR) is a well-studied topic, prior works usually do not analyze such models for prediction error. In fact, {\em prediction} and {\em loss} are not well-defined in the context of mixtures. In this paper,…

Machine Learning · Statistics 2022-05-27 Avishek Ghosh , Arya Mazumdar , Soumyabrata Pal , Rajat Sen

Image denoising can be described as the problem of mapping from a noisy image to a noise-free image. The best currently available denoising methods approximate this mapping with cleverly engineered algorithms. In this work we attempt to…

Computer Vision and Pattern Recognition · Computer Science 2012-11-12 Harold Christopher Burger , Christian J. Schuler , Stefan Harmeling

It is common to address the curse of dimensionality in Markov decision processes (MDPs) by exploiting low-rank representations. This motivates much of the recent theoretical study on linear MDPs. However, most approaches require a given…

Machine Learning · Computer Science 2022-12-09 Tianjun Zhang , Tongzheng Ren , Mengjiao Yang , Joseph E. Gonzalez , Dale Schuurmans , Bo Dai

The problem of monotone missing data has been broadly studied during the last two decades and has many applications in different fields such as bioinformatics or statistics. Commonly used imputation techniques require multiple iterations…

Machine Learning · Computer Science 2020-09-25 Thu Nguyen , Duy H. M. Nguyen , Huy Nguyen , Binh T. Nguyen , Bruce A. Wade

Multidimensional projections (MP) are among the most essential approaches in the visual analysis of multidimensional data. It transforms multidimensional data into two-dimensional representations that may be shown as scatter plots while…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Maniru Ibrahim , Thales Vieira

We consider a high-dimensional regression model with a possible change-point due to a covariate threshold and develop the Lasso estimator of regression coefficients as well as the threshold parameter. Our Lasso estimator not only selects…

Statistics Theory · Mathematics 2019-08-23 Sokbae Lee , Myung Hwan Seo , Youngki Shin

The problem of estimating the parameters of a moving target in multiple-input multiple-output (MIMO) radar is considered and a new approach for estimating the moving target parameters by making use of the phase information associated with…

Information Theory · Computer Science 2015-06-04 Aboulnasr Hassanien , Sergiy A. Vorobyov , Alex B. Gershman

We study asymptotic behavior of one-step weighted $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent weighted…

Statistics Theory · Mathematics 2015-07-07 Yu. Yu. Linke

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

In the multidimensional setting, we consider the errors-in-variables model. We aim at estimating the unknown nonparametric multivariate regression function with errors in the covariates. We devise an adaptive estimator based on projection…

Statistics Theory · Mathematics 2016-01-13 Michaël Chichignoud , Van Ha Hoang , Thanh Mai Pham Ngoc , Vincent Rivoirard