English
Related papers

Related papers: Robust approximate linear regression without corre…

200 papers

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

Measurement error arises through a variety of mechanisms. A rich literature exists on the bias introduced by covariate measurement error and on methods of analysis to address this bias. By comparison, less attention has been given to errors…

Methodology · Statistics 2018-11-27 Pamela Shaw , Jiwei He , Bryan Shepherd

Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Le Zhang , Zenglin Shi , Ming-Ming Cheng , Yun Liu , Jia-Wang Bian , Joey Tianyi Zhou , Guoyan Zheng , Zeng Zeng

Network experiments are powerful tools for studying spillover effects, which avoid endogeneity by randomly assigning treatments to units over networks. However, it is non-trivial to analyze network experiments properly without imposing…

Econometrics · Economics 2025-06-09 Mengsi Gao , Peng Ding

Large-scale population-level datasets, such as the UK Biobank and the All of Us Research Program, often lack covariates needed for a specific analysis, such as genetic or lifestyle measures, while related studies measure them. This creates…

Methodology · Statistics 2026-05-07 Huali Zhao , Tianying Wang

In this paper we consider a regression model that allows for time series covariates as well as heteroscedasticity with a regression function that is modelled nonparametrically. We assume that the regression function changes at some unknown…

Statistics Theory · Mathematics 2019-09-17 Maria Mohr , Leonie Selk

In this study, a longitudinal regression model for covariance matrix outcomes is introduced. The proposal considers a multilevel generalized linear model for regressing covariance matrices on (time-varying) predictors. This model…

Methodology · Statistics 2022-02-10 Yi Zhao , Brian S. Caffo , Xi Luo

In this work, we propose an algorithm for solving exact sparse linear regression problems over a network in a distributed manner. Particularly, we consider the problem where data is stored among different computers or agents that seek to…

Optimization and Control · Mathematics 2022-04-04 Tu Anh-Nguyen , César A. Uribe

The aim of reduced rank regression is to connect multiple response variables to multiple predictors. This model is very popular, especially in biostatistics where multiple measurements on individuals can be re-used to predict multiple…

Methodology · Statistics 2022-06-20 The Tien Mai , Pierre Alquier

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

Methodology · Statistics 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

We introduced and analyzed robust recovery-based a posteriori error estimators for various lower order finite element approximations to interface problems in [9, 10], where the recoveries of the flux and/or gradient are implicit (i.e.,…

Numerical Analysis · Mathematics 2014-07-17 Zhiqiang Cai , Shun Zhang

This paper deals with improvement of linear quantile regression, when there are a few distinct values of the covariates but many replicates. On can improve asymptotic efficiency of the estimated regression coefficients by using suitable…

Applications · Statistics 2020-11-30 Kaushik Jana , Debasis Sengupta

Asymptotic equivalence theory developed in the literature so far are only for bounded loss functions. This limits the potential applications of the theory because many commonly used loss functions in statistical inference are unbounded. In…

Statistics Theory · Mathematics 2009-09-03 T. Tony Cai , Harrison H. Zhou

Divergence estimators based on direct approximation of density-ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution…

Machine Learning · Statistics 2011-06-24 Makoto Yamada , Taiji Suzuki , Takafumi Kanamori , Hirotaka Hachiya , Masashi Sugiyama

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

Robust density estimation refers to the consistent estimation of the density function even when the data is contaminated by outliers. We find that existing forest density estimation at a certain point is inherently resistant to the outliers…

Machine Learning · Statistics 2025-01-28 Hongwei Wen , Annika Betken , Tao Huang

Aligning partially overlapping point sets where there is no prior information about the value of the transformation is a challenging problem in computer vision. To achieve this goal, we first reduce the objective of the robust point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Wei Lian , WangMeng Zuo , Lei Zhang

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

Semi- and non-parametric mixture of regressions are a very useful flexible class of mixture of regressions in which some or all of the parameters are non-parametric functions of the covariates. These models are, however, based on the…

Methodology · Statistics 2026-01-21 Peterson Mambondimumwe , Sphiwe B. Skhosana , Najmeh Nakhaei Rad

We study identification and estimation of endogenous linear and nonlinear regression models without excluded instrumental variables, based on the standard mean independence condition and a nonlinear relevance condition. Based on the…

Econometrics · Economics 2023-08-01 Wayne Yuan Gao , Rui Wang