English
Related papers

Related papers: Regression rank scores in nonlinear models

200 papers

We analyze the prediction error of ridge regression in an asymptotic regime where the sample size and dimension go to infinity at a proportional rate. In particular, we consider the role played by the structure of the true regression…

Statistics Theory · Mathematics 2021-03-09 Dominic Richards , Jaouad Mourtada , Lorenzo Rosasco

We consider inference about a scalar parameter under a non-parametric model based on a one-step estimator computed as a plug in estimator plus the empirical mean of an estimator of the parameter's influence function. We focus on a class of…

Statistics Theory · Mathematics 2019-06-07 Ezequiel Smucler , Andrea Rotnitzky , James M. Robins

Under a partially linear models we study a family of robust estimates for the regression parameter and the regression function when some of the predictor variables take values on a Riemannian manifold. We obtain the consistency and the…

Statistics Theory · Mathematics 2011-05-26 Guillermo Henry , Daniela Rodriguez

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

We consider continuous-time models with a large panel of moment conditions, where the structural parameter depends on a set of characteristics, whose effects are of interest. The leading example is the linear factor model in financial…

Econometrics · Economics 2018-12-04 Yuan Liao , Xiye Yang

A method for estimating nonlinear regression errors and their distributions without performing regression is presented. Assuming continuity of the modeling function the variance is given in terms of conditional probabilities extracted from…

Machine Learning · Statistics 2014-04-15 Hong Pi , Carsten Peterson

Many important problems in psychology and biomedical studies require testing for overdispersion, correlation and heterogeneity in mixed effects and latent variable models, and score tests are particularly useful for this purpose. But the…

Statistics Theory · Mathematics 2007-06-13 Hongtu Zhu , Heping Zhang

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

This paper considers a linear regression model with an endogenous regressor which arises from a nonlinear transformation of a latent variable. It is shown that the corresponding coefficient can be consistently estimated without external…

Econometrics · Economics 2023-11-08 Jörg Breitung , Alexander Mayer , Dominik Wied

The paper considers the problem of robust estimating a periodic function in a continuous time regression model with dependent disturbances given by a general square integrable semimartingale with unknown distribution. An example of such a…

Statistics Theory · Mathematics 2010-10-20 Victor Konev , Serguei Pergamenchtchikov

A local linear kernel estimator of the regression function x\mapsto g(x):=E[Y_i|X_i=x], x\in R^d, of a stationary (d+1)-dimensional spatial process {(Y_i,X_i),i\in Z^N} observed over a rectangular domain of the form I_n:={i=(i_1,...,i_N)\in…

Statistics Theory · Mathematics 2007-06-13 Marc Hallin , Zudi Lu , Lanh T. Tran

Expectile regression is a useful tool for exploring the relation between the response and the explanatory variables beyond the conditional mean. This article develops a continuous threshold expectile regression for modeling data in which…

Methodology · Statistics 2016-11-09 Feipeng Zhang , Qunhua Li

Regression evaluation has been performed for decades. Some metrics have been identified to be robust against shifting and scaling of the data but considering the different distributions of data is much more difficult to address (imbalance…

Machine Learning · Computer Science 2020-09-14 Mario Michael Krell , Bilal Wehbe

Robust and semiparametric statistics are of the same historical origin and largely employ the same locally asymptotically normal framework. In our talk, we consider he following more intrinsic connections of both fields: 1) Robust influence…

Statistics Theory · Mathematics 2013-06-25 Helmut Rieder

This paper discusses the solution of nonlinear integral equations with noisy integral kernels as they appear in nonparametric instrumental regression. We propose a regularized Newton-type iteration and establish convergence and convergence…

Numerical Analysis · Mathematics 2015-04-01 Fabian Dunker , Jean-Pierre Florens , Thorsten Hohage , Jan Johannes , Enno Mammen

A recent literature considers causal inference using noisy proxies for unobserved confounding factors. The proxies are divided into two sets that are independent conditional on the confounders. One set of proxies are `negative control…

Econometrics · Economics 2021-10-11 Ben Deaner

In this article the notion of the nondecreasing (ND) rank of a matrix or tensor is introduced. A tensor has an ND rank of r if it can be represented as a sum of r outer products of vectors, with each vector satisfying a monotonicity…

Machine Learning · Statistics 2025-10-21 Andrew McCormack

In this paper, we explore the asymptotically optimal tuning parameter choice in ridge regression for estimating nuisance functions of a statistical functional that has recently gained prominence in conditional independence testing and…

Statistics Theory · Mathematics 2025-10-28 Sean McGrath , Debarghya Mukherjee , Rajarshi Mukherjee , Zixiao Jolene Wang

We provide non-asymptotic excess risk guarantees for statistical learning in a setting where the population risk with respect to which we evaluate the target parameter depends on an unknown nuisance parameter that must be estimated from…

Statistics Theory · Mathematics 2023-06-07 Dylan J. Foster , Vasilis Syrgkanis

We develop a class of tests for semiparametric vector autoregressive (VAR) models with unspecified innovation densities, based on the recent measure-transportation-based concepts of multivariate {\it center-outward ranks} and {\it signs}.…

Statistics Theory · Mathematics 2020-11-13 Marc Hallin , Davide La Vecchia , Hang Liu