English
Related papers

Related papers: Nonlinear generalization of the monotone single in…

200 papers

The standard linear and logistic regression models assume that the response variables are independent, but share the same linear relationship to their corresponding vectors of covariates. The assumption that the response variables are…

Machine Learning · Computer Science 2019-10-09 Constantinos Daskalakis , Nishanth Dikkala , Ioannis Panageas

This study proposes a mathematical programming-based algorithm for the integrated selection of variable subsets and bandwidth estimation in geographically weighted regression, a local regression method that allows the kernel bandwidth and…

Methodology · Statistics 2025-03-24 Hyunwoo Lee , Young Woong Park

We want to recover the regression function in the single-index model. Using an aggregation algorithm with local polynomial estimators, we answer in particular to the second part of Question~2 from Stone (1982) on the optimal convergence…

Statistics Theory · Mathematics 2007-12-04 Stéphane Gaïffas , Guillaume Lecué

We propose a method for learning linear models whose predictive performance is robust to causal interventions on unobserved variables, when noisy proxies of those variables are available. Our approach takes the form of a regularization term…

Machine Learning · Computer Science 2021-06-29 Michael Oberst , Nikolaj Thams , Jonas Peters , David Sontag

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary…

Methodology · Statistics 2021-12-14 Siegfried Hörmann , Fatima Jammoul

This paper analyzes the classical linear regression model with measurement errors in all the variables. First, we provide necessary and sufficient conditions for identification of the coefficients. We show that the coefficients are not…

Methodology · Statistics 2023-06-22 Dan Ben-Moshe

This paper analyzes the possibilities of using the generalized ridge regression to mitigate multicollinearity in a multiple linear regression model. For this purpose, we obtain the expressions for the estimated variance, the coefficient of…

To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stacked gamma…

Machine Learning · Statistics 2016-08-24 Mingyuan Zhou

Recent advances in quantized compressed sensing and high-dimensional estimation have shown that signal recovery is even feasible under strong non-linear distortions in the observation process. An important characteristic of associated…

Information Theory · Computer Science 2023-08-08 Martin Genzel , Alexander Stollenwerk

In this paper, we consider the time-inhomogeneous nonlinear time series regression for a general class of locally stationary time series. On one hand, we propose sieve nonparametric estimators for the time-varying regression functions which…

Statistics Theory · Mathematics 2021-12-17 Xiucai Ding , Zhou Zhou

Linear regression is a fundamental modeling tool in statistics and related fields. In this paper, we study an important variant of linear regression in which the predictor-response pairs are partially mismatched. We use an optimization…

Optimization and Control · Mathematics 2022-11-01 Rahul Mazumder , Haoyue Wang

A semi-parametric, non-linear regression model in the presence of latent variables is introduced. These latent variables can correspond to unmodeled phenomena or unmeasured agents in a complex networked system. This new formulation allows…

Machine Learning · Statistics 2018-06-29 Jonathan Mei , José M. F. Moura

Semiparametric single-index assumptions are convenient and widely used dimen\-sion reduction approaches that represent a compromise between the parametric and fully nonparametric models for regressions or conditional laws. In a mean…

Statistics Theory · Mathematics 2014-10-21 Samuel Maistre , Valentin Patilea

This paper investigates and extends the computationally attractive nonparametric random coefficients estimator of Fox, Kim, Ryan, and Bajari (2011). We show that their estimator is a special case of the nonnegative LASSO, explaining its…

Econometrics · Economics 2019-09-20 Florian Heiss , Stephan Hetzenecker , Maximilian Osterhaus

We propose the use of indirect inference estimation to conduct inference in complex locally stationary models. We develop a local indirect inference algorithm and establish the asymptotic properties of the proposed estimator. Due to the…

Econometrics · Economics 2020-12-17 David Frazier , Bonsoo Koo

We consider the model of nonregular nonparametric regression where smoothness constraints are imposed on the regression function $f$ and the regression errors are assumed to decay with some sharpness level at their endpoints. The aim of…

Statistics Theory · Mathematics 2014-10-02 Moritz Jirak , Alexander Meister , Markus Reiß

This paper considers a linear regression model with an endogenous regressor which arises from a nonlinear transformation of a latent variable. It is shown that the corresponding coefficient can be consistently estimated without external…

Econometrics · Economics 2023-11-08 Jörg Breitung , Alexander Mayer , Dominik Wied

In prediction problems with more predictors than observations, it can sometimes be helpful to use a joint probability model, $\pi(Y,X)$, rather than a purely conditional model, $\pi(Y \mid X)$, where $Y$ is a scalar response variable and…

Methodology · Statistics 2010-11-17 P. Richard Hahn , Sayan Mukherjee , Carlos Carvalho

The problem of nonparametric inference on a monotone function has been extensively studied in many particular cases. Estimators considered have often been of so-called Grenander type, being representable as the left derivative of the…

Statistics Theory · Mathematics 2018-12-03 Ted Westling , Marco Carone