English
Related papers

Related papers: On Least Squares Linear Regression Without Second …

200 papers

In the setting of nonparametric multivariate regression with unknown error variance, we study asymptotic properties of a Bayesian method for estimating a regression function f and its mixed partial derivatives. We use a random series of…

Statistics Theory · Mathematics 2016-04-13 William Weimin Yoo , Subhashis Ghosal

In this paper we consider a regression model that allows for time series covariates as well as heteroscedasticity with a regression function that is modelled nonparametrically. We assume that the regression function changes at some unknown…

Statistics Theory · Mathematics 2019-09-17 Maria Mohr , Leonie Selk

We reassess the use of linear models to approximate response probabilities of binary outcomes, focusing on average partial effects (APE). We confirm that linear projection parameters coincide with APEs in certain scenarios. Through…

Econometrics · Economics 2023-10-19 Kaicheng Chen , Robert S. Martin , Jeffrey M. Wooldridge

The problem of measuring conditional dependence between two random phenomena arises when a third one (a confounder) has a potential influence on the amount of information between them. A typical issue in this challenging problem is the…

Machine Learning · Statistics 2025-03-12 Ferran de Cabrera , Marc Vilà-Insa , Jaume Riba

The ultimate goal of regression analysis is to obtain information about the conditional distribution of a response given a set of explanatory variables. This goal is, however, seldom achieved because most established regression models only…

Methodology · Statistics 2017-12-13 Torsten Hothorn , Thomas Kneib , Peter Bühlmann

We consider the problem of robustly predicting as well as the best linear combination of $d$ given functions in least squares regression, and variants of this problem including constraints on the parameters of the linear combination. For…

Statistics Theory · Mathematics 2012-02-24 Jean-Yves Audibert , Olivier Catoni

We study the asymptotic behaviour of least squares estimators in regression models for long-range dependent random fields observed on spheres. The least squares estimator can be given as a weighted functional of long-range dependent random…

Statistics Theory · Mathematics 2019-05-23 Vo Anh , Andriy Olenko , Volodymyr Vaskovych

This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response distributions. In particular, the analysis…

Statistics Theory · Mathematics 2014-03-26 Daniel Hsu , Sham M. Kakade , Tong Zhang

Nested simulation encompasses the estimation of functionals linked to conditional expectations through simulation techniques. In this paper, we treat conditional expectation as a function of the multidimensional conditioning variable and…

Statistics Theory · Mathematics 2025-04-16 Ruoxue Liu , Liang Ding , Wenjia Wang , Lu Zou

We propose simultaneous mean-variance regression for the linear estimation and approximation of conditional mean functions. In the presence of heteroskedasticity of unknown form, our method accounts for varying dispersion in the regression…

Econometrics · Economics 2019-01-04 Richard Spady , Sami Stouli

Uncertainty is ubiquitous in real-world data, and the assumptions underlying classical linear regression models are often violated in practice. Inspired by the theory of sublinear expectation, we consider a linear regression model where the…

Statistics Theory · Mathematics 2026-04-28 Xifeng Li , Shuzhen Yang

A new version of a weak nonlinear law of large numbers proposed. The existence of the first moment for any summand is not assumed. The assumption of independence is understood in the nonlinear sense, and may be further a little relaxed.

Probability · Mathematics 2025-06-10 Alina Akhmiarova , Alexander Veretennikov

Conditional expectations given past observations in stationary time series are usually estimated directly by kernel estimators, or by plugging in kernel estimators for transition densities. We show that, for linear and nonlinear…

Statistics Theory · Mathematics 2016-08-14 Ursula U. Müller , Anton Schick , Wolfgang Wefelmeyer

In modern experimental science, there is a common problem of estimating the coefficients of a linear regression in a context where the variables of interest cannot be observed simultaneously. When there is a categorical variable that is…

Methodology · Statistics 2025-03-10 Polina Arsenteva , Mohamed Amine Benadjaoud , Hervé Cardot

We consider the kernel partial least squares algorithm for non-parametric regression with stationary dependent data. Probabilistic convergence rates of the kernel partial least squares estimator to the true regression function are…

Statistics Theory · Mathematics 2017-06-13 Marco Singer , Tatyana Krivobokova , Axel Munk

In this paper, the maximal nonlinear conditional correlation of two random vectors $X$ and $Y$ given another random vector $Z$, denoted by $\rho_1(X,Y|Z)$, is defined as a measure of conditional association, which satisfies certain…

Statistics Theory · Mathematics 2010-10-20 Tzee-Ming Huang

The problem of prediction in functional linear regression is conventionally addressed by reducing dimension via the standard principal component basis. In this paper we show that an alternative basis chosen through weighted least-squares,…

Methodology · Statistics 2009-02-20 Aurore Delaigle , Peter Hall , Tatiyana V. Apanasovich

We test for departures from normal and independent and identically distributed (NIID) returns, when returns under the alternative hypothesis are self-affine. Self-affine returns are either fractionally integrated and long-range dependent,…

Statistical Finance · Quantitative Finance 2014-01-29 John Goddard , Enrico Onali

In this article, we consider the problem of estimating the index parameter $\alpha_0$ in the single index model $E[Y |X] = f_0(\alpha_0^T X)$ with $f_0$ the unknown ridge function defined on $\mathbb{R}$, $X$ a d-dimensional covariate and…

Statistics Theory · Mathematics 2017-12-19 Fadoua Balabdaoui , Gian-Andrea Thanei

For two independent, almost surely finite random variables, independence of their minimum (time) and the event that one of them is either greater, equal or less than the other (cause) is completely characterized. It is shown that, other…

Probability · Mathematics 2023-05-08 Offer Kella
‹ Prev 1 8 9 10 Next ›