English
Related papers

Related papers: Empirical process of residuals for regression mode…

200 papers

This paper describes limiting behaviour of tail empirical process associated with long memory stochastic volatility models. We show that such process has dichotomous behaviour, according to an interplay between a Hurst parameter and a tail…

Statistics Theory · Mathematics 2010-11-23 Rafal Kulik , Philippe Soulier

We consider the error distribution in functional linear models with scalar response and functional covariate. Different asymptotic expansions of the empirical distribution function and the empirical characteristic function based on…

Methodology · Statistics 2025-12-01 Natalie Neumeyer , Leonie Selk

We consider a random interval splitting process, in which the splitting rule depends on the empirical distribution of interval lengths. We show that this empirical distribution converges to a limit almost surely as the number of intervals…

Probability · Mathematics 2018-06-20 Pascal Maillard , Elliot Paquette

We consider estimation procedures which are recursive in the sense that each successive estimator is obtained from the previous one by a simple adjustment. We study rate of convergence of recursive estimation procedures for the general…

Statistics Theory · Mathematics 2007-05-23 Teo Sharia

Nonparametric cointegrating regression models have been extensively used in financial markets, stock prices, heavy traffic, climate data sets, and energy markets. Models with parametric regression functions can be more appealing in practice…

Methodology · Statistics 2023-12-27 Sepideh Mosaferi , Mark S. Kaiser , Daniel J. Nordman

Empirical design in reinforcement learning is no small task. Running good experiments requires attention to detail and at times significant computational resources. While compute resources available per dollar have continued to grow…

Machine Learning · Computer Science 2024-10-30 Andrew Patterson , Samuel Neumann , Martha White , Adam White

We study the minimal error of the Empirical Risk Minimization (ERM) procedure in the task of regression, both in the random and the fixed design settings. Our sharp lower bounds shed light on the possibility (or impossibility) of adapting…

Statistics Theory · Mathematics 2021-02-25 Gil Kur , Alexander Rakhlin

The inspection of residuals is a fundamental step to investigate the quality of adjustment of a parametric model to data. For spatial point processes, the concept of residuals has been recently proposed by Baddeley et al. (2005) as an…

Statistics Theory · Mathematics 2013-08-07 Jean-François Coeurjolly , Frédéric Lavancier

In survival or reliability studies, the mean residual life or life expectancy is an important characteristic of the model. Here, we study the limiting behaviour of the mean residual life, and derive an asymptotic expansion which can be used…

Statistics Theory · Mathematics 2007-06-13 David M. Bradley , Ramesh C. Gupta

For long-memory time series, inference based on resampling is of crucial importance, since the asymptotic distribution can often be non-Gaussian and is difficult to determine statistically. However due to the strong dependence, establishing…

Statistics Theory · Mathematics 2016-11-10 Shuyang Bai , Murad S. Taqqu

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

Machine Learning · Statistics 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

Individual-specific, time-constant, random effects are often used to model dependence and/or to account for omitted covariates in regression models for longitudinal responses. Longitudinal studies have known a huge and widespread use in the…

Methodology · Statistics 2026-01-14 Marco Alfo' , Roberto Rocci

This paper establishes bounds on the performance of empirical risk minimization for large-dimensional linear regression. We generalize existing results by allowing the data to be dependent and heavy-tailed. The analysis covers both the…

Econometrics · Economics 2025-04-23 Christian Brownlees , Guðmundur Stefán Guðmundsson

The processes of the averaged regression quantiles and of their modifications provide useful tools in the regression models when the covariates are not fully under our control. As an application we mention the probabilistic risk assessment…

Statistics Theory · Mathematics 2017-10-19 Jana Jurečková , Martin Schindler , Jan Picek

Optimization models used to make discrete decisions often contain uncertain parameters that are context-dependent and estimated through prediction. To account for the quality of the decision made based on the prediction, decision-focused…

Machine Learning · Computer Science 2024-07-30 Noah Schutte , Krzysztof Postek , Neil Yorke-Smith

A residual-based empirical distribution function is proposed to estimate the distribution function of the errors of a heteroskedastic nonparametric regression with responses missing at random based on completely observed data, and this…

Methodology · Statistics 2016-10-28 Justin Chown

In regression with random design, we study the problem of selecting a model that performs well for out-of-sample prediction. We do not assume that any of the candidate models under consideration are correct. Our analysis is based on…

Methodology · Statistics 2008-10-24 Hannes Leeb

Long memory in the sense of slowly decaying autocorrelations is a stylized fact in many time series from economics and finance. The fractionally integrated process is the workhorse model for the analysis of these time series. Nevertheless,…

Econometrics · Economics 2023-09-22 Uwe Hassler , Marc-Oliver Pohle

Empirical risk minimization is a standard principle for choosing algorithms in learning theory. In this paper we study the properties of empirical risk minimization for time series. The analysis is carried out in a general framework that…

Machine Learning · Statistics 2021-08-12 Christian Brownlees , Jordi Llorens-Terrazas

This paper discusses two goodness-of-fit testing problems. The first problem pertains to fitting an error distribution to an assumed nonlinear parametric regression model, while the second pertains to fitting a parametric regression model…

Statistics Theory · Mathematics 2007-06-13 Estate V. Khmaladze , Hira L. Koul