English
Related papers

Related papers: Benign Overfitting in Time Series Linear Models wi…

200 papers

Data-driven methods for modeling dynamic systems have received considerable attention as they provide a mechanism for control synthesis directly from the observed time-series data. In the absence of prior assumptions on how the time-series…

Optimization and Control · Mathematics 2018-09-24 Atiye Alaeddini , Siavash Alemzadeh , Afshin Mesbahi , Mehran Mesbahi

Overfitting, which happens when the number of parameters in a model is too large compared to the number of data points available for determining these parameters, is a serious and growing problem in survival analysis. While modern medicine…

Applications · Statistics 2017-09-13 ACC Coolen , JE Barrett , P Paga , CJ Perez-Vicente

This paper considers a general class of nonparametric time series regression models where the regression function can be time-dependent. We establish an asymptotic theory for estimates of the time-varying regression functions. For this…

Statistics Theory · Mathematics 2015-03-19 Ting Zhang , Wei Biao Wu

This paper is concerned with modeling the dependence structure of two (or more) time-series in the presence of a (possible multivariate) covariate which may include past values of the time series. We assume that the covariate influences…

Statistics Theory · Mathematics 2018-12-11 Natalie Neumeyer , Marek Omelka , Sarka Hudecova

These lecture notes provide an overview of existing methodologies and recent developments for estimation and inference with high dimensional time series regression models. First, we present main limit theory results for high dimensional…

Econometrics · Economics 2023-09-01 Christis Katsouris

For the challenging task of modeling multivariate time series, we propose a new class of models that use dependent Mat\'ern processes to capture the underlying structure of data, explain their interdependencies, and predict their unknown…

Machine Learning · Statistics 2015-02-13 Alexander Vandenberg-Rodes , Babak Shahbaba

In many modern applications of deep learning the neural network has many more parameters than the data points used for its training. Motivated by those practices, a large body of recent theoretical research has been devoted to studying…

Statistics Theory · Mathematics 2022-12-07 A. Tsigler , P. L. Bartlett

The recent success of neural network models has shone light on a rather surprising statistical phenomenon: statistical models that perfectly fit noisy data can generalize well to unseen test data. Understanding this phenomenon of…

Machine Learning · Statistics 2022-09-13 Niladri S. Chatterji , Philip M. Long , Peter L. Bartlett

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

We consider parameter estimation, hypothesis testing and variable selection for partially time-varying coefficient models. Our asymptotic theory has the useful feature that it can allow dependent, nonstationary error and covariate…

Statistics Theory · Mathematics 2012-08-20 Ting Zhang , Wei Biao Wu

Study of time series data often involves measuring the strength of temporal dependence, on which statistical properties like consistency and central limit theorem are built. Historically, various dependence measures have been proposed. In…

Statistics Theory · Mathematics 2019-07-16 Fang Han , Weibiao Wu

In this paper we propose a solution to the problem of parameter estimation of nonlinearly parameterized regressions--continuous or discrete time--and apply it for system identification and adaptive control. We restrict our attention to…

Optimization and Control · Mathematics 2019-10-18 Romeo Ortega , Vladislav Gromov , Emmanuel Nuño , Anton Pyrkin , Jose Guadalupe Romero

These lecture notes represent supplementary material for a short course on time series econometrics and network econometrics. We give emphasis on limit theory for time series regression models as well as the use of the local-to-unity…

Econometrics · Economics 2023-08-15 Christis Katsouris

In the nonparametric regression setting, we construct an estimator which is a continuous function interpolating the data points with high probability, while attaining minimax optimal rates under mean squared risk on the scale of H\"older…

Statistics Theory · Mathematics 2022-06-28 Julien Chhor , Suzanne Sigalla , Alexandre B. Tsybakov

The time series theory is set in this work under the domain of general elliptically contoured distributions. The advent of a time series approach that is in accordance with the expected reality of dependence between errors, transfers the…

In many applications it is desirable to infer coarse-grained models from observational data. The observed process often corresponds only to a few selected degrees of freedom of a high-dimensional dynamical system with multiple time scales.…

Statistics Theory · Mathematics 2015-05-06 Serafim Kalliadasis , Sebastian Krumscheid , Grigorios A. Pavliotis

The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains…

One of the major open problems in machine learning is to characterize generalization in the overparameterized regime, where most traditional generalization bounds become inconsistent even for overparameterized linear regression. In many…

Machine Learning · Computer Science 2023-11-22 Jing Xu , Jiaye Teng , Yang Yuan , Andrew Chi-Chih Yao

Although the independent censoring assumption is commonly used in survival analysis, it can be violated when the censoring time is related to the survival time, which often happens in many practical applications. To address this issue, we…

Methodology · Statistics 2024-08-28 Huazhen Yu , Lixin Zhang

We study the problem of parameter estimation for time-series possessing two, widely separated, characteristic time scales. The aim is to understand situations where it is desirable to fit a homogenized singlescale model to such multiscale…

Statistics Theory · Mathematics 2009-11-11 G. A. Pavliotis , A. M. Stuart
‹ Prev 1 2 3 10 Next ›