English
Related papers

Related papers: Forecasting under Long Memory and Nonstationarity

200 papers

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Simulating longitudinal data from specified marginal structural models is a crucial but challenging task for evaluating causal inference methods and informing study design. While data generation typically proceeds in a fully conditional…

Methodology · Statistics 2025-04-25 Xi Lin , Daniel de Vassimon Manela , Chase Mathis , Jens Magelund Tarp , Robin J. Evans

Neural networks have revolutionized many empirical fields, yet their application to financial time series forecasting remains controversial. In this study, we demonstrate that the conventional practice of estimating models locally in…

Econometrics · Economics 2025-02-21 Chen Liu , Minh-Ngoc Tran , Chao Wang , Richard Gerlach , Robert Kohn

We introduce a novel online multitask setting. In this setting each task is partitioned into a sequence of segments that is unknown to the learner. Associated with each segment is a hypothesis from some hypothesis class. We give algorithms…

Machine Learning · Computer Science 2020-08-18 Mark Herbster , Stephen Pasteris , Lisa Tse

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

Using kicked differential equations of motion with derivatives of noninteger orders, we obtain generalizations of the dissipative standard map. The main property of these generalized maps, which are called fractional maps, is long-term…

Chaotic Dynamics · Physics 2014-03-03 Vasily E. Tarasov , Mark Edelman

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

This article develops flexible methodology to study the association between scalar outcomes and functional predictors observed over time, at many instances, in longitudinal studies. We propose a parsimonious modeling framework to study…

Applications · Statistics 2018-01-25 Md Nazmul Islam , Ana-Maria Staicu , Eric van Heugten

In this paper, we propose two nonparametric methods used in the forecasting of functional time-dependent data, namely functional singular spectrum analysis recurrent forecasting and vector forecasting. Both algorithms utilize the results of…

Machine Learning · Statistics 2021-01-28 Jordan Trinka , Hossein Haghbin , Mehdi Maadooliat

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

Traditional Functional Principal Component Analysis typically focuses on densely observed univariate functional data, yet many applications, particularly in longitudinal studies, involve multivariate functional data observed sparsely and…

Methodology · Statistics 2026-03-23 Uche Mbaka , Michelle Carey

This article develops nonparametric cointegrating regression models with endogeneity and semi-long memory. We assume that semi-long memory is produced in the regressor process by tempering of random shock coefficients. The fundamental…

Econometrics · Economics 2025-01-31 Sepideh Mosaferi , Mark S. Kaiser

Long Short-Term Memory (LSTM) is a well-known method used widely on sequence learning and time series prediction. In this paper we deployed stacked LSTM model in an application of weather forecasting. We propose a 2-layer spatio-temporal…

Machine Learning · Computer Science 2018-11-16 Zahra Karevan , Johan A. K. Suykens

A new single-index model that reflects the time-dynamic effects of the single index is proposed for longitudinal and functional response data, possibly measured with errors, for both longitudinal and time-invariant covariates. With…

Statistics Theory · Mathematics 2011-03-10 Ci-Ren Jiang , Jane-Ling Wang

We propose nonparametric methods for functional linear regression which are designed for sparse longitudinal data, where both the predictor and response are functions of a covariate such as time. Predictor and response processes have smooth…

Statistics Theory · Mathematics 2016-08-16 Fang Yao , Hans-Georg Müller , Jane-Ling Wang

The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavior as a function of the number of available samples, with far…

Machine Learning · Computer Science 2024-11-12 Tomer Berg , Or Ordentlich , Ofer Shayevitz

We propose a model of fractal point process driven by the nonlinear stochastic differential equation. The model is adjusted to the empirical data of trading activity in financial markets. This reproduces the probability distribution…

Physics and Society · Physics 2009-11-13 V. Gontis , B. Kaulakys

We introduce a Gaussian process-based model for handling of non-stationarity. The warping is achieved non-parametrically, through imposing a prior on the relative change of distance between subsequent observation inputs. The model allows…

Machine Learning · Statistics 2019-12-06 David Tolpin

Empirical researchers increasingly use upstream machine-learning (ML) methods to construct proxies for latent target variables from complex, unstructured data. A naive plug-in use of such proxies in downstream econometric models, however,…

Econometrics · Economics 2026-04-14 Lixiong Li