English
Related papers

Related papers: Evaluating time series forecasting models: An empi…

200 papers

Time series forecasting is one of the most active research topics. Machine learning methods have been increasingly adopted to solve these predictive tasks. However, in a recent work, these were shown to systematically present a lower…

Machine Learning · Statistics 2019-10-01 Vitor Cerqueira , Luis Torgo , Carlos Soares

Predictions about people, such as their expected educational achievement or their credit risk, can be performative and shape the outcome that they aim to predict. Understanding the causal effect of these predictions on the eventual outcomes…

Machine Learning · Statistics 2022-10-19 Celestine Mendler-Dünner , Frances Ding , Yixin Wang

Time series forecasting is a critical task in various domains, where accurate predictions can drive informed decision-making. Traditional forecasting methods often rely on current observations of variables to predict future outcomes,…

Machine Learning · Computer Science 2026-03-17 Wentao Gao , Xiaojing Du , Wenjun Yu , Xiongren Chen , Yifan Guo , Feiyu Yang

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

Neural Posterior Estimation methods for simulation-based inference can be ill-suited for dealing with posterior distributions obtained by conditioning on multiple observations, as they tend to require a large number of simulator calls to…

Machine Learning · Computer Science 2023-07-11 Tomas Geffner , George Papamakarios , Andriy Mnih

In machine learning, statistics, econometrics and statistical physics, cross-validation (CV) is used asa standard approach in quantifying the generalisation performance of a statistical model. A directapplication of CV in time-series leads…

Machine Learning · Statistics 2021-12-14 Mehmet Süzen , Alper Yegenoglu

We consider the problem of sequentially testing for changes in the mean parameter of a time series, compared to a benchmark period. Most tests in the literature focus on the null hypothesis of a constant mean versus the alternative of a…

Methodology · Statistics 2025-09-23 Patrick Bastian , Tim Kutta , Rupsa Basu , Holger Dette

An increasing body of research focuses on using neural networks to model time series. A common assumption in training neural networks via maximum likelihood estimation on time series is that the errors across time steps are uncorrelated.…

Machine Learning · Computer Science 2021-10-12 Fan-Keng Sun , Christopher I. Lang , Duane S. Boning

In this work a method for statistical analysis of time series is proposed, which is used to obtain solutions to some classical problems of mathematical statistics under the only assumption that the process generating the data is stationary…

Information Theory · Computer Science 2012-04-05 Daniil Ryabko , Boris Ryabko

When building linear or nonlinear models one is faced with the problem of selecting the best set of variable with which to predict the future dynamics. In nonlinear time series analysis the problem is to select the correct time delays in…

Chaotic Dynamics · Physics 2007-05-23 Michael Small

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

In the era of increasingly complex AI models for time series forecasting, progress is often measured by marginal improvements on benchmark leaderboards. However, this approach suffers from a fundamental flaw: standard evaluation metrics…

Machine Learning · Computer Science 2026-05-28 Wanjin Feng , Yuan Yuan , Jingtao Ding , Yong Li

This paper provides insight into when, why, and how forecast strategies fail when they are applied to complicated time series. We conjecture that the inherent complexity of real-world time-series data---which results from the dimension,…

Information Theory · Computer Science 2014-11-24 Joshua Garland , Ryan James , Elizabeth Bradley

In this paper we study different approaches for time series modeling. The forecasting approaches using linear models, ARIMA alpgorithm, XGBoost machine learning algorithm are described. Results of different model combinations are shown. For…

Applications · Statistics 2017-03-07 B. M. Pavlyshenko

We investigate model assessment and selection in a changing environment, by synthesizing datasets from both the current time period and historical epochs. To tackle unknown and potentially arbitrary temporal distribution shift, we develop…

Machine Learning · Computer Science 2024-06-05 Elise Han , Chengpiao Huang , Kaizheng Wang

Time series forecasting has gained lots of attention recently; this is because many real-world phenomena can be modeled as time series. The massive volume of data and recent advancements in the processing power of the computers enable…

Machine Learning · Computer Science 2021-04-01 Manie Tadayon , Yumi Iwashita

Time Series Forecasting is at the core of many practical applications such as sales forecasting for business, rainfall forecasting for agriculture and many others. Though this problem has been extensively studied for years, it is still…

Machine Learning · Computer Science 2020-03-23 Anirban Chatterjee , Subhadip Paul , Uddipto Dutta , Smaranya Dey

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Deep learning methods achieve remarkable predictive performance in modeling complex, large-scale data. However, assessing the quality of derived models has become increasingly challenging, as more classical statistical assumptions may no…

Machine Learning · Statistics 2026-03-02 Daniele Zambon , Cesare Alippi

Real-world time series are influenced by numerous factors and exhibit complex non-stationary characteristics. Non-stationarity can lead to distribution shifts, where the statistical properties of time series change over time, negatively…

Machine Learning · Computer Science 2025-10-13 Zipo Jibao , Yingyi Fu , Xinyang Chen , Guoting Chen