English
Related papers

Related papers: Forecast error growth: A dynamic-stochastic model

200 papers

Spatio-temporal process models are often used for modeling dynamic physical and biological phenomena that evolve across space and time. These phenomena may exhibit environmental heterogeneity and complex interactions that are difficult to…

Methodology · Statistics 2026-01-06 Pratik Nag , Andrew Zammit-Mangion , Sumeetpal Singh , Noel Cressie

Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE…

In this paper, prediction for linear systems with missing information is investigated. New methods are introduced to improve the Mean Squared Error (MSE) on the test set in comparison to state-of-the-art methods, through appropriate tuning…

Machine Learning · Statistics 2017-01-04 Mohammad Amin Fakharian , Ashkan Esmaeili , Farokh Marvasti

Multi-agent trajectory prediction is crucial for various practical applications, spurring the construction of many large-scale trajectory datasets, including vehicles and pedestrians. However, discrepancies exist among datasets due to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon

We develop a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the $\ell_0$-penalized least squares solutions. It generates…

Computation · Statistics 2017-01-19 Jian Huang , Yuling Jiao , Yanyan Liu , Xiliang Lu

Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing…

Machine Learning · Computer Science 2021-05-12 Patrick Kidger , James Foster , Xuechen Li , Harald Oberhauser , Terry Lyons

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

We revisit the theoretical properties of Hamiltonian stochastic differential equations (SDES) for Bayesian posterior sampling, and we study the two types of errors that arise from numerical SDE simulation: the discretization error and the…

Machine Learning · Computer Science 2021-11-08 Giulio Franzese , Dimitrios Milios , Maurizio Filippone , Pietro Michiardi

Increasingly larger data sets of processes in space and time ask for statistical models and methods that can cope with such data. We show that the solution of a stochastic advection-diffusion partial differential equation provides a…

Methodology · Statistics 2016-02-18 Fabio Sigrist , Hans R. Künsch , Werner A. Stahel

The neural Ordinary Differential Equation (ODE) model has shown success in learning complex continuous-time processes from observations on discrete time stamps. In this work, we consider the modeling and forecasting of time series data that…

Machine Learning · Statistics 2023-06-05 Yixuan Tan , Liyan Xie , Xiuyuan Cheng

AI weather prediction ensembles with latent noise injection and optimized with the continuous ranked probability score (CRPS) have produced both accurate and well-calibrated predictions with far less computational cost compared with…

This chapter focuses on variable maturation delay or, more precisely, on the mathematical description of a size-structured population consuming an unstructured resource. When the resource concentration is a known function of time, we can…

Populations and Evolution · Quantitative Biology 2025-10-21 Odo Diekmann , Francesca Scarabel

Stochastic parametrisations are used in weather and climate models to improve the representation of unpredictable unresolved processes. When compared to a deterministic model, a stochastic model represents `model uncertainty', i.e., sources…

Atmospheric and Oceanic Physics · Physics 2020-04-22 Hannah M. Christensen

Recent innovations in diffusion probabilistic models have paved the way for significant progress in image, text and audio generation, leading to their applications in generative time series forecasting. However, leveraging such abilities to…

Machine Learning · Computer Science 2025-11-07 Yuansan Liu , Sudanthi Wijewickrema , Dongting Hu , Christofer Bester , Stephen O'Leary , James Bailey

We identify effective stochastic differential equations (SDE) for coarse observables of fine-grained particle- or agent-based simulations; these SDE then provide useful coarse surrogate models of the fine scale dynamics. We approximate the…

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

In the first part of this paper I give the historical background to my initial interest in stochastic analysis and to the writing of my book Stochastic Differential Equations. The first edition of this book was published by Springer in…

Probability · Mathematics 2022-11-01 Bernt Øksendal

Neural Stochastic Differential Equations model a dynamical environment with neural nets assigned to their drift and diffusion terms. The high expressive power of their nonlinearity comes at the expense of instability in the identification…

Machine Learning · Computer Science 2021-03-01 Manuel Haussmann , Sebastian Gerwinn , Andreas Look , Barbara Rakitsch , Melih Kandemir

We demonstrate how to model the toppling activity in avalanching systems by stochastic differential equations (SDEs). The theory is developed as a generalization of the classical mean field approach to sandpile dynamics by formulating it as…

Adaptation and Self-Organizing Systems · Physics 2009-11-13 Martin Rypdal , Kristoffer Rypdal

This letter presents a high-dimensional analysis of the training dynamics for a single-layer nonlinear contrastive learning model. The empirical distribution of the model weights converges to a deterministic measure governed by a…

Machine Learning · Computer Science 2024-06-12 Lineghuan Meng , Chuang Wang