English
Related papers

Related papers: Corrected Kriging update formulae for batch-sequen…

200 papers

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

For oceanographic applications, probabilistic forecasts typically have to deal with i) high-dimensional complex models, and ii) very sparse spatial observations. In search-and-rescue operations at sea, for instance, the short-term…

Applications · Statistics 2023-02-15 Florian Beiser , Håvard Heitlo Holm , Jo Eidsvik

For estimation and predictions of random fields it is increasingly acknowledged that the kriging variance may be a poor representative of true uncertainty. Experimental designs based on more elaborate criteria that are appropriate for…

Methodology · Statistics 2013-05-15 Werner G. Müller , Luc Pronzato , Joao Rendas , Helmut Waldl

One of the most common, but at the same time expensive operations in linear algebra, is multiplying two matrices $A$ and $B$. With the rapid development of machine learning and increases in data volume, performing fast matrix intensive…

Information Theory · Computer Science 2020-11-20 Neophytos Charalambides , Mert Pilanci , Alfred Hero

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

This study presents an efficient incremental/decremental approach for big streams based on Kernel Ridge Regression (KRR), a frequently used data analysis in cloud centers. To avoid reanalyzing the whole dataset whenever sensors receive new…

Machine Learning · Computer Science 2017-11-10 Bo-Wei Chen , Nik Nailah Binti Abdullah , Sangoh Park

Modern data assimilation schemes typically use the same discrete dynamical model to evolve the state estimate in time also to approximate the evolution, or propagation, of the estimation error covariance. Ensemble-based methods, such as the…

Analysis of PDEs · Mathematics 2025-08-25 Shay Gilpin

A novel single-frame quaternion estimator processing two vector observations is introduced. The singular cases are examined, and appropriate rotational solutions are provided. Additionally, an alternative method involving sequential…

Methodology · Statistics 2024-05-07 Caitong Peng , Daniel Choukroun

In the quantum optimisation setting, we build on a scheme introduced by Young et al [PRA 88, 062314, 2013], where physical qubits in multiple copies of a problem encoded into an Ising spin Hamiltonian are linked together to increase the…

Quantum Physics · Physics 2023-07-25 Jemma Bennett , Adam Callison , Tom O'Leary , Mia West , Nicholas Chancellor , Viv Kendon

We propose a novel framework for fitting additive quantile regression models, which provides well calibrated inference about the conditional quantiles and fast automatic estimation of the smoothing parameters, for model structures as…

Methodology · Statistics 2020-03-13 M. Fasiolo , S. N. Wood , M. Zaffran , R. Nedellec , Y. Goude

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

When machine learning systems meet real world applications, accuracy is only one of several requirements. In this paper, we assay a complementary perspective originating from the increasing availability of pre-trained and regularly…

The merits of the modelling philosophy of Box \& Jenkins (1970) are illustrated with a summary of our recent work on seasonal river flow forecasting. Specifically, this work demonstrates that the principle of parsimony, which has been…

Applications · Statistics 2016-11-08 A. Ian McLeod

While the formulation of most data assimilation schemes assumes an unbiased observation model error, in real applications, model error with nontrivial biases is unavoidable. A practical example is the error in the radiative transfer model…

Methodology · Statistics 2016-11-17 John Harlim , Tyrus Berry

Recently, the cyclic association rules have been introduced in order to discover rules from items characterized by their regular variation over time. In real life situations, temporal databases are often appended or updated. Rescanning the…

Databases · Computer Science 2015-06-01 Eya ben Ahmed , Mohamed Salah Gouider

We develop new methods to integrate experimental and observational data in causal inference. While randomized controlled trials offer strong internal validity, they are often costly and therefore limited in sample size. Observational data,…

Econometrics · Economics 2025-11-04 Xuelin Yang , Licong Lin , Susan Athey , Michael I. Jordan , Guido W. Imbens

We propose EAGLE update rule, a novel optimization method that accelerates loss convergence during the early stages of training by leveraging both current and previous step parameter and gradient values. The update algorithm estimates…

Machine Learning · Computer Science 2025-02-04 Takumi Fujimoto , Hiroaki Nishi

We consider performing simulation experiments in the presence of covariates. Here, covariates refer to some input information other than system designs to the simulation model that can also affect the system performance. To make decisions,…

Methodology · Statistics 2022-11-28 Cheng Li , Siyang Gao , Jianzhong Du

Data assimilation is often viewed as a framework for correcting short-term error growth in dynamical climate model forecasts. When viewed on the time scales of climate however, these short-term corrections, or analysis increments, can…

Atmospheric and Oceanic Physics · Physics 2023-10-02 William Gregory , Mitchell Bushuk , Alistair Adcroft , Yongfei Zhang , Laure Zanna