English
Related papers

Related papers: Convergent least-squares optimisation methods for …

200 papers

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

The online prediction of multivariate signals, existing simultaneously in space and time, from noisy partial observations is a fundamental task in numerous applications. We propose an efficient Neural Network architecture for the online…

Machine Learning · Computer Science 2024-01-30 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

The use of machine learning (ML) models in meteorology has attracted significant attention for their potential to improve weather forecasting efficiency and accuracy. GraphCast and NeuralGCM, two promising ML-based weather models, are at…

Atmospheric and Oceanic Physics · Physics 2024-11-25 Xiaoxu Tian , Daniel Holdaway , Daryl Kleist

Non-Gaussian statistics are a challenge for data assimilation. Linear methods oversimplify the problem, yet fully nonlinear methods are often too expensive to use in practice. The best solution usually lies between these extremes.…

Computation · Statistics 2026-03-20 Berent Å. S. Lunde , Maximilian Ramgraber

We commonly refer to state-estimation theory in geosciences as data assimilation. This term encompasses the entire sequence of operations that, starting from the observations of a system, and from additional statistical and dynamical…

Atmospheric and Oceanic Physics · Physics 2018-06-11 Alberto Carrassi , Marc Bocquet , Laurent Bertino , Geir Evensen

A non-Bayesian, regression-based or generalized least squares (GLS)-based approach is formally proposed to estimate a class of time-varying AR parameter models. This approach has partly been used by Ito et al. (2014, 2016a,b), and is proven…

Methodology · Statistics 2017-12-22 Mikio Ito , Akihiko Noda , Tatsuma Wada

State estimation in multi-layer turbulent flow fields with only a single layer of partial observation remains a challenging yet practically important task. Applications include inferring the state of the deep ocean by exploiting surface…

Fluid Dynamics · Physics 2025-09-30 Zhongrui Wang , Nan Chen , Di Qi

Statistical downscaling of global climate models (GCMs) allows researchers to study local climate change effects decades into the future. A wide range of statistical models have been applied to downscaling GCMs but recent advances in…

Machine Learning · Statistics 2017-02-15 Thomas Vandal , Evan Kodra , Auroop R Ganguly

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

We consider stochastic approximation for the least squares regression problem in the non-strongly convex setting. We present the first practical algorithm that achieves the optimal prediction error rates in terms of dependence on the noise…

Machine Learning · Computer Science 2022-03-04 Aditya Varre , Nicolas Flammarion

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

In this paper, we propose a reduced order approach for 3D variational data assimilation governed by parametrized partial differential equations. In contrast to the classical 3D-VAR formulation that penalizes the measurement error directly,…

Numerical Analysis · Mathematics 2019-05-16 Nicole Aretz-Nellesen , Martin A. Grepl , Karen Veroy

This paper presents a unified Least-Squares framework for solving nonlinear partial differential equations by recasting the governing system as a residual minimisation problem. A Least-Squares functional is formulated and the corresponding…

Numerical Analysis · Mathematics 2025-11-10 Fleurianne Bertrand , Maximilian Brodbeck , Tim Ricken , Henrik Schneider

Variational data assimilation technique applied to identification of optimal approximations of derivatives near boundary is discussed in frames of one-dimensional wave equation. Simplicity of the equation and of its numerical scheme allows…

Mathematical Physics · Physics 2015-05-13 Eugene Kazantsev

There is growing awareness that errors in the model equations cannot be ignored in data assimilation methods such as four-dimensional variational assimilation (4D-Var). If allowed for, more information can be extracted from observations,…

Numerical Analysis · Mathematics 2021-11-24 Ieva Daužickaitė , Amos S. Lawless , Jennifer A. Scott , Peter Jan van Leeuwen

Data assimilation (DA) aims at forecasting the state of a dynamical system by combining a mathematical representation of the system with noisy observations taking into account their uncertainties. State of the art methods are based on the…

Machine Learning · Computer Science 2023-05-26 Pierre Boudier , Anthony Fillion , Serge Gratton , Selime Gürol , Sixin Zhang

In this work, we aim at studying ensemble based optimal control strategies for data assimilation. Such formulation nicely combines the ingredients of ensemble Kalman filters and variational data assimilation (4DVar). In the same way as…

Mathematical Physics · Physics 2014-01-17 Yin Yang , Cordelia Robinson , Dominique Heitz , Etienne Mémin

Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals involving the Gaussian prior and non-conjugate likelihoods. Algorithms…

Machine Learning · Statistics 2013-06-06 Mohammad Emtiyaz Khan , Aleksandr Y. Aravkin , Michael P. Friedlander , Matthias Seeger

Data assimilation is a fundamental task in updating forecasting models upon observing new data, with applications ranging from weather prediction to online reinforcement learning. Deep generative forecasting models (DGFMs) have shown…

Machine Learning · Statistics 2025-11-25 Shreya Sinha-Roy , Richard G. Everitt , Christian P. Robert , Ritabrata Dutta

Deep Learning (DL) based downscaling has become a popular tool in earth sciences recently. Increasingly, different DL approaches are being adopted to downscale coarser precipitation data and generate more accurate and reliable estimates at…