English
Related papers

Related papers: A reduced-order strategy for 4D-Var data assimilat…

200 papers

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a…

Statistics Theory · Mathematics 2020-02-03 Sibo Cheng , Jean-Philippe Argaud , Bertrand Iooss , Angélique Ponçot , Didier Lucor

The objective of this contribution is to compare two methods proposed recently in order to build efficient reduced-order models for geometrically nonlinear structures. The first method relies on the normal form theory that allows one to…

Numerical Analysis · Mathematics 2022-02-22 Alessandra Vizzaccaro , Loïc Salles , Cyril Touzé

We consider reduced-rank modeling of the white noise covariance matrix in a large dimensional vector autoregressive (VAR) model. We first propose the reduced-rank covariance estimator under the setting where independent observations are…

Applications · Statistics 2014-12-09 Richard A. Davis , Pengfei Zang , Tian Zheng

We propose an online learning framework for forecasting nonlinear spatio-temporal signals (fields). The method integrates (i) dimensionality reduction, here, a simple proper orthogonal decomposition (POD) projection; (ii) a generalized…

Machine Learning · Computer Science 2025-07-29 Andrea Nóvoa , Luca Magri

Data assimilation has become a key technique for combining physical models with observational data to estimate state variables. However, classical assimilation algorithms often struggle with the high nonlinearity present in both physical…

Machine Learning · Computer Science 2025-07-22 Zhuoyuan Li , Bin Dong , Pingwen Zhang

Dimension reduction is often needed in the area of data mining. The goal of these methods is to map the given high-dimensional data into a low-dimensional space preserving certain properties of the initial data. There are two kinds of…

Numerical Analysis · Mathematics 2015-03-23 Yanlai Chen

In offline reinforcement learning, a policy learns to maximize cumulative rewards with a fixed collection of data. Towards conservative strategy, current methods choose to regularize the behavior policy or learn a lower bound of the value…

Machine Learning · Computer Science 2021-03-02 Hongchang Zhang , Jianzhun Shao , Yuhang Jiang , Shuncheng He , Xiangyang Ji

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based…

Computation · Statistics 2023-03-07 Tiangang Cui , Olivier Zahm

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

We introduce an order-invariant reinforcement learning framework for black-box combinatorial optimization. Classical estimation-of-distribution algorithms (EDAs) often rely on learning explicit variable dependency graphs, which can be…

Machine Learning · Computer Science 2026-01-30 Olivier Goudet , Quentin Suire , Adrien Goëffon , Frédéric Saubion , Sylvain Lamprier

This chapter provides various perspective on an important challenge in data assimilation: model error. While the overall goal is to understand the implication of model error of any type in data assimilation, we emphasize on the effect of…

Dynamical Systems · Mathematics 2015-07-02 John Harlim

Model errors are increasingly seen as a fundamental performance limiter in both Numerical Weather Prediction and Climate Prediction simulations run with state of the art Earth system digital twins.This has motivated recent efforts aimed at…

Applications · Statistics 2021-09-22 Massimo Bonavita

A reduced-order model based on Proper Orthogonal Decomposition (POD) is proposed for the bidomain equations of cardiac electrophysiology. Its accuracy is assessed through electrocardiograms in various configurations, including myocardium…

Numerical Analysis · Mathematics 2012-07-23 Muriel Boulakia , Elisa Schenone , Jean-Frédéric Gerbeau

Severe storms, tropical cyclones, and associated tornadoes, floods, lightning, and microbursts threaten life and property. Reliable, precise, and accurate alerts of these phenomena can trigger defensive actions and preparations. However,…

Atmospheric and Oceanic Physics · Physics 2011-02-15 Ross N. Hoffman , John M. Henderson , Thomas Nehrkorn

For high-dimensional classification, it is well known that naively performing the Fisher discriminant rule leads to poor results due to diverging spectra and noise accumulation. Therefore, researchers proposed independence rules to…

Machine Learning · Statistics 2011-11-10 Jianqing Fan , Yang Feng , Xin Tong

When training data are distributed across{ time or space,} covariate shift across fragments of training data biases cross-validation, compromising model selection and assessment. We present \textit{Fragmentation-Induced covariate-shift…

Machine Learning · Computer Science 2024-11-12 Behraj Khan , Behroz Mirza , Nouman Durrani , Tahir Syed

Starting from limited measurements of a turbulent flow, data assimilation (DA) attempts to estimate all the spatio-temporal scales of motion. Success is dependent on whether the system is observable from the measurements, or how much of the…

Fluid Dynamics · Physics 2026-02-16 Andrew Cleary , Qi Wang , Tamer A. Zaki

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao