English
Related papers

Related papers: Variational Data-Consistent Assimilation

200 papers

Data assimilation (DA) improves prediction of chaotic systems by combining model forecasts with sparse, noisy observations. Many DA methods are inherently probabilistic, but accurate probabilistic DA is often computationally expensive…

Fluid Dynamics · Physics 2026-04-24 Aditya Sai Pranith Ayapilla , Kazuya Miyashita , Yuki Yasuda , Ryo Onishi

Knowledge transfer from a source domain to a different but semantically related target domain has long been an important topic in the context of unsupervised domain adaptation (UDA). A key challenge in this field is establishing a metric…

Machine Learning · Computer Science 2020-07-21 Rongzhe Wei , Fa Zhang , Bo Dong , Qinghua Zheng

A Vector Auto-Regressive (VAR) model is commonly used to model multivariate time series, and there are many penalized methods to handle high dimensionality. However in terms of spatio-temporal data, most methods do not take the spatial and…

Methodology · Statistics 2020-12-21 Zhenzhong Wang , Abolfazl Safikhani , Zhengyuan Zhu , David S. Matteson

The dynamic mode decomposition (DMD) is a broadly applicable dimensionality reduction algorithm that approximates a matrix containing time-series data by the outer product of a matrix of exponentials, representing Fourier-like time…

Optimization and Control · Mathematics 2017-12-07 Travis Askham , Peng Zheng , Aleksandr Aravkin , J. Nathan Kutz

The data-aware method of distributions (DA-MD) is a low-dimension data assimilation procedure to forecast the behavior of dynamical systems described by differential equations. It combines sequential Bayesian update with the MD, such that…

Statistics Theory · Mathematics 2022-07-27 Francesca Boso , Daniel M. Tartakovsky

Data assimilation (DA) is a cornerstone of scientific and engineering applications, combining model forecasts with sparse and noisy observations to estimate latent system states. Classical high-dimensional DA methods, such as the ensemble…

Machine Learning · Statistics 2026-05-28 Martin Andrae , Erik Wikingsson , So Takao , Tomas Landelius , Fredrik Lindsten

Variational data assimilation and machine-learning based super-resolution are two alternative approaches to state estimation in turbulent flows. The former is an optimisation problem featuring a time series of coarse observations, the…

Fluid Dynamics · Physics 2025-10-21 Markus Weyrauch , Moritz Linkmann , Jacob Page

Continuous data assimilation (CDA) nudges observational data into governing equations to recover the underlying flow and improve predictions. Existing rigorous CDA analyses focus primarily on incompressible flows, yet no physical flow is…

Numerical Analysis · Mathematics 2026-04-30 Aytekin Çıbık , Rui Fang

Discrete diffusion models have recently shown great promise for modeling complex discrete data, with masked diffusion models (MDMs) offering a compelling trade-off between quality and generation speed. MDMs denoise by progressively…

Machine Learning · Computer Science 2026-04-15 Tianyu Xie , Shuchen Xue , Zijin Feng , Tianyang Hu , Jiacheng Sun , Zhenguo Li , Cheng Zhang

We consider the problem of distributed mean estimation (DME), in which $n$ machines are each given a local $d$-dimensional vector $x_v \in \mathbb{R}^d$, and must cooperate to estimate the mean of their inputs $\mu = \frac 1n\sum_{v = 1}^n…

Machine Learning · Computer Science 2021-04-08 Peter Davies , Vijaykrishna Gurunathan , Niusha Moshrefi , Saleh Ashkboos , Dan Alistarh

This paper outlines a unified framework for high dimensional variable selection for classification problems. Traditional approaches to finding interesting variables mostly utilize only partial information through moments (like mean…

Methodology · Statistics 2016-11-25 S. Mukhopadhyay , Emanuel Parzen , S. N. Lahiri

Dynamic Mode Decomposition (DMD) is a data based modeling tool that identifies a matrix to map a quantity at some time instant to the same quantity in future. We design a new version which we call Adaptive Dynamic Mode Decomposition (ADMD)…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Mohammad N. Murshed , M. Monir Uddin

Alkaline Water Electrolysis (AWE) is one of the simplest green hydrogen production method using renewable energy. AWE system typically yields process variables that are serially correlated and contaminated by measurement uncertainty. A…

Machine Learning · Computer Science 2024-04-16 Qi Zhang , Lei Xie , Weihua Xu , Hongye Su

Data assimilation (DA) estimates the state of an evolving dynamical system from noisy, partial observations, and is widely used in scientific simulation as well as weather and climate science. In practice, filtering methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-05-15 Yixuan Jia , Siyi Chen , Yida Pan , Xiao Li , Lianghe Shi , Chanyong Jung , Haijie Yuan , Ismail Alkhouri , Yue Cynthia Wu , Saiprasad Ravishankar , Jeffrey A Fessler , Qing Qu

Dynamic mode decomposition (DMD) is a versatile approach that enables the construction of low-order models from data. Controller design tasks based on such models require estimates and guarantees on predictive accuracy. In this work, we…

Systems and Control · Electrical Eng. & Systems 2020-03-24 Qiugang Lu , Sungho Shin , Victor M. Zavala

This paper addresses the impact of assimilating data from the Earth Networks Total Lightning Network (ENTLN) during two cases of severe weather. Data from the ENTLN serve as a substitute for those from the upcoming launch of the GOES…

Optimization and Control · Mathematics 2013-06-11 Razvan Stefanescu , I. Michael Navon , Henry Fuelberg , Max Marchand

The interaction of multiple fluids through a heterogeneous pore space leads to complex pore-scale flow dynamics, such as intermittent pathway flow. The non-local nature of these dynamics, and the size of the 4D datasets acquired to capture…

The reconstruction and prediction of full-state flows from sparse data are of great scientific and engineering significance yet remain challenging, especially in applications where data are sparse and/or subjected to noise. To this end,…

Fluid Dynamics · Physics 2023-12-08 Jiaxin Wu , Dunhui Xiao , Min Luo

Equivariant and invariant machine learning models exploit symmetries and structural patterns in data to improve sample efficiency. While empirical studies suggest that data-driven methods such as regularization and data augmentation can…

Machine Learning · Statistics 2025-06-17 Hao Duan , Guido Montúfar

The Dynamic Mode Decomposition (DMD) is a tool of trade in computational data driven analysis of fluid flows. More generally, it is a computational device for Koopman spectral analysis of nonlinear dynamical systems, with a plethora of…

Numerical Analysis · Mathematics 2017-08-10 Zlatko Drmač , Igor Mezić , Ryan Mohr