English
Related papers

Related papers: Tensor-Var: Efficient Four-Dimensional Variational…

200 papers

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

4D-variational data assimilation is applied to the Lorenz '63 model to introduce a new method for parameter estimation in chaotic climate models. The approach aims to optimise an Earth system model (ESM), for which no adjoint exists, by…

Atmospheric and Oceanic Physics · Physics 2025-04-18 Philip David Kennedy , Abhirup Banerjee , Armin Köhl , Detlef Stammer

Embedding is a useful technique to project a high-dimensional feature into a low-dimensional space, and it has many successful applications including link prediction, node classification and natural language processing. Current approaches…

Information Retrieval · Computer Science 2020-09-21 Meimei Liu , Hongxia Yang

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

Domain adaption (DA) allows machine learning methods trained on data sampled from one distribution to be applied to data sampled from another. It is thus of great practical importance to the application of such methods. Despite the fact…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Hao Lu , Lei Zhang , Zhiguo Cao , Wei Wei , Ke Xian , Chunhua Shen , Anton van den Hengel

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

Constraining a numerical weather prediction (NWP) model with observations via 4D variational (4D-Var) data assimilation is often difficult to implement in practice due to the need to develop and maintain a software-based tangent linear…

Machine Learning · Computer Science 2024-08-07 Kylen Solvik , Stephen G. Penny , Stephan Hoyer

Data Assimilation (DA) is a methodology for combining mathematical models simulating complex systems (the background knowledge) and measurements (the reality or observational data) in order to improve the estimate of the system state. This…

Numerical Analysis · Mathematics 2019-01-15 Luisa D'Amore , Rosalba Cacciapuoti

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a…

Machine Learning · Computer Science 2023-10-02 Kevin Roy , Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

In contemporary neuroscience, a key area of interest is dynamic effective connectivity, which is crucial for understanding the dynamic interactions and causal relationships between different brain regions. Dynamic effective connectivity can…

Methodology · Statistics 2024-05-30 Wei Zhang , Ivor Cribben , sonia Petrone , Michele Guindani

Data Assimilation is the process in which we improve the representation of the state of a physical system by combining information coming from a numerical model, real-world observations, and some prior modelling. It is widely used to model…

Optimization and Control · Mathematics 2025-01-09 Victor Trappler , Arthur Vidard

We present Tensor4D, an efficient yet effective approach to dynamic scene modeling. The key of our solution is an efficient 4D tensor decomposition method so that the dynamic scene can be directly represented as a 4D spatio-temporal tensor.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Ruizhi Shao , Zerong Zheng , Hanzhang Tu , Boning Liu , Hongwen Zhang , Yebin Liu

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

Dynamic mode decomposition (DMD) has become a powerful data-driven method for analyzing the spatiotemporal dynamics of complex, high-dimensional systems. However, conventional DMD methods are limited to matrix-based formulations, which…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Ziqin He , Mengqi Hu , Yifei Lou , Can Chen

Fitting nonlinear dynamical models to sparse and noisy observations is fundamentally challenging. Identifying dynamics requires data assimilation (DA) to estimate system states, but DA requires an accurate dynamical model. To break this…

Machine Learning · Computer Science 2024-09-12 Vadim Zinchenko , David S. Greenberg

This paper studies the role of sparse regularization in a properly chosen basis for variational data assimilation (VDA) problems. Specifically, it focuses on data assimilation of noisy and down-sampled observations while the state variable…

Data Analysis, Statistics and Probability · Physics 2014-06-25 A. M. Ebtehaj , M. Zupanski , G. Lerman , E. Foufoula-Georgiou

Compressive Learning is an emerging topic that combines signal acquisition via compressive sensing and machine learning to perform inference tasks directly on a small number of measurements. Many data modalities naturally have a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Dat Thanh Tran , Mehmet Yamac , Aysen Degerli , Moncef Gabbouj , Alexandros Iosifidis

In this paper, the Ensemble Kalman Filter is compared with a 4DVAR Data Assimilation System in chaotic dynamics. The Lorenz model is chosen for its simplicity in structure and its dynamical similarities with primitive equation models, such…

Chaotic Dynamics · Physics 2026-04-13 Fabrício Pereira Harter , Cleber Souza Corrêa

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

Variational data assimilation and machine-learning based super-resolution are two alternative approaches to state estimation in turbulent flows. The former is an optimisation problem featuring a time series of coarse observations, the…

Fluid Dynamics · Physics 2025-10-21 Markus Weyrauch , Moritz Linkmann , Jacob Page