English
Related papers

Related papers: A cheap data assimilation approach for expensive n…

200 papers

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts,…

Geophysics · Physics 2009-08-12 M. J. Werner , K. Ide , D. Sornette

Prediction of chaotic systems relies on a floating fusion of sensor data (observations) with a numerical model to decide on a good system trajectory and to compensate nonlinear feedback effects. Ensemble-based data assimilation (DA) is a…

Computational Engineering, Finance, and Science · Computer Science 2020-11-26 Sebastian Friedemann , Bruno Raffin

Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yongquan Qu , Juan Nathaniel , Shuolin Li , Pierre Gentine

This paper proposes a data-adaptive factor model (DAFM), a novel framework for extracting common factors that explain the structures of high-dimensional data. DAFM adopts a composite quantile strategy to adaptively capture the full…

Methodology · Statistics 2025-10-02 Seeun Park , Hee-Seok Oh

Traditional machine learning assumes that training and test sets are derived from the same distribution; however, this assumption does not always hold in practical applications. This distribution disparity can lead to severe performance…

Machine Learning · Computer Science 2025-02-18 Ahmad Chaddad , Yihang Wu , Yuchen Jiang , Ahmed Bouridane , Christian Desrosiers

An intrinsic property of almost any physical measuring device is that it makes observations which are slightly blurred in time. We consider a nudging-based approach for data assimilation that constructs an approximate solution based on a…

Analysis of PDEs · Mathematics 2018-09-05 Michael S. Jolly , Vincent R. Martinez , Eric J. Olson , Edriss S. Titi

Using a dynamical model to make predictions about a system has many sources of error. These can include errors in how the model was initialised but also errors in the dynamics of the model itself. For many applications in data assimilation,…

Numerical Analysis · Mathematics 2025-07-07 P. A. Browne

Today, huge amounts of data are being collected with spatial and temporal components from sources such as meteorological, satellite imagery etc. Efficient visualisation as well as discovery of useful knowledge from these datasets is…

Databases · Computer Science 2017-03-31 Nhien-An Le-Khac , Martin Bue , Michael Whelan , Tahar Kechadi

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for exploring document collections. Because of the increasing prevalence of large datasets, there is a need to improve the scalability of inference of LDA. In this…

Artificial Intelligence · Computer Science 2011-07-20 Ke Zhai , Jordan Boyd-Graber , Nima Asadi

Data assimilation plays a crucial role in numerical modeling, enabling the integration of real-world observations into mathematical models to enhance the accuracy and predictive capabilities of simulations. This approach is widely applied…

Numerical Analysis · Mathematics 2024-11-08 Alexander Lobbe , Dan Crisan , Oana Lang

Many dynamical systems are difficult or impossible to model using high fidelity physics based models. Consequently, researchers are relying more on data driven models to make predictions and forecasts. Based on limited training data,…

Chaotic Dynamics · Physics 2025-04-09 Max M. Chumley , Firas A. Khasawneh

We apply the optimization algorithm Adaptive Simulated Annealing (ASA) to the problem of analyzing data on a large population and selecting the best model to predict that an individual with various traits will have a particular disease. We…

Artificial Intelligence · Computer Science 2007-05-23 Darin Goldstein , William Murray , Binh Yang

Calibrating simulation models that take large quantities of multi-dimensional data as input is a hard simulation optimization problem. Existing adaptive sampling strategies offer a methodological solution. However, they may not sufficiently…

Methodology · Statistics 2024-07-17 Pranav Jain , Sara Shashaani , Eunshin Byon

Climate change exacerbates extreme weather events like heavy rainfall and flooding. As these events cause severe socioeconomic damage, accurate high-resolution simulation of precipitation is imperative. However, existing Earth System Models…

Geophysics · Physics 2026-02-03 Michael Aich , Philipp Hess , Baoxiang Pan , Sebastian Bathiany , Yu Huang , Niklas Boers

Data assimilation (DA) provides a general framework for estimation in dynamical systems based on the concepts of Bayesian inference. This constitutes a common basis for the different linear and nonlinear filtering and smoothing techniques…

Optimization and Control · Mathematics 2023-03-08 Tarek Diaa-Eldeen , Marcus Krogh Nielsen , Carl Fredrik Berg , Morten Hovd , John Bagterp Jørgensen

Ensemble data assimilation is a problem in determining the most likely phase space trajectory of a model of an observed dynamical sys- tem as it receives inputs from measurements passing information to the model. Using methods developed in…

Chaotic Dynamics · Physics 2015-05-13 Henry D. I. Abarbanel

This study assesses a Continuous Data Assimilation (CDA) dynamical-downscaling algorithm for enhancing the simulation of the Indian summer monsoon (ISM) system. CDA is a mathematically rigorous technique that has been recently introduced to…

We present a methodology to simulate the impact of the atmospheric models in the background particle flux on ground detectors using the Global Data Assimilation System. The methodology was within the ARTI simulation framework developed by…

Instrumentation and Methods for Astrophysics · Physics 2021-10-20 Jennifer Grisales-Casadiegos , Christian Sarmiento-Cano , Luis A. Núñez , the LAGO Collaboration

A thermal convection loop is a circular chamber filled with water, heated on the bottom half and cooled on the top half. With sufficiently large forcing of heat, the direction of fluid flow in the loop oscillates chaotically, forming an…

Dynamical Systems · Mathematics 2016-06-24 Andrew J. Reagan

Data assimilation has become a key technique for combining physical models with observational data to estimate state variables. However, classical assimilation algorithms often struggle with the high nonlinearity present in both physical…

Machine Learning · Computer Science 2025-07-22 Zhuoyuan Li , Bin Dong , Pingwen Zhang