English
Related papers

Related papers: Adaptive Parameter Selection in Nudging Based Data…

200 papers

Adaptivity is an important feature of data analysis---typically the choice of questions asked about a dataset depends on previous interactions with the same dataset. However, generalization error is typically bounded in a non-adaptive…

Machine Learning · Computer Science 2015-11-11 Raef Bassily , Adam Smith , Thomas Steinke , Jonathan Ullman

We consider a recently introduced continuous data assimilation (CDA) approach for downscaling a coarse resolution configuration of the 2D Benard convection equations into a finer grid. In this CDA, a nudging term, estimated as the misfit…

Optimization and Control · Mathematics 2015-12-22 M. U. Altaf , E. S. Titi , O. M. Knio , L. Zhao , M. F. McCabe , I. Hoteit

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

Machine Learning · Statistics 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

Lagrangian data assimilation exploits the trajectories of moving tracers as observations to recover the underlying flow field. One major challenge in Lagrangian data assimilation is the intrinsic nonlinearity that impedes using exact…

Dynamical Systems · Mathematics 2023-06-14 Nan Chen , Shubin Fu

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

Given a decision process based on the approximate probability density function returned by a data assimilation algorithm, an interaction level between the decision making level and the data assimilation level is designed to incorporate the…

Computation · Statistics 2015-03-19 Gabriel Terejanu , Puneet Singla , Tarunraj Singh , Peter D. Scott

In this study, we conduct parameter estimation analysis on a data assimilation algorithm for two turbulence models: the simplified Bardina model and the Navier-Stokes-{\alpha} model. Our approach involves creating an approximate solution…

Fluid Dynamics · Physics 2024-09-06 Debora A. F. Albanez , Maicon Jose Benvenutti , Samuel Little , Jing Tian

Ensuring that analyses performed on a dataset are representative of the entire population is one of the central problems in statistics. Most classical techniques assume that the dataset is independent of the analyst's query and break down…

Machine Learning · Computer Science 2024-09-25 Guy Blanc

Chaos is ubiquitous in physical systems. The associated sensitivity to initial conditions is a significant obstacle in forecasting the weather and other geophysical fluid flows. Data assimilation is the process whereby the uncertainty in…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alberto Carrassi , Marc Bocquet , Jonathan Demaeyer , Colin Grudzien , Patrick Raanes , Stephane Vannitsem

Low-order thermoacoustic models are qualitatively correct, but they are typically quantitatively inaccurate. We propose a time-domain bias-aware method to make qualitatively low--order models quantitatively (more) accurate. First, we…

Fluid Dynamics · Physics 2022-11-10 Andrea Nóvoa , Luca Magri

This article develops a novel data assimilation methodology, addressing challenges that are common in real-world settings, such as severe sparsity of observations, lack of reliable models, and non-stationarity of the system dynamics. These…

Optimization and Control · Mathematics 2024-11-05 David J. Abers , George Hripcsak , Lena Mamykina , Melike Sirlanci , Esteban G. Tabak

Statistical Data Assimilation (SDA) is the transfer of information from field or laboratory observations to a user selected model of the dynamical system producing those observations. The data is noisy and the model has errors; the…

Computation · Statistics 2019-01-16 Adrian S. Wong , Kangbo Hao , Zheng Fang , Henry D. I. Abarbanel

Adapters are widely popular parameter-efficient transfer learning approaches in natural language processing that insert trainable modules in between layers of a pre-trained language model. Apart from several heuristics, however, there has…

Computation and Language · Computer Science 2023-10-31 Rishabh Bhardwaj , Tushar Vaidya , Soujanya Poria

We propose an adaptive independent Metropolis--Hastings algorithm with the ability to learn from all previous proposals in the chain except the current location. It is an extension of the independent Metropolis--Hastings algorithm.…

Probability · Mathematics 2009-03-04 Lars Holden , Ragnar Hauge , Marit Holden

Adaptivity is an important feature of data analysis---the choice of questions to ask about a dataset often depends on previous interactions with the same dataset. However, statistical validity is typically studied in a nonadaptive model,…

Machine Learning · Computer Science 2015-11-10 Raef Bassily , Kobbi Nissim , Adam Smith , Thomas Steinke , Uri Stemmer , Jonathan Ullman

Data assimilation plays a crucial role in modern weather prediction, providing a systematic way to incorporate observational data into complex dynamical models. The paper addresses continuous data assimilation for a model arising as a…

Analysis of PDEs · Mathematics 2026-02-03 Eduard Feireisl , Piotr Gwiazda , Agnieszka Świerczewska-Gwiazda

Data assimilation is a fundamental task in updating forecasting models upon observing new data, with applications ranging from weather prediction to online reinforcement learning. Deep generative forecasting models (DGFMs) have shown…

Machine Learning · Statistics 2025-11-25 Shreya Sinha-Roy , Richard G. Everitt , Christian P. Robert , Ritabrata Dutta

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

Process-oriented theories of cognition must be evaluated against time-ordered observations. Here we present a representative example for data assimilation of the SWIFT model, a dynamical model of the control of spatial fixation position and…

Neurons and Cognition · Quantitative Biology 2019-10-23 Stefan A. Seelig , Maximilian M. Rabe , Noa Malem-Shinitski , Sarah Risse , Sebastian Reich , Ralf Engbert

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source…

Machine Learning · Statistics 2026-04-10 Shivam Kumar , Yixin Wang , Lizhen Lin