English
Related papers

Related papers: Adaptive Parameter Selection in Nudging Based Data…

200 papers

In adaptive data analysis, the user makes a sequence of queries on the data, where at each step the choice of query may depend on the results in previous steps. The releases are often randomized in order to reduce overfitting for such…

Machine Learning · Statistics 2016-02-16 Yu-Xiang Wang , Jing Lei , Stephen E. Fienberg

The efficacy of a nudging data assimilation algorithm using higher order finite element interpolating operators is studied. Numerical experiments are presented for the 2D Navier-Stokes equations in two cases: shear flow in an annulus and a…

Numerical Analysis · Mathematics 2021-08-10 Michael S. Jolly , Ali Pakzad

With the rapid development of data-driven machine learning (ML) models in meteorology, typhoon track forecasts have become increasingly accurate. However, current ML models still face challenges, such as underestimating typhoon intensity…

Atmospheric and Oceanic Physics · Physics 2024-08-26 Zeyi Niu , Wei Huang , Lei Zhang , Lin Deng , Haibo Wang , Yuhua Yang , Dongliang Wang , Hong Li

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

Computation · Statistics 2018-08-03 Jonathan U Harrison , Ruth E Baker

We present a novel framework for assimilating planar PIV experimental data using a variational approach to enhance the predictions of the Spalart-Allmaras RANS turbulence model. Our method applies three-dimensional constraints to the…

Fluid Dynamics · Physics 2026-01-27 Uttam Cadambi Padmanaban , Bharathram Ganapathisubramani , Sean Symon

This paper discusses the problem of adaptive estimation of a univariate object like the value of a regression function at a given point or a linear functional in a linear inverse problem. We consider an adaptive procedure originated from…

Statistics Theory · Mathematics 2009-08-26 Vladimir Spokoiny , Céline Vial

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

The classical alternating minimization (or projection) algorithm has been successful in the context of solving optimization problems over two variables. The iterative nature and simplicity of the algorithm has led to its application to many…

Information Theory · Computer Science 2010-08-24 Urs Niesen , Devavrat Shah , Gregory Wornell

Data assimilation (DA) is a fundamental component of modern weather prediction, yet it remains a major computational bottleneck in machine learning (ML)-based forecasting pipelines due to reliance on traditional variational methods. Recent…

Machine Learning · Computer Science 2026-02-09 Ran Cheng , Lailai Zhu

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems…

Optimization and Control · Mathematics 2024-05-08 Amit N. Subrahmanya , Andrey A. Popov , Reid J. Gomillion , Adrian Sandu

Given the growth in the variety and precision of astronomical datasets of interest for cosmology, the best cosmological constraints are invariably obtained by combining data from different experiments. At the likelihood level, one…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-04 Arrykrishna Mootoovaloo , Carlos García-García , David Alonso , Jaime Ruiz-Zapatero

Obtaining accurate high-resolution representations of model outputs is essential to describe the system dynamics. In general, however, only spatially- and temporally-coarse observations of the system states are available. These observations…

Dynamical Systems · Mathematics 2022-11-08 Mohamad Abed El Rahman Hammoud , Olivier LeMaitre , Edriss S. Titi , Ibrahim Hoteit , Omar Knio

The non-stationary nature of image characteristics calls for adaptive processing, based on the local image content. We propose a simple and flexible method to learn local tuning of parameters in adaptive image processing: we extract simple…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Jingming Dong , Iuri Frosio , Jan Kautz

Data assimilation, consisting in the combination of a dynamical model with a set of noisy and incomplete observations in order to infer the state of a system over time, involves uncertainty in most settings. Building upon an existing…

Machine Learning · Computer Science 2026-03-02 Anthony Frion , David S Greenberg

Data assimilation methodologies are designed to incorporate noisy observations of a physical system into an underlying model in order to infer the properties of the state of the system. Filters refer to a class of data assimilation…

Optimization and Control · Mathematics 2011-10-13 C. E. A. Brett , K. F. Lam , K. J. H. Law , D. S. McCormick , M. R. Scott , A. M. Stuart

Normalizing flow is a generative modeling approach with efficient sampling. However, Flow-based models suffer two issues: 1) If the target distribution is manifold, due to the unmatch between the dimensions of the latent target distribution…

Machine Learning · Computer Science 2024-04-24 Qinglong Meng , Chongkun Xia , Xueqian Wang

Guidance provides a simple and effective framework for posterior sampling by steering the generation process towards the desired distribution. When modeling discrete data, existing approaches mostly focus on guidance with the first-order…

Machine Learning · Computer Science 2026-04-16 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

In order to leverage the information embedded in the background state and observations, covariance matrices modelling is a pivotal point in data assimilation algorithms. These matrices are often estimated from an ensemble of observations or…

Methodology · Statistics 2019-10-22 Sibo Cheng , Jean-Philippe Argaud , Bertrand Iooss , Didier Lucor , Angélique Ponçot

Guided diffusion sampling relies on approximating often intractable likelihood scores, which introduces significant noise into the sampling dynamics. We propose using adaptive moment estimation to stabilize these noisy likelihood scores…

Machine Learning · Computer Science 2026-04-24 Christian Belardi , Justin Lovelace , Kilian Q. Weinberger , Carla P. Gomes