English
Related papers

Related papers: Precision Annealing Monte Carlo Methods for Statis…

200 papers

Diffuse optical tomography (DOT) is an imaging modality which uses near-infrared light. Although iterative numerical schemes are commonly used for its inverse problem, correct solutions are not obtained unless good initial guesses are…

Numerical Analysis · Mathematics 2021-06-07 Yu Jiang , Manabu Machida , Norikazu Todoroki

This paper presents a new data assimilation (DA) scheme based on a sequential Markov Chain Monte Carlo (SMCMC) DA technique [Ruzayqat et al. 2024] which is provably convergent and has been recently used for filtering, particularly for…

Computation · Statistics 2024-09-12 Hamza Ruzayqat , Omar Knio

Dimensional analysis (DA) pays attention to fundamental physical dimensions such as length and mass when modelling scientific and engineering systems. It goes back at least a century to Buckingham's Pi theorem, which characterizes a…

Machine Learning · Computer Science 2023-12-19 G. Alexi Rodriguez-Arelis , William J. Welch

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

Annealed Importance Sampling (AIS) and its Sequential Monte Carlo (SMC) extensions are state-of-the-art methods for estimating normalizing constants of probability distributions. We propose here a novel Monte Carlo algorithm, Annealed Flow…

Machine Learning · Statistics 2021-07-12 Michael Arbel , Alexander G. D. G. Matthews , Arnaud Doucet

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to…

Artificial Intelligence · Computer Science 2024-08-05 Nicolò Dal Fabbro , Arman Adibi , H. Vincent Poor , Sanjeev R. Kulkarni , Aritra Mitra , George J. Pappas

Data assimilation (DA) improves prediction of chaotic systems by combining model forecasts with sparse, noisy observations. Many DA methods are inherently probabilistic, but accurate probabilistic DA is often computationally expensive…

Fluid Dynamics · Physics 2026-04-24 Aditya Sai Pranith Ayapilla , Kazuya Miyashita , Yuki Yasuda , Ryo Onishi

Data assimilation combines (imperfect) knowledge of a flow's physical laws with (noisy, time-lagged, and otherwise imperfect) observations to produce a more accurate prediction of flow statistics. Assimilation by nudging (from 1964), while…

Numerical Analysis · Mathematics 2024-07-31 Aytekin Çıbık , Rui Fang , William Layton , Farjana Siddiqua

Active Domain Adaptation (ADA) adapts models to target domains by selectively labeling a few target samples. Existing ADA methods prioritize uncertain samples but overlook confident ones, which often match ground-truth. We find that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Bardia Safaei , Vibashan VS , Vishal M. Patel

A novel method for extracting physical parameters from experimental and simulation data is presented. The method is based on statistical concepts and it relies on Monte Carlo simulation techniques. It identifies and determines with maximal…

High Energy Physics - Phenomenology · Physics 2012-05-31 C. N. Papanicolas , E. Stiliaris

Stochastic gradient Hamiltonian Monte Carlo (SGHMC) is an efficient method for sampling from continuous distributions. It is a faster alternative to HMC: instead of using the whole dataset at each iteration, SGHMC uses only a subsample.…

Machine Learning · Computer Science 2022-02-18 Ruqi Zhang , A. Feder Cooper , Christopher De Sa

Simulated annealing (SA) was inspired from annealing in metallurgy, a technique involving heating and controlled cooling of a material to increase the size of its crystals and reduce their defects, both are attributes of the material that…

Optimization and Control · Mathematics 2014-01-21 Jiapu Zhang

Recently a new algorithm for sampling posteriors of unnormalised probability densities, called ABC Shadow, was proposed in [8]. This talk introduces a global optimisation procedure based on the ABC Shadow simulation dynamics. First the…

Computation · Statistics 2018-03-20 R. S. Stoica , M. Deaconu , L. Hurtado

Ensemble data assimilation is a problem in determining the most likely phase space trajectory of a model of an observed dynamical sys- tem as it receives inputs from measurements passing information to the model. Using methods developed in…

Chaotic Dynamics · Physics 2015-05-13 Henry D. I. Abarbanel

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

Among random sampling methods, Markov Chain Monte Carlo algorithms are foremost. Using a combination of analytical and numerical approaches, we study their convergence properties towards the steady state, within a random walk Metropolis…

Statistical Mechanics · Physics 2024-01-08 Alexei D. Chepelianskii , Satya N. Majumdar , Hendrik Schawe , Emmanuel Trizac

The recent surge in machine learning (ML) methods for geophysical modeling has raised the question of how these methods might be applied to data assimilation (DA). We focus on diffusion modeling (a form of generative artificial…

Atmospheric and Oceanic Physics · Physics 2025-08-29 Daniel Hodyss , Matthias Morzfeld

Transferring information from observations of a dynamical system to estimate the fixed parameters and unobserved states of a system model can be formulated as the evaluation of a discrete time path integral in model state space. The…

Chaotic Dynamics · Physics 2015-05-14 John C. Quinn , Henry D. I. Abarbanel