English
Related papers

Related papers: Sequential Kalman Tuning of the $t$-preconditioned…

200 papers

Global ocean models exhibit biases in the mean state and variability, particularly at coarse resolution, where mesoscale eddies are unresolved. To address these biases, parameterization coefficients are typically tuned ad hoc. Here, we…

Atmospheric and Oceanic Physics · Physics 2026-05-19 Pavel Perezhogin , Alistair Adcroft , Laure Zanna

Ensemble Kalman inversion (EKI) is a technique for the numerical solution of inverse problems. A great advantage of the EKI's ensemble approach is that derivatives are not required in its implementation. But theoretically speaking, EKI's…

Numerical Analysis · Mathematics 2023-05-03 Xin T. Tong , Matthias Morzfeld

Randomized algorithms exploit stochasticity to reduce computational complexity. One important example is random feature regression (RFR) that accelerates Gaussian process regression (GPR). RFR approximates an unknown function with a random…

Machine Learning · Computer Science 2025-02-26 Oliver R. A. Dunbar , Nicholas H. Nelsen , Maya Mutic

Bayesian linear inverse problems aim to recover an unknown signal from noisy observations, incorporating prior knowledge. This paper analyses a data-dependent method to choose the scale parameter of a Gaussian prior. The method we study…

Statistics Theory · Mathematics 2025-10-22 Maia Tienstra , Sebastian Reich

Numerical models of geothermal reservoirs typically depend on hundreds or thousands of unknown parameters, which must be estimated using sparse, noisy data. However, these models capture complex physical processes, which frequently results…

The Ensemble Kalman filter (EnKF) was introduced by Evensen in 1994 [10] as a novel method for data assimilation: state estimation for noisily observed time-dependent problems. Since that time it has had enormous impact in many application…

Optimization and Control · Mathematics 2013-04-08 Marco A. Iglesias , Kody J. H. Law , Andrew M. Stuart

In the geophysical joint inversion, the gradient and Bayesian Markov Chain Monte Carlo (MCMC) sampling-based methods are widely used owing to their fast convergences or global optimality. However, these methods either require the…

Geophysics · Physics 2022-08-04 Longlong Wang , Yun Chen , Youshan Liu , Nanqiao Du , Wei Li , Junliu Suwen

Bayesian Neural Networks represent a fascinating confluence of deep learning and probabilistic reasoning, offering a compelling framework for understanding uncertainty in complex predictive models. In this paper, we investigate the use of…

Machine Learning · Computer Science 2025-03-11 Lucia Pezzetti , Stefano Favaro , Stefano Peluchetti

Bayesian experimental design (BED) offers a principled framework for optimizing data acquisition by leveraging probabilistic inference. However, practical implementations of BED are often compromised by model discrepancy, i.e., the mismatch…

Machine Learning · Computer Science 2025-11-25 Huchen Yang , Xinghao Dong , Jin-Long Wu

Although the governing equations of many systems, when derived from first principles, may be viewed as known, it is often too expensive to numerically simulate all the interactions they describe. Therefore researchers often seek simpler…

Computation · Statistics 2021-05-03 Tapio Schneider , Andrew M. Stuart , Jin-Long Wu

This work proposes ensemble Kalman randomized maximum likelihood estimation, a new derivative-free method for performing randomized maximum likelihood estimation, which is a method that can be used to generate approximate samples from…

Numerical Analysis · Mathematics 2025-07-08 Pavlos Stavrinides , Elizabeth Qian

In this study, we consider an ensemble Kalman inversion (EKI) for the numerical solution of time-fractional diffusion inverse problems (TFDIPs). Computational challenges in the EKI arise from the need for repeated evaluations of the forward…

Numerical Analysis · Mathematics 2019-02-26 Fenglian Yang , Liang Yan

In recent years, operator learning, particularly the DeepONet, has received much attention for efficiently learning complex mappings between input and output functions across diverse fields. However, in practical scenarios with limited and…

Machine Learning · Computer Science 2024-03-07 Andrew Pensoneault , Xueyu Zhu

We study the ensemble Kalman filter (EnKF) algorithm for sequential data assimilation in a general situation, that is, for nonlinear forecast and measurement models with non-additive and non-Gaussian noises. Such applications traditionally…

Methodology · Statistics 2018-08-17 Weixuan Li , W. Steven Rosenthal , Guang Lin

Based on the recently developed theory of Unscented Kalman Inversion in computational mathematics, we proposed a Bayesian joint inversion framework, i.e., Multi-task Unscented Kalman Inversion (MTUKI), and apply it to the joint inversion of…

Geophysics · Physics 2023-01-18 Wang Longlong , Liu Youshan , Chen Yun , Du nanqiao

Sequential fine-tuning of transformers is useful when new data arrive sequentially, especially with shifting distributions. Unlike batch learning, sequential learning demands that training be stabilized despite a small amount of data by…

Machine Learning · Computer Science 2025-09-16 Haoming Jing , Oren Wright , José M. F. Moura , Yorie Nakahira

In this paper we use a Variational Quantum Algorithm to solve Initial Value Problems with the Implicit Crank-Nicolson and the Method of Lines (MoL) evolution schemes. The unknown functions use a spectral decomposition with the Fourier…

Quantum Physics · Physics 2024-10-17 Francisco Guzman-Cajica , Francisco S. Guzman

Mathematical modeling and simulation of complex physical systems based on partial differential equations (PDEs) have been widely used in engineering and industrial applications. To enable reliable predictions, it is crucial yet challenging…

Numerical Analysis · Mathematics 2021-07-20 Han Gao , Jian-Xun Wang

This paper proposes a replica exchange preconditioned Langevin diffusion discretized by the Crank-Nicolson scheme (repCNLD) to handle high-dimensional and multi-modal distribution problems. Sampling from high-dimensional and multi-modal…

Numerical Analysis · Mathematics 2022-11-01 Ou Na , Zecheng Zhang , Guang Lin

We study non-linear Bayesian inverse problems arising from semilinear partial differential equations (PDEs) that can be transformed into linear Bayesian inverse problems. We are then able to extend the early stopping for Ensemble…

Statistics Theory · Mathematics 2025-10-22 Maia Tienstra , Gottfried Hastermann