English
Related papers

Related papers: Ensemble transport smoothing. Part II: Nonlinear u…

200 papers

Nudging is an empirical data assimilation technique that incorporates an observation-driven control term into the model dynamics. The trajectory of the nudged system approaches the true system trajectory over time, even when the initial…

Machine Learning · Computer Science 2025-08-11 Jaemin Oh , Jinsil Lee , Youngjoon Hong

A novel formulation of the clustering problem is introduced in which the task is expressed as an estimation problem, where the object to be estimated is a function which maps a point to its distribution of cluster membership. Unlike…

Machine Learning · Computer Science 2025-10-14 David P. Hofmeyr

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

We consider the problem of state estimation in general state-space models using variational inference. For a generic variational family defined using the same backward decomposition as the actual joint smoothing distribution, we establish…

Methodology · Statistics 2022-06-02 Mathis Chagneux , Élisabeth Gassiat , Pierre Gloaguen , Sylvain Le Corff

Multivariate spatial fields are of interest in many applications, including climate model emulation. Not only can the marginal spatial fields be subject to nonstationarity, but the dependence structure among the marginal fields and between…

Methodology · Statistics 2023-11-21 Paul F. V. Wiemann , Matthias Katzfuss

Filtering and smoothing with a generalised representation of uncertainty is considered. Here, uncertainty is represented using a class of outer measures. It is shown how this representation of uncertainty can be propagated using…

Methodology · Statistics 2018-08-02 Jeremie Houssineau , Adrian N. Bishop

State space models are well-known for their versatility in modeling dynamic systems that arise in various scientific disciplines. Although parametric state space models are well studied, nonparametric approaches are much less explored in…

Methodology · Statistics 2015-07-23 Satyaki Mazumder , Sourabh Bhattacharya

In the context of nonparametric regression, we study conditions under which the consistency (and rates of convergence) of estimators built from discretely sampled curves can be derived from the consistency of estimators based on the…

Statistics Theory · Mathematics 2017-05-29 Forzani Liliana , Fraiman Ricardo , Llop Pamela

This paper considers the problem of fitting the parameters of a Kalman smoother to data. We formulate the Kalman smoothing problem with missing measurements as a constrained least squares problem and provide an efficient method to solve it…

Optimization and Control · Mathematics 2019-10-22 Shane Barratt , Stephen Boyd

Predicting the behavior of a dynamical system from noisy observations of its past outputs is a classical problem encountered across engineering and science. For linear systems with Gaussian inputs, the Kalman filter -- the best linear…

Machine Learning · Computer Science 2026-03-10 Usman Akram , Haris Vikalo

Motivated by the maneuvering target tracking with sensors such as radar and sonar, this paper considers the joint and recursive estimation of the dynamic state and the time-varying process noise covariance in nonlinear state space models.…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Hua Lan , Jinjie Hu , Zengfu Wang , Qiang Cheng

Smoothed analysis is a framework suggested for mediating gaps between worst-case and average-case complexities. In a recent work, Dinitz et al.~[Distributed Computing, 2018] suggested to use smoothed analysis in order to study dynamic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-29 Uri Meir , Ami Paz , Gregory Schwartzman

Sequential fine-tuning of transformers is useful when new data arrive sequentially, especially with shifting distributions. Unlike batch learning, sequential learning demands that training be stabilized despite a small amount of data by…

Machine Learning · Computer Science 2025-09-16 Haoming Jing , Oren Wright , José M. F. Moura , Yorie Nakahira

Prior work has explored directly regularizing the output distributions of probabilistic models to alleviate peaky (i.e. over-confident) predictions, a common sign of overfitting. This class of techniques, of which label smoothing is one,…

Computation and Language · Computer Science 2020-05-13 Clara Meister , Elizabeth Salesky , Ryan Cotterell

This paper presents a method for calculating the smoothed state distribution for Jump Markov Linear Systems. More specifically, the paper details a novel two-filter smoother that provides closed-form expressions for the smoothed hybrid…

Methodology · Statistics 2020-04-21 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

This letter presents a non-parametric modeling approach for forecasting stochastic dynamical systems on low-dimensional manifolds. The key idea is to represent the discrete shift maps on a smooth basis which can be obtained by the diffusion…

Dynamical Systems · Mathematics 2015-03-25 Tyrus Berry , Dimitrios Giannakis , John Harlim

Ensemble randomized maximum likelihood (EnRML) is an iterative (stochastic) ensemble smoother, used for large and nonlinear inverse problems, such as history matching and data assimilation. Its current formulation is overly complicated and…

Data Analysis, Statistics and Probability · Physics 2019-09-12 Patrick N. Raanes , Geir Evensen , Andreas S. Stordal

A comprehensive methodology is provided for smoothing noisy, irregularly sampled data with non-Gaussian noise using smoothing splines. We demonstrate how the spline order and tension parameter can be chosen a priori from physical reasoning.…

Methodology · Statistics 2020-02-18 Jeffrey J. Early , Adam M. Sykulski

Inferring the state and unknown parameters of a network of coupled oscillators is of utmost importance. This task is made harder when only partial and noisy observations are available, which is a typical scenario in realistic…

Adaptation and Self-Organizing Systems · Physics 2025-04-07 Lauren D. Smith , Georg A. Gottwald

In recent years, several ensemble-based filtering methods have been proposed and studied. The main challenge in such procedures is the updating of a prior ensemble to a posterior ensemble at every step of the filtering recursions. In the…

Methodology · Statistics 2019-04-11 Margrethe Kvale Loe , Håkon Tjelmeland