English
Related papers

Related papers: Self-Consistent Stochastic Model Errors in Data As…

200 papers

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

Alongside optimization-based planners, sampling-based approaches are often used in trajectory planning for autonomous driving due to their simplicity. Model predictive path integral control is a framework that builds upon optimization…

Robotics · Computer Science 2026-02-09 Georg Rabenstein , Lars Ullrich , Knut Graichen

A goal of data assimilation is to infer stochastic dynamical behaviors with available observations. We consider transition phenomena between metastable states for a stochastic system with (non-Gaussian) $\alpha-$stable L\'evy noise. With…

Dynamical Systems · Mathematics 2016-06-29 Ting Gao , Jinqiao Duan , Xingye Kan

In this study, we explore data assimilation for the Stochastic Camassa-Holm equation through the application of the particle filtering framework. Specifically, our approach integrates adaptive tempering, jittering, and nudging techniques to…

Numerical Analysis · Mathematics 2024-02-13 Colin John Cotter , Dan Crisan , Maneesh Kumar Singh

Modeling transformations between arbitrary data distributions is a fundamental scientific challenge, arising in applications like drug discovery and evolutionary simulation. While flow matching offers a natural framework for this task, its…

Machine Learning · Computer Science 2025-10-09 Shiye Su , Yuhui Zhang , Linqi Zhou , Rajesh Ranganath , Serena Yeung-Levy

Data assimilation is the process to fuse information from priors, observations of nature, and numerical models, in order to obtain best estimates of the parameters or state of a physical system of interest. Presence of large errors in some…

Numerical Analysis · Mathematics 2015-11-06 Vishwas Rao , Adrian Sandu , Michael Ng , Elias Nino-Ruiz

Self-consistency improves reasoning by aggregating diverse stochastic samples, yet the dynamics behind its efficacy remain underexplored. We reframe self-consistency as a dynamic distributional alignment problem, revealing that decoding…

Computation and Language · Computer Science 2025-06-12 Yiwei Li , Ji Zhang , Shaoxiong Feng , Peiwen Yuan , Xinglin Wang , Jiayi Shi , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

Data assimilation, in its most comprehensive form, addresses the Bayesian inverse problem of identifying plausible state trajectories that explain noisy or incomplete observations of stochastic dynamical systems. Various approaches have…

Machine Learning · Computer Science 2023-11-01 François Rozet , Gilles Louppe

Inspired by the key principle behind the EM algorithm, we propose a general methodology for conducting wavelet estimation with irregularly-spaced data by viewing the data as the observed portion of an augmented regularly-spaced data set. We…

Statistics Theory · Mathematics 2007-06-13 Thomas C. M. Lee , Xiao-Li Meng

Within the machine learning community, the widely-used uniform convergence framework has been used to answer the question of how complex, over-parameterized models can generalize well to new data. This approach bounds the test error of the…

Machine Learning · Statistics 2021-03-05 Ryan Theisen , Jason M. Klusowski , Michael W. Mahoney

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

This paper develops a framework for the error analysis in nonparametric model fitting of fractional stochastic differential equations based on discrete observations. We identify and quantify the main error sources -- time discretization,…

Probability · Mathematics 2026-05-07 Mahdi Dehshiri , Kerlyns Martinez , Lauri Viitasaari

Statistical samples, in order to be representative, have to be drawn from a population in a random and unbiased way. Nevertheless, it is common practice in the field of model-based diagnosis to make estimations from (biased) best-first…

Artificial Intelligence · Computer Science 2022-08-05 Patrick Rodler , Fatima Elichanova

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

Consistency models imitate the multi-step sampling of score-based diffusion in a single forward pass of a neural network. They can be learned in two ways: consistency distillation and consistency training. The former relies on the true…

Machine Learning · Computer Science 2025-07-03 Thibaut Issenhuth , Sangchul Lee , Ludovic Dos Santos , Jean-Yves Franceschi , Chansoo Kim , Alain Rakotomamonjy

We consider the inference problem for parameters in stochastic differential equation models from discrete time observations (e.g. experimental or simulation data). Specifically, we study the case where one does not have access to…

Numerical Analysis · Mathematics 2018-04-10 Sebastian Krumscheid

Imperfect score-matching leads to a shift between the training and the sampling distribution of diffusion models. Due to the recursive nature of the generation process, errors in previous steps yield sampling iterates that drift away from…

Machine Learning · Computer Science 2023-02-20 Giannis Daras , Yuval Dagan , Alexandros G. Dimakis , Constantinos Daskalakis

This paper proposes a new stochastic model of traffic dynamics in Lagrangian coordinates. The source of uncertainty is heterogeneity in driving behavior, captured using driver-specific speed-spacing relations, i.e., parametric uncertainty.…

Systems and Control · Computer Science 2019-08-16 Fangfang Zheng , Saif Eddin Jabari , Henry X. Liu , DianChao Lin

Parameter estimation in linear errors-in-variables models typically requires that the measurement error distribution be known (or estimable from replicate data). A generalized method of moments approach can be used to estimate model…

Methodology · Statistics 2018-12-04 Linh Nghiem , Michael Byrd , Cornelis Potgieter