English
Related papers

Related papers: Self-Consistent Stochastic Model Errors in Data As…

200 papers

One way to interject knowledge into clinically impactful forecasting is to use data assimilation, a nonlinear regression that projects data onto a mechanistic physiologic model, instead of a set of functions, such as neural networks. Such…

Quantitative Methods · Quantitative Biology 2019-02-07 DJ Albers , M Levine , L Mamykina , G Hripcsak

In this paper we analyze the probability of consistency of sensor data distribution systems (SDDS), and determine suitable evaluation models. This problem is typically difficult, since a reliable model taking into account all parameters and…

Networking and Internet Architecture · Computer Science 2016-11-17 Mauro Femminella , Gianluca Reali

Autocovariance of the error term in a time series model plays a key role in the estimation and inference for the model that it belongs to. Typically, some arbitrary parametric structure is assumed upon the error to simplify the estimation,…

Methodology · Statistics 2022-10-17 Yoon Bae Jun , Chae Young Lim , Kun Ho Kim

In many situations, sample data is obtained from a noisy or imperfect source. In order to address such corruptions, this paper introduces the concept of a sampling corrector. Such algorithms use structure that the distribution is purported…

Data Structures and Algorithms · Computer Science 2018-04-03 Clément Canonne , Themis Gouleakis , Ronitt Rubinfeld

Signal Temporal Logic (STL) inference learns interpretable logical rules for temporal behaviors in dynamical systems. To ensure the correctness of learned STL formulas, recent approaches have incorporated conformal prediction as a…

Machine Learning · Computer Science 2026-03-31 Yixuan Wang , Danyang Li , Matthew Cleaveland , Roberto Tron , Mingyu Cai

In the Monte Carlo (MC) method statistical noise is usually present. Statistical noise may become dominant in the calculation of a distribution, usually by iteration, but is less Important in calculating integrals. The subject of the…

Computational Physics · Physics 2013-11-08 Mihály Makai , Zoltán Szatmáry

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

Implicit particle filters for data assimilation generate high-probability samples by representing each particle location as a separate function of a common reference variable. This representation requires that a certain underdetermined…

Numerical Analysis · Mathematics 2015-05-27 Matthias Morzfeld , Xuemin Tu , Ethan Atkins , Alexandre J. Chorin

We examine the extent to which sublinear-sample property testing and estimation apply to settings where samples are independently but not identically distributed. Specifically, we consider the following distributional property testing…

Data Structures and Algorithms · Computer Science 2025-11-05 Shivam Garg , Chirag Pabbaraju , Kirankumar Shiragur , Gregory Valiant

We propose a two-sample testing procedure based on learned deep neural network representations. To this end, we define two test statistics that perform an asymptotic location test on data samples mapped onto a hidden layer. The tests are…

Machine Learning · Statistics 2020-03-11 Matthias Kirchler , Shahryar Khorasani , Marius Kloft , Christoph Lippert

Variational data assimilation in continuous time is revisited. The central techniques applied in this paper are in part adopted from the theory of optimal nonlinear control. Alternatively, the investigated approach can be considered as a…

Atmospheric and Oceanic Physics · Physics 2015-05-18 Jochen Bröcker

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Test-time adaptation (TTA) enables efficient adaptation of deployed models, yet it often leads to poorly calibrated predictive uncertainty - a critical issue in high-stakes domains such as autonomous driving, finance, and healthcare.…

Machine Learning · Computer Science 2025-12-09 Gilhyun Nam , Taewon Kim , Joonhyun Jeong , Eunho Yang

We introduce a data assimilation method to estimate model parameters with observations of passive tracers by directly assimilating Lagrangian Coherent Structures. Our approach differs from the usual Lagrangian Data Assimilation approach,…

Atmospheric and Oceanic Physics · Physics 2017-11-22 John Maclean , Naratip Santitissadeekorn , Christopher KRT Jones

As causal ground truth is incredibly rare, causal discovery algorithms are commonly only evaluated on simulated data. This is concerning, given that simulations reflect preconceptions about generating processes regarding noise…

Classifiers and other statistics-based machine learning (ML) techniques generalize, or learn, based on various statistical properties of the training data. The assumption underlying statistical ML resulting in theoretical or empirical…

Machine Learning · Computer Science 2021-11-11 Samuel Ackerman , Orna Raz , Marcel Zalmanovici , Aviad Zlotnick

We review approaches to statistical inference based on randomization. Permutation tests are treated as an important special case. Under a certain group invariance property, referred to as the ``randomization hypothesis,'' randomization…

Econometrics · Economics 2025-02-05 David M. Ritzwoller , Joseph P. Romano , Azeem M. Shaikh

Conformal inference is a fundamental and versatile tool that provides distribution-free guarantees for many machine learning tasks. We consider the transductive setting, where decisions are made on a test sample of $m$ new points, giving…

Methodology · Statistics 2024-03-20 Ulysse Gazin , Gilles Blanchard , Etienne Roquain

Robust inference for stochastic dynamical systems is often hampered by sparse sampling and the absence of closed-form likelihoods. We introduce a Monte Carlo path-inference framework that leverages full-path statistics and bridge processes…

Statistical Mechanics · Physics 2025-10-07 Javier Aguilar , Miguel A. Muñoz , Sandro Azaele

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

Machine Learning · Statistics 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu