English
Related papers

Related papers: Efficient Amortised Bayesian Inference for Hierarc…

200 papers

Amortized Bayesian inference trains neural networks to solve stochastic inference problems using model simulations, thereby making it possible to rapidly perform Bayesian inference for any newly observed data. However, current…

Machine Learning · Computer Science 2024-07-16 Manuel Gloeckler , Michael Deistler , Christian Weilbach , Frank Wood , Jakob H. Macke

Nonlinear differential equations (DEs) are used in a wide range of scientific problems to model complex dynamic systems. The differential equations often contain unknown parameters that are of scientific interest, which have to be estimated…

Computation · Statistics 2021-09-07 Shijia Wang , Shufei Ge , Renny Doig , Liangliang Wang

We propose an efficient inference method for switching nonlinear dynamical systems. The key idea is to learn an inference network which can be used as a proposal distribution for the continuous latent variables, while performing exact…

Machine Learning · Computer Science 2020-02-12 Zhe Dong , Bryan A. Seybold , Kevin P. Murphy , Hung H. Bui

System inference for nonlinear dynamic models, represented by ordinary differential equations (ODEs), remains a significant challenge in many fields, particularly when the data are noisy, sparse, or partially observable. In this paper, we…

Machine Learning · Computer Science 2025-12-25 Hyunwoo Cho , Hyeontae Jo , Hyung Ju Hwang

This paper proposes a probabilistic Bayesian formulation for system identification (ID) and estimation of nonseparable Hamiltonian systems using stochastic dynamic models. Nonseparable Hamiltonian systems arise in models from diverse…

Dynamical Systems · Mathematics 2022-09-19 Harsh Sharma , Nicholas Galioto , Alex A. Gorodetsky , Boris Kramer

Complex simulator-based models are now routinely used to perform inference across the sciences and engineering, but existing inference methods are often unable to account for outliers and other extreme values in data which occur due to…

Machine Learning · Statistics 2026-02-18 Ayush Bharti , Charita Dellaporta , Yuga Hikida , François-Xavier Briol

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

Dynamical systems governed by ordinary differential equations (ODEs) serve as models for a vast number of natural and social phenomena. In this work, we offer a fresh perspective on the classical problem of imputing missing time series…

Machine Learning · Computer Science 2025-03-17 Patrick Seifner , Kostadin Cvejoski , Antonia Körner , Ramsés J. Sánchez

Many critical applications, from autonomous scientific discovery to personalized medicine, demand systems that can both strategically acquire the most informative data and instantaneously perform inference based upon it. While amortized…

Machine Learning · Statistics 2025-10-22 Daolang Huang , Xinyi Wen , Ayush Bharti , Samuel Kaski , Luigi Acerbi

This paper addresses the data-driven identification of latent dynamical representations of partially-observed systems, i.e., dynamical systems for which some components are never observed, with an emphasis on forecasting applications,…

This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable…

Machine Learning · Computer Science 2020-04-21 Yibo Yang , Mohamed Aziz Bhouri , Paris Perdikaris

We develop and apply a learning framework for parameter estimation in initial value problems that are assessed only indirectly via aggregate data such as sample means and/or standard deviations. Our comprehensive framework follows Bayesian…

Quantitative Methods · Quantitative Biology 2025-06-27 Stephen McCoy , Daniel McBride , D. Katie McCullough , Benjamin C. Calfee , Erik Zinser , David Talmy , Ioannis Sgouralis

Finite mixtures are a broad class of models useful in scenarios where observed data is generated by multiple distinct processes but without explicit information about the responsible process for each data point. Estimating Bayesian mixture…

Machine Learning · Statistics 2026-03-17 Šimon Kucharský , Paul Christian Bürkner

Deep generative models such as flow matching and diffusion models have shown great potential in learning complex distributions and dynamical systems, but often act as black-boxes, neglecting underlying physics. In contrast, physics-based…

Machine Learning · Computer Science 2026-04-28 Gurjeet Sangra Singh , Frantzeska Lavda , Giangiacomo Mercatali , Alexandros Kalousis

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

Computation · Statistics 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

This paper presents ORXE, a modular and adaptable framework for achieving real-time configurable efficiency in AI models. By leveraging a collection of pre-trained experts with diverse computational costs and performance levels, ORXE…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Qingyuan Wang , Guoxin Wang , Barry Cardiff , Deepu John

Bayesian inference often faces a trade-off between computational speed and sampling accuracy. We propose an adaptive workflow that integrates rapid amortized inference with gold-standard MCMC techniques to achieve a favorable combination of…

Machine Learning · Computer Science 2026-02-19 Chengkun Li , Aki Vehtari , Paul-Christian Bürkner , Stefan T. Radev , Luigi Acerbi , Marvin Schmitt

Data generated from dynamical systems with unknown dynamics enable the learning of state observers that are: robust to modeling error, computationally tractable to design, and capable of operating with guaranteed performance. In this paper,…

Systems and Control · Electrical Eng. & Systems 2021-06-28 Ankush Chakrabarty , Mouhacine Benosman

Biological systems commonly exhibit complex spatiotemporal patterns whose underlying generative mechanisms pose a significant analytical challenge. Traditional approaches to spatiodynamic inference rely on dimensionality reduction through…

Quantitative Methods · Quantitative Biology 2025-08-01 Jun Won Park , Kangyu Zhao , Sanket Rane

In complex physical systems, conventional differential equations often fall short in capturing non-local and memory effects, as they are limited to local dynamics and integer-order interactions. This study introduces a stepwise data-driven…

Computational Physics · Physics 2025-05-30 Xiangnan Yu , Hao Xu , Zhiping Mao , HongGuang Sun , Yong Zhang , Dongxiao Zhang , Yuntian Chen