English
Related papers

Related papers: Efficient Amortised Bayesian Inference for Hierarc…

200 papers

This paper proposes a hierarchical, multi-resolution framework for the identification of model parameters and their spatially variability from noisy measurements of the response or output. Such parameters are frequently encountered in…

Mathematical Physics · Physics 2015-05-13 P. S. Koutsourelakis

Learning dynamical systems from incomplete or noisy data is inherently ill-posed, as a single observation may correspond to multiple plausible futures. While physics-based ensemble forecasting relies on perturbing initial states to capture…

Machine Learning · Computer Science 2026-02-27 Siddharth Rout , Eldad Haber , Stephane Gaudreault

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

This paper provides a unifying theoretical framework for stochastic optimization algorithms by means of a latent stochastic variational problem. Using techniques from stochastic control, the solution to the variational problem is shown to…

Machine Learning · Computer Science 2019-10-29 Philippe Casgrain

Automatic machine learning of empirical models from experimental data has recently become possible as a result of increased availability of computational power and dedicated algorithms. Despite the successes of non-parametric inference and…

Statistical Mechanics · Physics 2024-06-04 Yunfei Huang , Youssef Mabrouk , Gerhard Gompper , Benedikt Sabass

Learning and predicting the dynamics of physical systems requires a profound understanding of the underlying physical laws. Recent works on learning physical laws involve generalizing the equation discovery frameworks to the discovery of…

Machine Learning · Statistics 2023-10-11 Tapas Tripura , Souvik Chakraborty

Inferring the structure and dynamics of network models is critical to understanding the functionality and control of complex systems, such as metabolic and regulatory biological networks. The increasing quality and quantity of experimental…

Dynamical Systems · Mathematics 2016-05-27 Niall M. Mangan , Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

Domain experts often possess valuable physical insights that are overlooked in fully automated decision-making processes such as Bayesian optimisation. In this article we apply high-throughput (batch) Bayesian optimisation alongside…

Machine Learning · Computer Science 2023-12-06 Tom Savage , Ehecatl Antonio del Rio Chanona

Nonlinear mixed effects modeling is a powerful tool when analyzing data from several entities in an experiment. In this paper, we present NLMEModeling, a package for mixed effects modeling in Wolfram Mathematica. NLMEModeling supports mixed…

Computation · Statistics 2020-11-16 Jacob Leander , Joachim Almquist , Anna Johnning , Julia Larsson , Mats Jirstrand

Mechanistic models with differential equations are a key component of scientific applications of machine learning. Inference in such models is usually computationally demanding, because it involves repeatedly solving the differential…

Machine Learning · Statistics 2022-07-06 Jonathan Schmidt , Nicholas Krämer , Philipp Hennig

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

In this article, we present an extension of the formulation recently developed by the authors (A Framework for Data-Driven Computational Mechanics Based on Nonlinear Optimization, arXiv:1910.12736 [math.NA]) to the structural dynamics…

Numerical Analysis · Mathematics 2019-12-25 Cristian Guillermo Gebhardt , Marc Christian Steinbach , Dominik Schillinger , Raimund Rolfes

Modeling nonstationary processes is of paramount importance to many scientific disciplines including environmental science, ecology, and finance, among others. Consequently, flexible methodology that provides accurate estimation across a…

Methodology · Statistics 2014-08-13 Wen-Hsi Yang , Scott H. Holan , Christopher K. Wikle

We describe different Bayesian ensemble refinement methods, examine their interrelation, and discuss their practical application. With ensemble refinement, the properties of dynamic and partially disordered (bio)molecular structures can be…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Gerhard Hummer , Jürgen Köfinger

In conventional ODE modelling coefficients of an equation driving the system state forward in time are estimated. However, for many complex systems it is practically impossible to determine the equations or interactions governing the…

Machine Learning · Statistics 2018-03-13 Markus Heinonen , Cagatay Yildiz , Henrik Mannerström , Jukka Intosalmi , Harri Lähdesmäki

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

There are many issues that can cause problems when attempting to infer model parameters from data. Data and models are both imperfect, and as such there are multiple scenarios in which standard methods of inference will lead to misleading…

Computation · Statistics 2024-05-01 Simon L. Cotter

Bayesian optimization has proven to be a highly effective methodology for the global optimization of unknown, expensive and multimodal functions. The ability to accurately model distributions over functions is critical to the effectiveness…

Machine Learning · Statistics 2014-06-13 Jasper Snoek , Kevin Swersky , Richard S. Zemel , Ryan P. Adams

In this paper, we propose a Bayesian approach for multiscale problems with the availability of dynamic observational data. Our method selects important degrees of freedom probabilistically in a Generalized multiscale finite element method…

Numerical Analysis · Mathematics 2018-06-18 Siu Wun Cheung , Nilabja Guha