English
Related papers

Related papers: Black-Box Inference for Non-Linear Latent Force Mo…

200 papers

Inferring behavior model of a running software system is quite useful for several automated software engineering tasks, such as program comprehension, anomaly detection, and testing. Most existing dynamic model inference techniques are…

Machine Learning · Computer Science 2020-08-31 Mohammad Jafar Mashhadi , Hadi Hemmati

Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in downstream tasks poses an intractable posterior inference problem. This paper studies amortized…

In this paper, the problem of state estimation, in the context of both filtering and smoothing, for nonlinear state-space models is considered. Due to the nonlinear nature of the models, the state estimation problem is generally intractable…

Machine Learning · Statistics 2021-11-24 Jarrad Courts , Adrian Wills , Thomas B. Schön

Laplace approximations are a standard tool for computationally efficient inference in latent Gaussian models, but they fail for quantile regression with the asymmetric Laplace likelihood because the observed Hessian vanishes almost…

Methodology · Statistics 2026-05-21 Andrea Nava , Fabio Sigrist

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

Stochastic processes are a flexible and widely used family of models for statistical modeling. While stochastic processes offer attractive properties such as inclusion of uncertainty properties, their inference is typically intractable,…

Methodology · Statistics 2026-02-10 Teemu Härkönen , Simo Särkkä

Complex systems may be subject to various uncertainties. A great effort has been concentrated on predicting the dynamics under uncertainty in initial conditions. In the present work, we consider the well-known Burgers equation with random…

Classical Analysis and ODEs · Mathematics 2007-05-23 Dirk Blömker , Jinqiao Duan

Non-Gaussian likelihoods are essential for modelling complex real-world observations but pose significant computational challenges in learning and inference. Even with Gaussian priors, non-Gaussian likelihoods often lead to analytically…

Machine Learning · Statistics 2024-10-29 Thang D. Bui

Many complex systems operating far from the equilibrium exhibit stochastic dynamics that can be described by a Langevin equation. Inferring Langevin equations from data can reveal how transient dynamics of such systems give rise to their…

Machine Learning · Statistics 2021-11-01 Mikhail Genkin , Owen Hughes , Tatiana A. Engel

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2021-10-15 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

Understanding the inner mechanisms of black-box foundation models (FMs) is essential yet challenging in artificial intelligence and its applications. Over the last decade, the long-running focus has been on their explainability, leading to…

Machine Learning · Computer Science 2024-11-26 Shi Fu , Yuzhu Chen , Yingjie Wang , Dacheng Tao

This study presents a conditional flow matching framework for solving physics-constrained Bayesian inverse problems. In this setting, samples from the joint distribution of inferred variables and measurements are assumed available, while…

An efficient technique is introduced for model inference of complex nonlinear dynamical systems driven by noise. The technique does not require extensive global optimization, provides optimal compensation for noise-induced errors and is…

Data Analysis, Statistics and Probability · Physics 2007-05-23 V. N. Smelyanskiy , D. A. Timucin , A. Bandrivskyy , D. G. Luchinsky

We consider the problem of computing the maximal invariant set of discrete-time black-box nonlinear systems without analytic dynamical models. Under the assumption that the system is asymptotically stable, the maximal invariant set…

Systems and Control · Electrical Eng. & Systems 2021-05-31 Zheming Wang , Raphaël M. Jungers

Systems of interacting continuous-time Markov chains are a powerful model class, but inference is typically intractable in high dimensional settings. Auxiliary information, such as noisy observations, is typically only available at discrete…

Machine Learning · Statistics 2026-04-21 Giosue Migliorini , Padhraic Smyth

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

Current supervised learning can learn spurious correlation during the data-fitting process, imposing issues regarding interpretability, out-of-distribution (OOD) generalization, and robustness. To avoid spurious correlation, we propose a…

Machine Learning · Computer Science 2021-04-29 Xinwei Sun , Botong Wu , Xiangyu Zheng , Chang Liu , Wei Chen , Tao Qin , Tie-yan Liu

Bayesian inference on non-Gaussian data is often non-analytic and requires computationally expensive approximations such as sampling or variational inference. We propose an approximate inference framework primarily designed to be…

Machine Learning · Computer Science 2022-10-12 Marius Hobbhahn , Philipp Hennig

Late-lumping feedback design for infinite-dimensional linear systems with unbounded input operators is considered. The proposed scheme is suitable for the approximation of backstepping and flatness-based designs and relies on a…

Optimization and Control · Mathematics 2022-11-03 Marcus Riesmeier , Frank Woittennek

This paper deals with the state estimation of non-linear and non-Gaussian systems with an emphasis on the numerical solution to the Bayesian recursive relations. In particular, this paper builds upon the Lagrangian grid-based filter (GbF)…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Jindřich Duník , Jan Krejčí , Jakub Matoušek , Marek Brandner , Yeongkwon Choe