English
Related papers

Related papers: Moment-Based Variational Inference for Markov Jump…

200 papers

We examine an analytic variational inference scheme for the Gaussian Process State Space Model (GPSSM) - a probabilistic model for system identification and time-series modelling. Our approach performs variational inference over both the…

Machine Learning · Statistics 2018-12-11 Alessandro Davide Ialongo , Mark van der Wilk , Carl Edward Rasmussen

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling

We introduce and test a general machine-learning-based technique for the inference of short term causal dependence between state variables of an unknown dynamical system from time series measurements of its state variables. Our technique…

Adaptation and Self-Organizing Systems · Physics 2020-12-18 Amitava Banerjee , Jaideep Pathak , Rajarshi Roy , Juan G. Restrepo , Edward Ott

We develop the first exact Bayesian methodology for the problem of inference in discretely observed regime switching diffusions. Switching diffusion models extend ordinary diffusions by allowing for jumps in instantaneous drift and…

Biochemical reactions can happen on different time scales and also the abundance of species in these reactions can be very different from each other. Classical approaches, such as deterministic or stochastic approach, fail to account for or…

Quantitative Methods · Quantitative Biology 2014-09-16 Arnab Ganguly , Derya Altintan , Heinz Koeppl

Motion planning under uncertainty for an autonomous system can be formulated as a Markov Decision Process with a continuous state space. In this paper, we propose a novel solution to this decision-theoretic planning problem that directly…

Robotics · Computer Science 2020-07-02 Junhong Xu , Kai Yin , Lantao Liu

We consider a class of pure jump Markov processes in $\rr^d$ whose jump kernels are comparable to those of symmetric stable processes. We prove a support theorem, a lower bound on the occupation times of sets, and show that we can…

Probability · Mathematics 2011-02-25 Brian M. Whitehead

Variational inference has had great success in scaling approximate Bayesian inference to big data by exploiting mini-batch training. To date, however, this strategy has been most applicable to models of independent data. We propose an…

Machine Learning · Statistics 2021-05-19 Tom Ryder , Dennis Prangle , Andrew Golightly , Isaac Matthews

Guided diffusion sampling relies on approximating often intractable likelihood scores, which introduces significant noise into the sampling dynamics. We propose using adaptive moment estimation to stabilize these noisy likelihood scores…

Machine Learning · Computer Science 2026-04-24 Christian Belardi , Justin Lovelace , Kilian Q. Weinberger , Carla P. Gomes

We develop a new Monte Carlo variance reduction method to estimate the expectation of two commonly encountered path-dependent functionals: first-passage times and occupation times of sets. The method is based on a recursive approximation of…

Probability · Mathematics 2014-10-28 Aleksandar Mijatovic , Martijn Pistorius , Johannes Stolte

We derive and present explicit algorithms to facilitate streamlined computing for variational inference for models containing higher level random effects. Existing literature, such as Lee and Wand (2016), is such that streamlined…

Computation · Statistics 2020-07-07 Tui H. Nolan , Marianne Menictas , Matt P. Wand

To achieve scalable and accurate inference for latent Gaussian processes, we propose a variational approximation based on a family of Gaussian distributions whose covariance matrices have sparse inverse Cholesky (SIC) factors. We combine…

Machine Learning · Statistics 2023-05-30 Jian Cao , Myeongjong Kang , Felix Jimenez , Huiyan Sang , Florian Schafer , Matthias Katzfuss

This paper presents a numerical method to calculate the value function for a general discounted impulse control problem for piecewise deterministic Markov processes. Our approach is based on a quantization technique for the underlying…

Probability · Mathematics 2011-08-31 Benoîte de Saporta , François Dufour

Gaussian process (GP) regression with 1D inputs can often be performed in linear time via a stochastic differential equation formulation. However, for non-Gaussian likelihoods, this requires application of approximate inference methods…

Machine Learning · Computer Science 2020-07-20 Paul E. Chang , William J. Wilkinson , Mohammad Emtiyaz Khan , Arno Solin

Statistical inference for discretely observed jump-diffusion processes is a complex problem which motivates new methodological challenges. Thus existing approaches invariably resort to time-discretisations which inevitably lead to…

Methodology · Statistics 2023-03-02 Flávio B. Gonçalves , Krzysztof G. Łatuszyński , Gareth O. Roberts

Recent advances in deep learning have brought to the fore models that can make multiple computational steps in the service of completing a task; these are capable of describ- ing long-term dependencies in sequential data. Novel recurrent…

Machine Learning · Computer Science 2018-09-06 Kyriakos Tolias , Sotirios Chatzis

Features in machine learning problems are often time-varying and may be related to outputs in an algebraic or dynamical manner. The dynamic nature of these machine learning problems renders current higher order accelerated gradient descent…

Optimization and Control · Mathematics 2019-05-29 Joseph E. Gaudio , Travis E. Gibson , Anuradha M. Annaswamy , Michael A. Bolender

Machine learning has emerged as a promising approach to study the properties of many-body systems. Recently proposed as a tool to classify phases of matter, the approach relies on classical simulation methods$-$such as Monte Carlo$-$which…

Quantum Physics · Physics 2020-07-17 Alexey Uvarov , Andrey Kardashin , Jacob Biamonte

We define a new variant of exclusion processes in discrete time that has jump probabilities that depend on the last jump performed. In a particular limit for the jump probabilities and in suitable scaling limits for space and time, we…

Statistical Mechanics · Physics 2021-04-01 Bryan Debin , Etienne Granet

Variational algorithms have particular relevance for near-term quantum computers but require non-trivial parameter optimisations. Here we propose Analytic Descent: Given that the energy landscape must have a certain simple form in the local…

Quantum Physics · Physics 2022-05-16 Bálint Koczor , Simon C. Benjamin
‹ Prev 1 4 5 6 7 8 10 Next ›