English
Related papers

Related papers: Path-Guided Particle-based Sampling

200 papers

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

We formulate natural gradient variational inference (VI), expectation propagation (EP), and posterior linearisation (PL) as extensions of Newton's method for optimising the parameters of a Bayesian posterior distribution. This viewpoint…

Machine Learning · Statistics 2022-12-07 William J. Wilkinson , Simo Särkkä , Arno Solin

Stochastic gradients have been widely integrated into Langevin-based methods to improve their scalability and efficiency in solving large-scale sampling problems. However, the proximal sampler, which exhibits much faster convergence than…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Yi-An Ma , Hanze Dong , Tong Zhang

Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of…

Machine Learning · Statistics 2023-11-01 Mingxuan Yi , Song Liu

The proximal stochastic gradient method (PSGD) is one of the state-of-the-art approaches for stochastic composite-type problems. In contrast to its deterministic counterpart, PSGD has been found to have difficulties with the correct…

Optimization and Control · Mathematics 2026-03-04 Junwen Qiu , Li Jiang , Andre Milzarek

Obtaining a reduced description with particle and momentum flux densities outgoing from the microscopic equations of motion of the particles requires approximations. The usual method, we refer to as truncation method, is to zero Fourier…

Statistical Mechanics · Physics 2017-01-04 Hamid Seyed-Allaei , Lutz Schimansky-Geier , Mohammad Reza Ejtehadi

Robust Bayesian inference using density power divergence (DPD) has emerged as a promising approach for handling outliers in statistical estimation. Although the DPD-based posterior offers theoretical guarantees of robustness, its practical…

Methodology · Statistics 2025-12-11 Naruki Sonobe , Tomotaka Momozaki , Tomoyuki Nakagawa

Probabilistic load forecasting (PLF) is a key component in the extended tool-chain required for efficient management of smart energy grids. Neural networks are widely considered to achieve improved prediction performances, supporting highly…

Signal Processing · Electrical Eng. & Systems 2021-01-12 Alessandro Brusaferri , Matteo Matteucci , Stefano Spinelli , Andrea Vitali

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

The theoretical investigation of gas adsorption, storage, separation, diffusion and related transport processes in porous materials relies on a detailed knowledge of the potential energy surface of molecules in a stationary environment. In…

Chemical Physics · Physics 2025-01-30 Johannes K. Krondorfer , Christian W. Binder , Andreas W. Hauser

We propose a learning-based method for light-path construction in path tracing algorithms, which iteratively optimizes and samples from what we refer to as spatio-directional Gaussian mixture models (SDMMs). In particular, we approximate…

Graphics · Computer Science 2021-12-30 Ana Dodik , Marios Papas , Cengiz Öztireli , Thomas Müller

Particle Markov Chain Monte Carlo methods are used to carry out inference in non-linear and non-Gaussian state space models, where the posterior density of the states is approximated using particles. Current approaches usually perform…

Computation · Statistics 2019-09-30 Eduardo F. Mendes , Christopher K. Carter , David Gunawan , Robert Kohn

The particle-based, rapid incremental smoother (PARIS) is a sequential Monte Carlo technique allowing for efficient online approximation of expectations of additive functionals under Feynman--Kac path distributions. Under weak assumptions,…

Methodology · Statistics 2022-09-22 Gabriel Cardoso , Eric Moulines , Jimmy Olsson

Geographical data are generally autocorrelated. In this case, it is preferable to select spread units. In this paper, we propose a new method for selecting well-spread samples from a finite spatial population with equal or unequal inclusion…

Methodology · Statistics 2020-08-11 Raphaël Jauslin , Yves Tillé

Particle-based methods include a variety of techniques, such as Markov Chain Monte Carlo (MCMC) and Sequential Monte Carlo (SMC), for approximating a probabilistic target distribution with a set of weighted particles. In this paper, we…

Machine Learning · Statistics 2024-12-03 Hadi Mohasel Afshar , Gilad Francis , Sally Cripps

This paper aims to efficiently compute transport maps between probability distributions arising from particle representation of bio-physical problems. We develop a bidirectional DeepParticle (BDP) method to learn and generate solutions…

Computational Physics · Physics 2025-04-17 Tan Zhang , Zhongjian Wang , Jack Xin , Zhiwen Zhang

We investigate the convergence rates and data sample sizes required for training a machine learning model using a stochastic gradient descent (SGD) algorithm, where data points are sampled based on either their loss value or uncertainty…

Machine Learning · Computer Science 2024-11-26 Daniel Haimovich , Dima Karamshuk , Fridolin Linder , Niek Tax , Milan Vojnovic

Stein Variational Gradient Descent (SVGD) is an algorithm for sampling from a target density which is known up to a multiplicative constant. Although SVGD is a popular algorithm in practice, its theoretical study is limited to a few recent…

Machine Learning · Computer Science 2022-06-20 Adil Salim , Lukang Sun , Peter Richtárik

Optimal Transport has sparked vivid interest in recent years, in particular thanks to the Wasserstein distance, which provides a geometrically sensible and intuitive way of comparing probability measures. For computational reasons, the…

Machine Learning · Computer Science 2024-03-19 Eloi Tanguy

Distance measures between graphs are important primitives for a variety of learning tasks. In this work, we describe an unsupervised, optimal transport based approach to define a distance between graphs. Our idea is to derive…

Computational Engineering, Finance, and Science · Computer Science 2024-04-11 Michael Scholkemper , Damin Kühn , Gerion Nabbefeld , Simon Musall , Björn Kampa , Michael T. Schaub