English
Related papers

Related papers: Flow Annealed Importance Sampling Bootstrap meets …

200 papers

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

Machine Learning · Computer Science 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang

This study presents an importance sampling formulation based on adaptively relaxing parameters from the indicator function and/or the probability density function. The formulation embodies the prevalent mathematical concept of relaxing a…

Applications · Statistics 2024-04-11 Jianhua Xian , Ziqi Wang

Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chang Won Lee , Selina Leveugle , Svetlana Stolpner , Chris Langley , Paul Grouchy , Jonathan Kelly , Steven L. Waslander

Deep generative frameworks including GANs and normalizing flow models have proven successful at filling in missing values in partially observed data samples by effectively learning -- either explicitly or implicitly -- complex,…

Machine Learning · Computer Science 2021-04-06 Edgar A. Bernal

Annealed importance sampling is a means to assign equilibrium weights to a nonequilibrium sample that was generated by a simulated annealing protocol. The weights may then be used to calculate equilibrium averages, and also serve as an…

Biomolecules · Quantitative Biology 2009-11-13 Edward Lyman , Daniel M. Zuckerman

Machine Learning (ML) models in Robotic Assembly Sequence Planning (RASP) need to be introspective on the predicted solutions, i.e. whether they are feasible or not, to circumvent potential efficiency degradation. Previous works need both…

Particle Filtering (PF) methods are an established class of procedures for performing inference in non-linear state-space models. Resampling is a key ingredient of PF, necessary to obtain low variance likelihood and states estimates.…

Machine Learning · Statistics 2021-07-01 Adrien Corenflos , James Thornton , George Deligiannidis , Arnaud Doucet

We introduce a novel, training-free method for sampling differentiable representations (diffreps) using pretrained diffusion models. Rather than merely mode-seeking, our method achieves sampling by "pulling back" the dynamics of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yash Savani , Marc Finzi , J. Zico Kolter

Differentiable particle filters provide a flexible mechanism to adaptively train dynamic and measurement models by learning from observed data. However, most existing differentiable particle filters are within the bootstrap particle…

Artificial Intelligence · Computer Science 2021-11-11 Xiongjie Chen , Hao Wen , Yunpeng Li

Importance sampling has been successfully used to accelerate stochastic optimization in many convex problems. However, the lack of an efficient way to calculate the importance still hinders its application to Deep Learning. In this paper,…

Machine Learning · Computer Science 2017-09-14 Angelos Katharopoulos , François Fleuret

As a highly expressive generative model, diffusion models have demonstrated exceptional success across various domains, including image generation, natural language processing, and combinatorial optimization. However, as data distributions…

Machine Learning · Computer Science 2025-10-27 Myunsoo Kim , Donghyeon Ki , Seong-Woong Shim , Byung-Jun Lee

Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal…

Machine Learning · Computer Science 2023-11-02 Shivakanth Sujit , Somjit Nath , Pedro H. M. Braga , Samira Ebrahimi Kahou

Disentangled representation learning aims to capture the underlying explanatory factors of observed data, enabling a principled understanding of the data-generating process. Recent advances in generative modeling have introduced new…

Machine Learning · Computer Science 2026-05-12 Jinjin Chi , Taoping Liu , Mengtao Yin , Ximing Li , Yongcheng Jing , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Deep generative models provide state-of-the-art performance across a wide array of applications, with recent studies showing increasing applicability for science and engineering. Despite a growing corpus of literature focused on the…

Machine Learning · Computer Science 2026-05-14 Jacob K. Christopher , James E. Warner , Ferdinando Fioretto

Despite the advances in the representational capacity of approximate distributions for variational inference, the optimization process can still limit the density that is ultimately learned. We demonstrate the drawbacks of biasing the true…

Machine Learning · Computer Science 2018-10-29 Chin-Wei Huang , Shawn Tan , Alexandre Lacoste , Aaron Courville

Importance sampling is a popular technique in Bayesian inference: by reweighting samples drawn from a proposal distribution we are able to obtain samples and moment estimates from a Bayesian posterior over latent variables. Recent work,…

Computation · Statistics 2024-06-19 Sam Bowyer , Thomas Heap , Laurence Aitchison

In federated learning (FL), accommodating clients' varied computational capacities poses a challenge, often limiting the participation of those with constrained resources in global model training. To address this issue, the concept of model…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-10 Feijie Wu , Xingchen Wang , Yaqing Wang , Tianci Liu , Lu Su , Jing Gao

Generative models such as diffusion models, excel at capturing high-dimensional distributions with diverse input modalities, e.g. robot trajectories, but are less effective at multi-step constraint reasoning. Task and Motion Planning (TAMP)…

Importance sampling, which involves sampling from a probability density function (PDF) proportional to the product of an importance weight function and a base PDF, is a powerful technique with applications in variance reduction, biased or…

Machine Learning · Computer Science 2025-02-10 Heasung Kim , Taekyun Lee , Hyeji Kim , Gustavo de Veciana

This article presents new methodology for sample-based Bayesian inference when data are partitioned and communication between the parts is expensive, as arises by necessity in the context of "big data" or by choice in order to take…

Methodology · Statistics 2022-11-01 Marc Box