English
Related papers

Related papers: Slithering Through Gaps: Capturing Discrete Isolat…

200 papers

While diffusion models have made remarkable progress in image generation, their outputs can still appear unrealistic and lack fine details, especially when using fewer number of neural function evaluations (NFEs) or lower guidance scales.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Seyedmorteza Sadat , Farnood Salehi , Romann M. Weber

Dynamic structural equation modeling (DSEM) is widely used for analyzing intensive longitudinal data (ILD). Although many ILD have categorical (Bernoulli or binomially distributed) responses, currently available Metropolis-within-Gibbs…

Computation · Statistics 2026-04-01 Øystein Sørensen , Ethan M. McCormick

Dependency networks (Heckerman et al., 2000) provide a flexible framework for modeling complex systems with many variables by combining independently learned local conditional distributions through pseudo-Gibbs sampling. Despite their…

Machine Learning · Computer Science 2026-04-02 Kazuya Takabatake , Shotaro Akaho

Hybrid Gibbs samplers represent a prominent class of approximated Gibbs algorithms that utilize Markov chains to approximate conditional distributions, with the Metropolis-within-Gibbs algorithm standing out as a well-known example. Despite…

Statistics Theory · Mathematics 2025-03-24 Qian Qin , Nianqiao Ju , Guanyang Wang

Nonparametric Bayesian approaches to clustering, information retrieval, language modeling and object recognition have recently shown great promise as a new paradigm for unsupervised data analysis. Most contributions have focused on the…

Methodology · Statistics 2012-07-02 Ian Porteous , Alexander T. Ihler , Padhraic Smyth , Max Welling

Standard Gibbs sampling applied to a multivariate normal distribution with a specified precision matrix is equivalent in fundamental ways to the Gauss-Seidel iterative solution of linear equations in the precision matrix. Specifically, the…

Computation · Statistics 2015-05-14 Colin Fox , Albert Parker

We propose discrete Langevin proposal (DLP), a simple and scalable gradient-based proposal for sampling complex high-dimensional discrete distributions. In contrast to Gibbs sampling-based methods, DLP is able to update all coordinates in…

Machine Learning · Computer Science 2022-06-22 Ruqi Zhang , Xingchao Liu , Qiang Liu

The numerical representation of high-dimensional Gibbs distributions is challenging due to the curse of dimensionality manifesting through the intractable normalization constant calculations. This work addresses this challenge by performing…

Numerical Analysis · Mathematics 2025-01-30 Nan Sheng , Xun Tang , Haoxuan Chen , Lexing Ying

Rapid sampling from the environment to acquire available frontier points and timely incorporating them into subsequent planning to reduce fragmented regions are critical to improve the efficiency of autonomous exploration. We propose HPHS,…

Robotics · Computer Science 2024-07-22 Shijun Long , Ying Li , Chenming Wu , Bin Xu , Wei Fan

Component-wise MCMC algorithms, including Gibbs and conditional Metropolis-Hastings samplers, are commonly used for sampling from multivariate probability distributions. A long-standing question regarding Gibbs algorithms is whether a…

Statistics Theory · Mathematics 2021-05-11 Qian Qin , Galin L. Jones

We present a performant, general-purpose gradient-guided nested sampling algorithm, ${\tt GGNS}$, combining the state of the art in differentiable programming, Hamiltonian slice sampling, clustering, mode separation, dynamic nested…

Machine Learning · Computer Science 2023-12-08 Pablo Lemos , Nikolay Malkin , Will Handley , Yoshua Bengio , Yashar Hezaveh , Laurence Perreault-Levasseur

Discrete distributions, particularly in high-dimensional deep models, are often highly multimodal due to inherent discontinuities. While gradient-based discrete sampling has proven effective, it is susceptible to becoming trapped in local…

Machine Learning · Computer Science 2024-10-28 Patrick Pynadath , Riddhiman Bhattacharya , Arun Hariharan , Ruqi Zhang

Gradient-based Markov Chain Monte Carlo methods have recently received much attention for sampling discrete distributions, with interesting connections to their continuous counterparts. For examples, there are two discrete analogues to the…

Methodology · Statistics 2025-07-15 Yuze Zhou , Zhiqiang Tan

Learning the joint dependence of discrete variables is a fundamental problem in machine learning, with many applications including prediction, clustering and dimensionality reduction. More recently, the framework of copula modeling has…

Machine Learning · Statistics 2013-11-15 Alfredo Kalaitzis , Ricardo Silva

We study general coordinate-wise MCMC schemes (such as Metropolis-within-Gibbs samplers), which are commonly used to fit Bayesian non-conjugate hierarchical models. We relate their convergence properties to the ones of the corresponding…

Computation · Statistics 2026-01-12 Filippo Ascolani , Gareth O. Roberts , Giacomo Zanella

Deterministic dynamics is an essential part of many MCMC algorithms, e.g. Hybrid Monte Carlo or samplers utilizing normalizing flows. This paper presents a general construction of deterministic measure-preserving dynamics using autonomous…

Computation · Statistics 2021-06-21 Kirill Neklyudov , Roberto Bondesan , Max Welling

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Analyses of collider data, often assisted by modern Machine Learning methods, condense a number of observables into a few powerful discriminants for the separation of the targeted signal process from the contributing backgrounds. These…

High Energy Physics - Phenomenology · Physics 2020-08-26 Philipp Windischhofer , Miha Zgubic , Daniela Bortoletto

We propose a general framework for a hybrid continuous-discrete algorithm that integrates continuous-time deterministic dynamics with Metropolis-Hastings steps to combine search dynamics with and without detailed balance. Our purpose is to…

Statistical Mechanics · Physics 2024-10-31 Timothée Leleu , Samuel Reifenstein

We propose a hybrid generative model for efficient sampling of high-dimensional, multimodal probability distributions for Bayesian inference. Traditional Monte Carlo methods, such as the Metropolis-Hastings and Langevin Monte Carlo sampling…

Machine Learning · Statistics 2025-05-14 Hoang Tran , Zezhong Zhang , Feng Bao , Dan Lu , Guannan Zhang