English
Related papers

Related papers: Algorithm for direct sampling from conditional dis…

200 papers

Hyperbolic models are known to produce networks with properties observed empirically in most network datasets, including heavy-tailed degree distribution, high clustering, and hierarchical structures. As a result, several embeddings…

Computation · Statistics 2025-05-16 Simon Lizotte , Jean-Gabriel Young , Antoine Allard

In this manuscript, inspired by a simpler reformulation of primary sample space Metropolis light transport, we derive a novel family of general Markov chain Monte Carlo algorithms called charted Metropolis-Hastings, that introduces the…

Graphics · Computer Science 2017-05-01 Jacopo Pantaleoni

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

Machine Learning · Computer Science 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

We study the efficiency of Thompson sampling for contextual bandits. Existing Thompson sampling-based algorithms need to construct a Laplace approximation (i.e., a Gaussian distribution) of the posterior distribution, which is inefficient…

Machine Learning · Computer Science 2022-06-23 Pan Xu , Hongkai Zheng , Eric Mazumdar , Kamyar Azizzadenesheli , Anima Anandkumar

Counting and uniform sampling of directed acyclic graphs (DAGs) from a Markov equivalence class are fundamental tasks in graphical causal analysis. In this paper, we show that these tasks can be performed in polynomial time, solving a…

Machine Learning · Computer Science 2020-12-18 Marcel Wienöbst , Max Bannach , Maciej Liśkiewicz

A Markov network characterizes the conditional independence structure, or Markov property, among a set of random variables. Existing work focuses on specific families of distributions (e.g., exponential families) and/or certain structures…

Machine Learning · Computer Science 2023-05-22 Yujia Zheng , Ignavier Ng , Yewen Fan , Kun Zhang

The $k$-core decomposition is a widely studied summary statistic that describes a graph's global connectivity structure. In this paper, we move beyond using $k$-core decomposition as a tool to summarize a graph and propose using $k$-core…

Statistics Theory · Mathematics 2016-11-29 Vishesh Karwa , Michael J. Pelsmajer , Sonja Petrović , Despina Stasi , Dane Wilburne

In this work, we establish a direct connection between generative diffusion models (DMs) and stochastic quantization (SQ). The DM is realized by approximating the reversal of a stochastic process dictated by the Langevin equation,…

High Energy Physics - Lattice · Physics 2024-05-10 Lingxiao Wang , Gert Aarts , Kai Zhou

Autoregressive models enable tractable sampling from learned probability distributions, but their performance critically depends on the variable ordering used in the factorization via complexities of the resulting conditional distributions.…

Machine Learning · Statistics 2026-03-04 Shiba Biswal , Marc Vuffray , Andrey Y. Lokhov

Training energy-based probabilistic models is confronted with apparently intractable sums, whose Monte Carlo estimation requires sampling from the estimated probability distribution in the inner loop of training. This can be approximately…

Machine Learning · Computer Science 2016-06-13 Taesup Kim , Yoshua Bengio

We describe approximation algorithms in Linial's classic LOCAL model of distributed computing to find maximum-weight matchings in a hypergraph of rank $r$. Our main result is a deterministic algorithm to generate a matching which is an…

Data Structures and Algorithms · Computer Science 2023-10-13 David G. Harris

This paper considers the problem of randomized influence maximization over a Markovian graph process: given a fixed set of nodes whose connectivity graph is evolving as a Markov chain, estimate the probability distribution (over this fixed…

Social and Information Networks · Computer Science 2017-11-10 Buddhika Nettasinghe , Vikram Krishnamurthy

A fundamental theory is presented for the mechanical response of polymer networks undergoing large deformation which seamlessly integrates statistical mechanical principles with macroscopic thermodynamic constitutive theory. Our formulation…

Soft Condensed Matter · Physics 2020-07-06 Michael R. Buche , Meredith N. Silberstein

For a spatial characteristic, there exist commonly fat-tail frequency distributions of fragment-size and -mass of glass, areas enclosed by city roads, and pore size/volume in random packings. In order to give a new analytical approach for…

Statistical Mechanics · Physics 2015-06-12 Yukio Hayashi , Takayuki Komaki , Yusuke Ide , Takuya Machida , Norio Konno

We present a simple, general technique for reducing the sample complexity of matrix and tensor decomposition algorithms applied to distributions. We use the technique to give a polynomial-time algorithm for standard ICA with sample…

Data Structures and Algorithms · Computer Science 2015-06-22 Santosh S. Vempala , Ying Xiao

Hamiltonian Monte Carlo (HMC) is an efficient and effective means of sampling posterior distributions on Euclidean space, which has been extended to manifolds with boundary. However, some applications require an extension to more general…

Populations and Evolution · Quantitative Biology 2017-06-26 Vu Dinh , Arman Bilge , Cheng Zhang , Frederick A. Matsen

Optimal control synthesis in stochastic systems with respect to quantitative temporal logic constraints can be formulated as linear programming problems. However, centralized synthesis algorithms do not scale to many practical systems. To…

Systems and Control · Computer Science 2015-03-26 Jie Fu , Shuo Han , Ufuk Topcu

We propose a directed acyclic hypergraph framework for a probabilistic graphical model that we call Bayesian hypergraphs. The space of directed acyclic hypergraphs is much larger than the space of chain graphs. Hence Bayesian hypergraphs…

Data Structures and Algorithms · Computer Science 2018-11-22 Mohammad Ali Javidian , Linyuan Lu , Marco Valtorta , Zhiyu Wang

We present a new framework to derandomise certain Markov chain Monte Carlo (MCMC) algorithms. As in MCMC, we first reduce counting problems to sampling from a sequence of marginal distributions. For the latter task, we introduce a method…

Data Structures and Algorithms · Computer Science 2023-04-05 Weiming Feng , Heng Guo , Chunyang Wang , Jiaheng Wang , Yitong Yin

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the Markov chain induced…

Computation · Statistics 2024-06-24 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson