English
Related papers

Related papers: Efficient Sampling from Time-Varying Log-Concave D…

200 papers

We pose a new and intriguing question motivated by distributed computing regarding random walks on graphs: How long does it take for several independent random walks, starting from the same vertex, to cover an entire graph? We study the…

Probability · Mathematics 2007-11-20 Noga Alon , Chen Avin , Michal Koucky , Gady Kozma , Zvi Lotker , Mark R. Tuttle

The Hamiltonian Monte Carlo (HMC) sampling algorithm exploits Hamiltonian dynamics to construct efficient Markov Chain Monte Carlo (MCMC), which has become increasingly popular in machine learning and statistics. Since HMC uses the gradient…

Machine Learning · Computer Science 2019-06-04 Minghao Gu , Shiliang Sun

Random walks are a fundamental primitive used in many machine learning algorithms with several applications in clustering and semi-supervised learning. Despite their relevance, the first efficient parallel algorithm to compute random walks…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-02 Michael Kapralov , Silvio Lattanzi , Navid Nouri , Jakab Tardos

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

This paper develops an algorithmic framework for tracking fixed points of time-varying contraction mappings. Analytical results for the tracking error are established for the cases where: (i) the underlying contraction self-map changes at…

Optimization and Control · Mathematics 2018-09-14 Andrey Bernstein , Emiliano Dall'Anese

Random walks constitute a fundamental mechanism for many dynamics taking place on complex networks. Besides, as a more realistic description of our society, multiplex networks have been receiving a growing interest, as well as the dynamical…

Physics and Society · Physics 2016-05-25 Quantong Guo , Emanuele Cozzo , Zhiming Zheng , Yamir Moreno

Representations based on random walks can exploit discrete data distributions for clustering and classification. We extend such representations from discrete to continuous distributions. Transition probabilities are now calculated using a…

Machine Learning · Computer Science 2012-12-12 Chen-Hsiang Yeang , Martin Szummer

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

Methodology · Statistics 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

We consider an exactly solvable model of branching random walk with random selection, which describes the evolution of a population with $N$ individuals on the real line. At each time step, every individual reproduces independently, and its…

Probability · Mathematics 2018-10-09 Aser Cortines , Bastien Mallein

Sampling algorithms play an important role in controlling the quality and runtime of diffusion model inference. In recent years, a number of works~\cite{chen2023sampling,chen2023ode,benton2023error,lee2022convergence} have proposed schemes…

Machine Learning · Computer Science 2024-10-18 Shivam Gupta , Linda Cai , Sitan Chen

We derive an exact closed-form analytical expression for the distribution of the cover time for a random walk over an arbitrary graph. In special case, we derive simplified exact expressions for the distributions of cover time for a…

Mathematical Physics · Physics 2009-10-20 Nikola Zlatanov , Ljupco Kocarev

Sampling random nodes is a fundamental algorithmic primitive in the analysis of massive networks, with many modern graph mining algorithms critically relying on it. We consider the task of generating a large collection of random nodes in…

Social and Information Networks · Computer Science 2021-10-27 Omri Ben-Eliezer , Talya Eden , Joel Oren , Dimitris Fotakis

Although many successful ensemble clustering approaches have been developed in recent years, there are still two limitations to most of the existing approaches. First, they mostly overlook the issue of uncertain links, which may mislead the…

Machine Learning · Statistics 2016-06-06 Dong Huang , Jian-Huang Lai , Chang-Dong Wang

The shrinking rank method is a variation of slice sampling that is efficient at sampling from multivariate distributions with highly correlated parameters. It requires that the gradient of the log-density be computable. At each individual…

Computation · Statistics 2010-11-23 Madeleine B. Thompson , Radford M. Neal

We study the problem of approximately simulating a $t$-step random walk on a graph where the input edges come from a single-pass stream. The straightforward algorithm using reservoir sampling needs $O(nt)$ words of memory. We show that this…

Data Structures and Algorithms · Computer Science 2020-01-03 Ce Jin

We propose new Markov chain Monte Carlo algorithms to sample a uniform distribution on a convex body $K$. Our algorithms are based on the proximal sampler, which uses Gibbs sampling on an augmented distribution and assumes access to the…

Data Structures and Algorithms · Computer Science 2026-02-17 Thanh Dang , Jiaming Liang

Min et al. (2009) presented two complementary techniques that use the diffusion approximation to allow efficient Monte-Carlo radiation transfer in very optically thick regions: a modified random walk and a partial diffusion approximation.…

Instrumentation and Methods for Astrophysics · Physics 2015-05-20 Thomas P. Robitaille

Sampling a network with a given probability distribution has been identified as a useful operation. In this paper we propose distributed algorithms for sampling networks, so that nodes are selected by a special node, called the…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-28 Andrés Sevilla , Alberto Mozo , Antonio Fernández Anta

We study a sequential Monte Carlo algorithm to sample from the Gibbs measure with a non-convex energy function at a low temperature. We use the practical and popular geometric annealing schedule, and use a Langevin diffusion at each…

Statistics Theory · Mathematics 2026-01-13 Ruiyu Han , Gautam Iyer , Dejan Slepčev

Hit-and-Run is known to be one of the best random sampling algorithms, its mixing time is polynomial in dimension. Nevertheless, in practice the number of steps required to achieve uniformly distributed samples is rather high. We propose…

Optimization and Control · Mathematics 2014-02-13 Elena Gryazina , Boris Polyak