English
Related papers

Related papers: Efficient Sampling from Time-Varying Log-Concave D…

200 papers

Elliptical slice sampling, when adapted to linearly truncated multivariate normal distributions, is a rejection-free Markov chain Monte Carlo method. At its core, it requires analytically constructing an ellipse-polytope intersection. The…

Machine Learning · Computer Science 2024-07-16 Kaiwen Wu , Jacob R. Gardner

Temporal-Difference (TD) learning with nonlinear smooth function approximation for policy evaluation has achieved great success in modern reinforcement learning. It is shown that such a problem can be reformulated as a stochastic…

Machine Learning · Computer Science 2020-08-25 Shuang Qiu , Zhuoran Yang , Xiaohan Wei , Jieping Ye , Zhaoran Wang

Random walks on networks are widely used to model stochastic processes such as search strategies, transportation problems or disease propagation. A prominent example of such process is the guiding of naive T cells by the lymph node conduits…

Social and Information Networks · Computer Science 2022-10-21 Solène Song , Malek Senoussi , Paul Escande , Paul Villoutreix

We propose a method for zeroth order stochastic convex optimization that attains the suboptimality rate of $\tilde{\mathcal{O}}(n^{7}T^{-1/2})$ after $T$ queries for a convex bounded function $f:{\mathbb R}^n\to{\mathbb R}$. The method is…

Machine Learning · Computer Science 2014-02-13 Tengyuan Liang , Hariharan Narayanan , Alexander Rakhlin

We introduce a theoretical framework for sampling from unnormalized densities based on a smoothing scheme that uses an isotropic Gaussian kernel with a single fixed noise scale. We prove one can decompose sampling from a density (minimal…

Machine Learning · Statistics 2023-10-02 Saeed Saremi , Ji Won Park , Francis Bach

Graphs in many applications, such as social networks and IoT, are inherently streaming, involving continuous additions and deletions of vertices and edges at high rates. Constructing random walks in a graph, i.e., sequences of vertices…

Databases · Computer Science 2022-09-14 Serafeim Papadias , Zoi Kaoudi , Jorge-Arnulfo Quiane-Ruiz , Volker Markl

Langevin diffusion processes and their discretizations are often used for sampling from a target density. The most convenient framework for assessing the quality of such a sampling scheme corresponds to smooth and strongly log-concave…

Probability · Mathematics 2018-12-27 Arnak S. Dalalyan , Lionel Riou-Durand

We give algorithms for sampling several structured logconcave families to high accuracy. We further develop a reduction framework, inspired by proximal point methods in convex optimization, which bootstraps samplers for regularized…

Data Structures and Algorithms · Computer Science 2021-10-25 Yin Tat Lee , Ruoqi Shen , Kevin Tian

In network embedding, random walks play a fundamental role in preserving network structures. However, random walk based embedding methods have two limitations. First, random walk methods are fragile when the sampling frequency or the number…

Machine Learning · Computer Science 2018-05-14 Yong Shi , Minglong Lei , Peng Zhang , Lingfeng Niu

We propose the Hit-and-Run algorithm for planning and sampling problems in non-convex spaces. For sampling, we show the first analysis of the Hit-and-Run algorithm in non-convex spaces and show that it mixes fast as long as certain…

Computation · Statistics 2016-10-28 Yasin Abbasi-Yadkori , Peter L. Bartlett , Victor Gabillon , Alan Malek

We consider the problem of sampling from a target distribution, which is \emph {not necessarily logconcave}, in the context of empirical risk minimization and stochastic optimization as presented in Raginsky et al. (2017). Non-asymptotic…

Statistics Theory · Mathematics 2021-02-03 Ngoc Huy Chau , Éric Moulines , Miklos Rásonyi , Sotirios Sabanis , Ying Zhang

In video prediction tasks, one major challenge is to capture the multi-modal nature of future contents and dynamics. In this work, we propose a simple yet effective framework that can efficiently predict plausible future states. The key…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Jingwei Xu , Huazhe Xu , Bingbing Ni , Xiaokang Yang , Trevor Darrell

The world is not static: This causes real-world time series to change over time through external, and potentially disruptive, events such as macroeconomic cycles or the COVID-19 pandemic. We present an adaptive sampling strategy that…

We consider the problem of sampling from a log-concave distribution $\pi(\theta) \propto e^{-f(\theta)}$ constrained to a polytope $K:=\{\theta \in \mathbb{R}^d: A\theta \leq b\}$, where $A\in \mathbb{R}^{m\times d}$ and $b \in…

Data Structures and Algorithms · Computer Science 2024-09-09 Oren Mangoubi , Nisheeth K. Vishnoi

Many online social networks feature restrictive web interfaces which only allow the query of a user's local neighborhood through the interface. To enable analytics over such an online social network through its restrictive web interface,…

Social and Information Networks · Computer Science 2012-11-26 Zhuojie Zhou , Nan Zhang , Zhiguo Gong , Gautam Das

Researchers have designed many algorithms to measure the distances between graph nodes, such as average hitting times of random walks, cosine distances from DeepWalk, personalized PageRank, etc. Successful although these algorithms are,…

Discrete Mathematics · Computer Science 2020-12-02 Enzhi Li , Zhengyi Le

Multiscale phenomena that evolve on multiple distinct timescales are prevalent throughout the sciences. It is often the case that the governing equations of the persistent and approximately periodic fast scales are prescribed, while the…

Chaotic Dynamics · Physics 2020-08-19 Jason J. Bramburger , Daniel Dylewsky , J. Nathan Kutz

Recently non-reversible samplers based on simulating piecewise deterministic Markov processes (PDMPs) have shown potential for efficient sampling in Bayesian inference problems. However, there remains a lack of guidance on how to best…

Methodology · Statistics 2021-12-28 Matthew Sutton , Paul Fearnhead

We propose a flat-histogram Monte Carlo method to efficiently sample fractal landscapes such as escape time functions of open chaotic systems. This is achieved by using a random-walk step which depends on the height of the landscape via the…

Statistical Mechanics · Physics 2013-05-31 Jorge C. Leitão , João M. Viana Parente Lopes , Eduardo G. Altmann

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis