English
Related papers

Related papers: The Penalty Method for Random Walks with Uncertain…

200 papers

I show how one can modify the random-walk Metropolis MCMC method in such a way that a sequence of modified Metropolis updates takes little computation time when the rejection rate is outside a desired interval. This allows one to…

Statistics Theory · Mathematics 2007-06-13 Radford M. Neal

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

The stability and ergodicity properties of two adaptive random walk Metropolis algorithms are considered. The both algorithms adjust the scaling of the proposal distribution continuously based on the observed acceptance probability. Unlike…

Probability · Mathematics 2011-11-21 Matti Vihola

We prove a general result that if a Metropolis--Hastings algorithm has a proposal that is not geometrically ergodic and the acceptance rate approaches unity at a suitable rate as the state variable becomes large, then the Metropolised chain…

Computation · Statistics 2026-03-10 Yuxin Liu , Peiyi Zhou , Samuel Livingstone

We examine challenges to sampling from Boltzmann distributions associated with multiscale energy landscapes. The multiscale features, or "roughness," corresponds to highly oscillatory, but bounded, perturbations of a smooth landscape.…

Numerical Analysis · Mathematics 2020-07-02 Petr Plecháč , Gideon Simpson

Random Walk is a basic algorithm to explore the structure of networks, which can be used in many tasks, such as local community detection and network embedding. Existing random walk methods are based on single networks that contain limited…

Social and Information Networks · Computer Science 2023-07-06 Dongsheng Luo , Yuchen Bian , Yaowei Yan , Xiong Yu , Jun Huan , Xiao Liu , Xiang Zhang

We propose a model of random walks on weighted graphs where the weights are interval valued, and connect it to reversible imprecise Markov chains. While the theory of imprecise Markov chains is now well established, this is a first attempt…

Optimization and Control · Mathematics 2016-09-20 Damjan Škulj

We consider the random walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. In the limit $n\to\infty$, it is well known (see [Ann.…

Probability · Mathematics 2016-08-14 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

Applied to statistical physics models, the random cost algorithm enforces a Random Walk (RW) in energy (or possibly other thermodynamic quantities). The dynamics of this procedure is distinct from fixed weight updates. The probability for a…

Statistical Mechanics · Physics 2009-10-31 Bernd A. Berg , Ulrich H. E. Hansmann

It is a common phenomenon in nature and technology that a system under perturbations exits a regime of its usual dynamics. Often it is possible to define a potential function whereby a potential well can be associated with a usual or…

Statistical Mechanics · Physics 2018-08-22 Tamás Bódai

In high-dimensional model selection problems, penalized simple least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a…

Methodology · Statistics 2011-07-06 Jelena Bradic , Jianqing Fan , Weiwei Wang

We introduce a general framework that constructs estimators with reduced variance for random walk Metropolis and Metropolis-adjusted Langevin algorithms. The resulting estimators require negligible computational cost and are derived in a…

Methodology · Statistics 2022-03-07 Angelos Alexopoulos , Petros Dellaportas , Michalis K. Titsias

Penalized methods are applied to quasi likelihood analysis for stochastic differential equation models. In this paper, we treat the quasi likelihood function and the associated statistical random field for which a polynomial type large…

Statistics Theory · Mathematics 2019-10-30 Yoshiki Kinoshita , Nakahiro Yoshida

We consider the approximation of the performance of random walks in the quarter-plane. The approximation is in terms of a random walk with a product-form stationary distribution, which is obtained by perturbing the transition probabilities…

Probability · Mathematics 2014-09-15 Jasper Goseling , Richard J. Boucherie , Jan-Kees van Ommeren

We present a new Monte Carlo algorithm that produces results of high accuracy with reduced simulational effort. Independent random walks are performed (concurrently or serially) in different, restricted ranges of energy, and the resultant…

Statistical Mechanics · Physics 2009-10-31 Fugao Wang , D. P. Landau

A new method is proposed for variable screening, variable selection and prediction in linear regression problems where the number of predictors can be much larger than the number of observations. The method involves minimizing a penalized…

Statistics Theory · Mathematics 2017-09-14 D. Vasiliu , T. Dey , I. L. Dryden

Quantifying the contributions, or weights, of comparisons or single studies to the estimates in a network meta-analysis (NMA) is an active area of research. We extend this to the contributions of paths to NMA estimates. We present a general…

A continuous-time random walk in the quarter plane with homogeneous transition rates is considered. Given a non-negative reward function on the state space, we are interested in the expected stationary performance. Since a direct derivation…

Probability · Mathematics 2017-08-31 Xinwei Bai , Jasper Goseling

Adaptive sampling theory has shown that, with proper assumptions on the signal class, algorithms exist to reconstruct a signal in $\mathbb{R}^{d}$ with an optimal number of samples. We generalize this problem to the case of spatial signals,…

Machine Learning · Statistics 2017-02-20 John Lipor , Brandon Wong , Donald Scavia , Branko Kerkez , Laura Balzano

We propose a globally convergent Gauss-Newton algorithm for finding a local optimal solution of a non-convex and possibly non-smooth optimization problem. The algorithm that we present is based on a Gauss-Newton-type iteration for the…

Optimization and Control · Mathematics 2020-12-08 Ilyes Mezghani , Quoc Tran-Dinh , Ion Necoara , Anthony Papavasiliou