English
Related papers

Related papers: Normal approximation for functions of hidden Marko…

200 papers

The Gumbel trick is a method to sample from a discrete probability distribution, or to estimate its normalizing partition function. The method relies on repeatedly applying a random perturbation to the distribution in a particular way, each…

Machine Learning · Statistics 2017-06-14 Matej Balog , Nilesh Tripuraneni , Zoubin Ghahramani , Adrian Weller

Markov Chain Monte Carlo (MCMC) methods are a powerful tool for computation with complex probability distributions. However the performance of such methods is critically dependant on properly tuned parameters, most of which are difficult if…

Computation · Statistics 2021-10-27 James A. Brofos , Marylou Gabrié , Marcus A. Brubaker , Roy R. Lederman

Two popular approaches for relating correlated measurements of a non-Gaussian response variable to a set of predictors are to fit a marginal model using generalized estimating equations and to fit a generalized linear mixed model by…

Methodology · Statistics 2017-02-23 Jeffrey J. Gory , Peter F. Craigmile , Steven N. MacEachern

A regularized vector autoregressive hidden semi-Markov model is developed to analyze multivariate financial time series with switching data generating regimes. Furthermore, an augmented EM algorithm is proposed for parameter estimation by…

Applications · Statistics 2021-05-19 Zekun Xu , Ye Liu

Diffusion approximations are widely used in the analysis of service systems, providing tractable insights into complex models. While heavy-traffic limit theorems justify these approximations asymptotically, they do not quantify the error…

Probability · Mathematics 2025-03-18 Anton Braverman , Ziv Scully

We propose the Gaussian-Linear Hidden Markov model (GLHMM), a generalisation of different types of HMMs commonly used in neuroscience. In short, the GLHMM is a general framework where linear regression is used to flexibly parameterise the…

Neurons and Cognition · Quantitative Biology 2024-10-02 Diego Vidaurre , Laura Masaracchia , Nick Y. Larsen , Lenno R. P. T Ruijters , Sonsoles Alonso , Christine Ahrends , Mark W. Woolrich

A new probalistic approach to general relativistic kinetic theory is proposed. The general relativistic Boltzmann equation is linked to a new Markov process in a completely intrinsic way. This treatment is then used to prove the causal…

Mathematical Physics · Physics 2011-07-05 Ismael Bailleul , Frabrice Debbasch

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

We introduce a doubly stochastic proximal gradient algorithm for optimizing a finite average of smooth convex functions, whose gradients depend on numerically expensive expectations. Our main motivation is the acceleration of the…

Machine Learning · Statistics 2016-11-09 Massil Achab , Agathe Guilloux , Stéphane Gaïffas , Emmanuel Bacry

Stochastic gradient Markov chain Monte Carlo (SGMCMC) is a popular class of algorithms for scalable Bayesian inference. However, these algorithms include hyperparameters such as step size or batch size that influence the accuracy of…

Computation · Statistics 2021-11-19 Jeremie Coullon , Leah South , Christopher Nemeth

We present a distributed proximal-gradient method for optimizing the average of convex functions, each of which is the private local objective of an agent in a network with time-varying topology. The local objectives have distinct…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-09 Annie I. Chen , Asuman Ozdaglar

Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalisation constants requires summation over large or possibly infinite sets, which can be impractical. This paper…

Methodology · Statistics 2023-09-04 Takuo Matsubara , Jeremias Knoblauch , François-Xavier Briol , Chris. J. Oates

We establish Bernstein's inequalities for functions of general (general-state-space and possibly non-reversible) Markov chains. These inequalities achieve sharp variance proxies and encompass the classical Bernstein inequality for…

Statistics Theory · Mathematics 2025-04-18 Bai Jiang , Qiang Sun , Jianqing Fan

This paper derives normal approximation results for subgraph counts written as multiparameter stochastic integrals in a random-connection model based on a Poisson point process. By combinatorial arguments we express the cumulants of general…

Probability · Mathematics 2025-11-11 Qingwei Liu , Nicolas Privault

We investigate the resolution of second-order, potential, and monotone mean field games with the generalized conditional gradient algorithm, an extension of the Frank-Wolfe algorithm. We show that the method is equivalent to the fictitious…

Optimization and Control · Mathematics 2023-08-22 Pierre Lavigne , Laurent Pfeiffer

We present a computational and statistical approach for fitting isotonic models under convex differentiable loss functions. We offer a recursive partitioning algorithm which provably and efficiently solves isotonic regression under any such…

Methodology · Statistics 2012-10-09 Ronny Luss , Saharon Rosset

One of the most demanding calculations is to generate random samples from a specified probability distribution (usually with an unknown normalizing prefactor) in a high-dimensional configuration space. One often has to resort to using a…

Computational Physics · Physics 2015-06-18 Youhan Fang , Jesus-Maria Sanz-Serna , Robert D. Skeel

Methods of Pad\'e approximation are used to analyse a multivariate Markov transform which has been recently introduced by the authors, and which is generalizing the well-known in Spectral theory Stieltjes transform (Markov function) of…

Numerical Analysis · Mathematics 2011-12-07 Ognyan Kounchev , Hermann Render

The normalizing constant plays an important role in Bayesian computation, and there is a large literature on methods for computing or approximating normalizing constants that cannot be evaluated in closed form. When the normalizing constant…

Computation · Statistics 2020-09-02 Yuling Yao , Collin Cademartori , Aki Vehtari , Andrew Gelman

By the continuous mapping theorem, if a sequence of $d$-dimensional random vectors $(\mathbf{W}_n)_{n\geq1}$ converges in distribution to a multivariate normal random variable $\Sigma^{1/2}\mathbf{Z}$, then the sequence of random variables…

Probability · Mathematics 2020-03-18 Robert E. Gaunt