English
Related papers

Related papers: Statistically efficient thinning of a Markov chain…

200 papers

The approximate uniform sampling of graph realizations with a given degree sequence is an everyday task in several social science, computer science, engineering etc. projects. One approach is using Markov chains. The best available current…

Combinatorics · Mathematics 2024-01-09 Péter L. Erdős , Tamás Róbert Mezei , István Miklós

The AutoRegressive Conditional Heteroskedasticity (ARCH) and its generalized version (GARCH) family of models have grown to encompass a wide range of specifications, each of them is designed to enhance the ability of the model to capture…

Data Analysis, Statistics and Probability · Physics 2007-05-23 G. R. Jafari , A. Bahraminasab , P. Norouzzadeh

This paper studies a large number of homogeneous Markov decision processes where the transition probabilities and costs are coupled in the empirical distribution of states (also called mean-field). The state of each process is not known to…

Optimization and Control · Mathematics 2020-12-03 Jalal Arabneydi , Amir G. Aghdam

An important problem arising in the study of complex networks, for instance in community detection and motif finding, is the sampling of graphs with fixed degree sequence. The equivalent problem of generating random 0,1 matrices with fixed…

Combinatorics · Mathematics 2018-07-27 Annabell Berger , Corrie Jacobien Carstens

Markov chain Monte Carlo methods are often deemed too computationally intensive to be of any practical use for big data applications, and in particular for inference on datasets containing a large number $n$ of individual data points, also…

Methodology · Statistics 2015-05-13 Rémi Bardenet , Arnaud Doucet , Chris Holmes

Markov chain Monte Carlo (MCMC) algorithms for hidden Markov models often rely on the forward-backward sampler. This makes them computationally slow as the length of the time series increases, motivating the development of…

Machine Learning · Statistics 2024-07-26 Rihui Ou , Deborshee Sen , Alexander L Young , David B Dunson

Stochastic optimization methods such as mirror descent have wide applications due to low computational cost. Those methods have been well studied under assumption of the independent and identical distribution, and usually achieve sublinear…

Machine Learning · Computer Science 2023-09-27 Yawei Zhao

In this work, we developed an efficient approach to compute ensemble averages in systems with pairwise-additive energetic interactions between the entities. Methods involving full enumeration of the configuration space result in exponential…

Biomolecules · Quantitative Biology 2020-10-13 Arun V. Sathanur , Nathan A. Baker

Random Linear Network Coding (RLNC) has been proved to offer an efficient communication scheme, leveraging an interesting robustness against packet losses. However, it suffers from a high computational complexity and some novel approaches,…

Networking and Internet Architecture · Computer Science 2016-07-25 Garrido Pablo , Lucani E. Daniel , Aguero Ramon

Sampling from the conditional (or posterior) probability distribution of the latent states of a Hidden Markov Model, given the realization of the observed process, is a non-trivial problem in the context of Markov Chain Monte Carlo. To do…

Statistics Theory · Mathematics 2015-09-29 Sumeetpal S. Singh , Fredrik Lindsten , Eric Moulines

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

Sequence segmentation is a well-studied problem, where given a sequence of elements, an integer K, and some measure of homogeneity, the task is to split the sequence into K contiguous segments that are maximally homogeneous. A classic…

Data Structures and Algorithms · Computer Science 2019-02-12 Nikolaj Tatti

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

We consider the weakly supervised binary classification problem where the labels are randomly flipped with probability $1- {\alpha}$. Although there exist numerous algorithms for this problem, it remains theoretically unexplored how the…

Machine Learning · Computer Science 2019-07-16 Xinyang Yi , Zhaoran Wang , Zhuoran Yang , Constantine Caramanis , Han Liu

Traditional Markov chain Monte Carlo (MCMC) sampling of hidden Markov models (HMMs) involves latent states underlying an imperfect observation process, and generates posterior samples for top-level parameters concurrently with nuisance…

Computation · Statistics 2016-01-13 Daniel Turek , Perry de Valpine , Christopher J. Paciorek

A central limitation of multiple-acquisition magnetic resonance imaging (MRI) is the degradation in scan efficiency as the number of distinct datasets grows. Sparse recovery techniques can alleviate this limitation via randomly undersampled…

Image and Video Processing · Electrical Eng. & Systems 2017-10-03 L Kerem Senel , Toygan Kilic , Alper Gungor , Emre Kopanoglu , H Emre Guven , Emine U Saritas , Aykut Koc , Tolga Cukur

Scientific machine learning reports predictive performance. It does not report whether the same prediction would survive a different draw of training data. Across $9$ chemistry benchmarks, two classifiers trained on independent bootstraps…

Machine Learning · Computer Science 2026-05-14 Gordan Prastalo , Kevin Maik Jablonka

Many natural phenomena exhibit a stochastic nature that one attempts at modeling by using stochastic processes of different types. In this context, often one is interested in investigating the memory properties of the natural phenomenon at…

Computational Physics · Physics 2023-05-09 Salvatore Miccichè

Bayesian inference via standard Markov Chain Monte Carlo (MCMC) methods is too computationally intensive to handle large datasets, since the cost per step usually scales like $\Theta(n)$ in the number of data points $n$. We propose the…

Machine Learning · Statistics 2019-06-12 Robert Cornish , Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet