English
Related papers

Related papers: Curved Markov Chain Monte Carlo for Network Learni…

200 papers

This paper develops a deep learning method for linear and nonlinear filtering. The idea is to start with a nominal dynamic model and generate Monte Carlo sample paths. Then these samples are used to train a deep neutral network. A least…

Optimization and Control · Mathematics 2020-08-11 Qing Zhang , George Yin , Leyi Wang

Efficient sampling of complex high-dimensional probability distributions is a central task in computational science. Machine learning methods like autoregressive neural networks, used with Markov chain Monte Carlo sampling, provide good…

Statistical Mechanics · Physics 2021-11-11 Dian Wu , Riccardo Rossi , Giuseppe Carleo

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

Recent advances in machine learning have led to the development of new methods for enhancing Monte Carlo methods such as Markov chain Monte Carlo (MCMC) and importance sampling (IS). One such method is normalizing flows, which use a neural…

Computation · Statistics 2024-01-12 Charly Andral

We present a Markov chain Monte Carlo scheme based on merges and splits of groups that is capable of efficiently sampling from the posterior distribution of network partitions, defined according to the stochastic block model (SBM). We…

Physics and Society · Physics 2020-07-14 Tiago P. Peixoto

We investigate the problem of learning the structure of a Markov network from data. It is shown that the structure of such networks can be described in terms of constraints which enables the use of existing solver technology with…

Artificial Intelligence · Computer Science 2013-10-04 Jukka Corander , Tomi Janhunen , Jussi Rintanen , Henrik Nyman , Johan Pensar

This paper proposes a novel learning method for a mixture of recurrent neural network (RNN) experts model, which can acquire the ability to generate desired sequences by dynamically switching between experts. Our method is based on maximum…

Adaptation and Self-Organizing Systems · Physics 2008-06-17 Jun Namikawa , Jun Tani

We demonstrate that a number of sociology models for social network dynamics can be viewed as continuous time Bayesian networks (CTBNs). A sampling-based approximate inference method for CTBNs can be used as the basis of an…

Social and Information Networks · Computer Science 2012-05-14 Yu Fan , Christian R. Shelton

Closed-form stochastic filtering equations can be derived in a general setting where probability distributions are replaced by some specific outer measures. In this article, we study how the principles of the sequential Monte Carlo method…

Methodology · Statistics 2018-05-07 Jeremie Houssineau , Branko Ristic

This study proposes a trainable sampling-based solver for combinatorial optimization problems (COPs) using a deep-learning technique called deep unfolding. The proposed solver is based on the Ohzeki method that combines Markov-chain…

Disordered Systems and Neural Networks · Physics 2024-05-03 Ryo Hagiwara , Satoshi Takabe

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…

Methodology · Statistics 2018-05-16 Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

Uncertainty quantification for full-waveform inversion provides a probabilistic characterization of the ill-conditioning of the problem, comprising the sensitivity of the solution with respect to the starting model and data noise. This…

Geophysics · Physics 2020-04-20 Gabrio Rizzuti , Ali Siahkoohi , Philipp A. Witte , Felix J. Herrmann

This paper introduces a class of Monte Carlo algorithms which are based upon the simulation of a Markov process whose quasi-stationary distribution coincides with a distribution of interest. This differs fundamentally from, say, current…

Methodology · Statistics 2020-04-14 Murray Pollock , Paul Fearnhead , Adam M. Johansen , Gareth O. Roberts

Bayesian Neural Networks (BNNs) provide a promising framework for modeling predictive uncertainty and enhancing out-of-distribution robustness (OOD) by estimating the posterior distribution of network parameters. Stochastic Gradient Markov…

Machine Learning · Computer Science 2025-03-04 Hyunsu Kim , Giung Nam , Chulhee Yun , Hongseok Yang , Juho Lee

Uniform sampling from graphical realizations of a given degree sequence is a fundamental component in simulation-based measurements of network observables, with applications ranging from epidemics, through social networks to Internet…

Physics and Society · Physics 2010-04-14 Charo I. Del Genio , Hyunju Kim , Zoltan Toroczkai , Kevin E. Bassler

Graph neural network (GNN) has been demonstrated powerful in modeling graph-structured data. However, despite many successful cases of applying GNNs to various graph classification and prediction tasks, whether the graph geometrical…

Machine Learning · Computer Science 2023-07-20 Dai Shi , Yi Guo , Zhiqi Shao , Junbin Gao

Posterior sampling is a task of central importance in Bayesian inference. For many applications in Bayesian meta-analysis and Bayesian transfer learning, the prior distribution is unknown and needs to be estimated from samples. In practice,…

Computation · Statistics 2024-08-06 Chenyang Zhong , Shouxuan Ji , Tian Zheng

Randomising networks using a naive `accept-all' edge-swap algorithm is generally biased. Building on recent results for nondirected graphs, we construct an ergodic detailed balance Markov chain with non-trivial acceptance probabilities for…

Quantitative Methods · Quantitative Biology 2011-12-21 E. S. Roberts , A. C. C. Coolen

We consider quantile estimation using Markov chain Monte Carlo and establish conditions under which the sampling distribution of the Monte Carlo error is approximately Normal. Further, we investigate techniques to estimate the associated…

Statistics Theory · Mathematics 2018-04-20 Charles Doss , James M. Flegal , Galin L. Jones , Ronald C. Neath

A new Monte Carlo algorithm for phase-space sampling, named (MC)**3, is presented. It is based on Markov Chain Monte Carlo techniques but at the same time incorporates prior knowledge about the target distribution in the form of suitable…

High Energy Physics - Phenomenology · Physics 2015-06-12 Kevin Kroeninger , Steffen Schumann , Benjamin Willenberg