English
Related papers

Related papers: Communication-Free Parallel Supervised Topic Model…

200 papers

We present a new framework to derandomise certain Markov chain Monte Carlo (MCMC) algorithms. As in MCMC, we first reduce counting problems to sampling from a sequence of marginal distributions. For the latter task, we introduce a method…

Data Structures and Algorithms · Computer Science 2023-04-05 Weiming Feng , Heng Guo , Chunyang Wang , Jiaheng Wang , Yitong Yin

Bayesian learning in undirected graphical models|computing posterior distributions over parameters and predictive quantities is exceptionally difficult. We conjecture that for general undirected models, there are no tractable MCMC (Markov…

Machine Learning · Computer Science 2012-07-19 Iain Murray , Zoubin Ghahramani

Source-Free Domain Adaptation (SFDA) tackles the problem of adapting a pre-trained source model to an unlabeled target domain without accessing any source data, which is quite suitable for the field of data security. Although recent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Shanshan Wang , Ziying Feng , Xiaozheng Shen , Xun Yang , Pichao Wang , Zhenwei He , Xingyi Zhang

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

SMC (Sequential Monte Carlo) is a class of Monte Carlo algorithms for filtering and related sequential problems. Gerber and Chopin (2015) introduced SQMC (Sequential quasi-Monte Carlo), a QMC version of SMC. This paper has two objectives:…

Computation · Statistics 2017-06-19 Nicolas Chopin , Mathieu Gerber

A number of problems in a variety of fields are characterised by target distributions with a multimodal structure in which the presence of several isolated local maxima dramatically reduces the efficiency of Markov Chain Monte Carlo…

Methodology · Statistics 2009-07-31 Miquel Trias , Alberto Vecchio , John Veitch

High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and…

Quantum Physics · Physics 2026-04-08 Abigail N. Poteshman , Jiwon Yun , Tim H. Taminiau , Giulia Galli

We consider the massively parallel computation (MPC) model, which is a theoretical abstraction of large-scale parallel processing models such as MapReduce. In this model, assuming the widely believed 1-vs-2-cycles conjecture, solving many…

Data Structures and Algorithms · Computer Science 2023-10-31 Yi-Jun Chang , Da Wei Zheng

The Massively Parallel Computation (MPC) model serves as a common abstraction of many modern large-scale parallel computation frameworks and has recently gained a lot of importance, especially in the context of classic graph problems.…

Data Structures and Algorithms · Computer Science 2018-07-20 Sebastian Brandt , Manuela Fischer , Jara Uitto

This paper studies the problem of parameter learning in probabilistic graphical models having latent variables, where the standard approach is the expectation maximization algorithm alternating expectation (E) and maximization (M) steps.…

Machine Learning · Computer Science 2017-02-15 Hyeryung Jang , Hyungwon Choi , Yung Yi , Jinwoo Shin

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

Semi-supervised learning addresses label scarcity and high annotation costs in medical image segmentation by exploiting the latent information in unlabeled data to enhance model performance. Traditional discriminative segmentation relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Kaiwen Huang , Yi Zhou , Yizhe Zhang , Jingxiong Li , Tao Zhou

Stochastic gradient Markov chain Monte Carlo (MCMC) algorithms have received much attention in Bayesian computing for big data problems, but they are only applicable to a small class of problems for which the parameter space has a fixed…

Computation · Statistics 2020-02-10 Qifan Song , Yan Sun , Mao Ye , Faming Liang

The Hamiltonian Monte Carlo (HMC) sampling algorithm exploits Hamiltonian dynamics to construct efficient Markov Chain Monte Carlo (MCMC), which has become increasingly popular in machine learning and statistics. Since HMC uses the gradient…

Machine Learning · Computer Science 2019-06-04 Minghao Gu , Shiliang Sun

Multi-source domain adaptation (MSDA) plays an important role in industrial model generalization. Recent efforts on MSDA focus on enhancing multi-domain distributional alignment while omitting three issues, e.g., the class-level discrepancy…

Machine Learning · Computer Science 2024-12-24 Min Huang , Zifeng Xie , Bo Sun , Ning Wang

We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin…

Numerical Analysis · Mathematics 2019-08-13 Michael B. Giles , Mateusz B. Majka , Lukasz Szpruch , Sebastian Vollmer , Konstantinos Zygalakis

We present in this paper a hybrid, Multi-Level Monte Carlo (MLMC) method for solving the neutral particle transport equation. MLMC methods, originally developed to solve parametric integration problems, work by using a cheap, low fidelity…

Numerical Analysis · Mathematics 2025-08-06 Vincent N. Novellino , Dmitriy Y. Anistratov

In many computational problems, using the Markov Chain Monte Carlo (MCMC) can be prohibitively time-consuming. We propose MCMC-Net, a simple yet efficient way to accelerate MCMC via neural networks. The key idea of our approach is to…

Numerical Analysis · Mathematics 2025-09-16 Sudeb Majee , Anuj Abhishek , Thilo Strauss , Taufiquar Khan

Cyclical MCMC is a novel MCMC framework recently proposed by Zhang et al. (2019) to address the challenge posed by high-dimensional multimodal posterior distributions like those arising in deep learning. The algorithm works by generating a…

Computation · Statistics 2024-03-04 Liwei Wang , Xinru Liu , Aaron Smith , Yves Atchade

In the stochastic gradient descent (SGD) for sequential simulations such as the neural stochastic differential equations, the Multilevel Monte Carlo (MLMC) method is known to offer better theoretical computational complexity compared to the…

Machine Learning · Computer Science 2023-10-11 Kei Ishikawa