English
Related papers

Related papers: Mini-Batch Gradient-Based MCMC for Decentralized M…

200 papers

Statistical signal processing applications usually require the estimation of some parameters of interest given a set of observed data. These estimates are typically obtained either by solving a multi-variate optimization problem, as in the…

Computation · Statistics 2021-07-27 D. Luengo , L. Martino , M. Bugallo , V. Elvira , S. Särkkä

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms which are primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Single instances of MCMC methods are widely…

Computation · Statistics 2019-05-27 Alessandro Varsi , Lykourgos Kekempanos , Jeyarajan Thiyagalingam , Simon Maskell

Decentralized baseband processing (DBP) architecture, which partitions the base station antennas into multiple antenna clusters, has been recently proposed to alleviate the excessively high interconnect bandwidth, chip input/output data…

Signal Processing · Electrical Eng. & Systems 2021-05-25 Zhenyu Zhang , Yuanyuan Dong , Keping Long , Xiyuan Wang , Xiaoming Dai

We propose a generic Markov Chain Monte Carlo (MCMC) algorithm to speed up computations for datasets with many observations. A key feature of our approach is the use of the highly efficient difference estimator from the survey sampling…

Methodology · Statistics 2017-08-03 Matias Quiroz , Mattias Villani , Robert Kohn

Markov chain Monte Carlo (MCMC) sampling is an important and commonly used tool for the analysis of hierarchical models. Nevertheless, practitioners generally have two options for MCMC: utilize existing software that generates a black-box…

Recently, the decentralized baseband processing (DBP) paradigm and relevant detection methods have been proposed to enable extremely large-scale massive multiple-input multiple-output technology. Under the DBP architecture, base station…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Xiaotong Zhao , Mian Li , Bo Wang , Enbin Song , Tsung-Hui Chang , Qingjiang Shi

In this paper, we address technical difficulties that arise when applying Markov chain Monte Carlo (MCMC) to hierarchical models designed to perform clustering in the space of latent parameters of subject-wise generative models.…

Quantitative Methods · Quantitative Biology 2020-12-15 Yu Yao , Klaas E. Stephan

Recent developments in big data and analytics research have produced an abundance of large data sets that are too big to be analyzed in their entirety, due to limits on computer memory or storage capacity. To address these issues,…

Methodology · Statistics 2016-01-06 Alexey Miroshnikov , Erin M. Conlon

Decentralized stochastic gradient method emerges as a promising solution for solving large-scale machine learning problems. This paper studies the decentralized Markov chain gradient descent (DMGD) algorithm - a variant of the decentralized…

Optimization and Control · Mathematics 2021-04-14 Tao Sun , Dongsheng Li

Stochastic gradient Markov Chain Monte Carlo (SG-MCMC) has been developed as a flexible family of scalable Bayesian sampling algorithms. However, there has been little theoretical analysis of the impact of minibatch size to the algorithm's…

Machine Learning · Statistics 2017-09-06 Changyou Chen , Wenlin Wang , Yizhe Zhang , Qinliang Su , Lawrence Carin

The use of one-bit analog-to-digital converters (ADCs) is a practical solution for reducing cost and power consumption in massive Multiple-Input-Multiple-Output (MIMO) systems. However, the distortion caused by one-bit ADCs makes the data…

Signal Processing · Electrical Eng. & Systems 2020-09-02 Ly V. Nguyen , A. Lee Swindlehurst , Duy H. N. Nguyen

A novel compressive-sensing based signal multiplexing scheme is proposed in this paper to further improve the multiplexing gain for multiple input multiple output (MIMO) system. At the transmitter side, a Gaussian random measurement matrix…

Information Theory · Computer Science 2016-04-05 Chanzi Liu , Qingchun Chen , Xiaohu Tang

Multiple Input Multiple Output (MIMO) systems have recently emerged as a key technology in wireless communication systems for increasing both data rates and system performance. There are many schemes that can be applied to MIMO systems such…

Networking and Internet Architecture · Computer Science 2010-02-23 Nirmalendu Bikas Sinha , S. Chakraborty , P. K. Sutradhar , R. Bera , M. Mitra

Probabilistic models are conceptually powerful tools for finding structure in data, but their practical effectiveness is often limited by our ability to perform inference in them. Exact inference is frequently intractable, so approximate…

Computation · Statistics 2014-07-25 Robert Nishihara , Iain Murray , Ryan P. Adams

Monte Carlo (MC) methods are widely used for Bayesian inference and optimization in statistics, signal processing and machine learning. A well-known class of MC methods are Markov Chain Monte Carlo (MCMC) algorithms. In order to foster…

Computation · Statistics 2016-09-27 L. Martino , V. Elvira , D. Luengo , J. Corander , F. Louzada

Markov chain Monte Carlo (MCMC) is the engine of modern Bayesian statistics, being used to approximate the posterior and derived quantities of interest. Despite this, the issue of how the output from a Markov chain is post-processed and…

Methodology · Statistics 2021-09-07 Leah F. South , Marina Riabiz , Onur Teymur , Chris. J. Oates

In statistical analysis, Monte Carlo (MC) stands as a classical numerical integration method. When encountering challenging sample problem, Markov chain Monte Carlo (MCMC) is a commonly employed method. However, the MCMC estimator is biased…

Numerical Analysis · Mathematics 2024-11-05 Jiarui Du , Zhijian He

This paper considers a multiple-input multiple-output (MIMO) system with low-resolution analog-to-digital converters (ADCs). In this system, the paper presents a new MIMO detection approach using coding theory. The principal idea of the…

Information Theory · Computer Science 2016-10-26 Song-Nam Hong , Yo-Seb Jeon , Namyoon Lee

Bayesian inference using Markov Chain Monte Carlo (MCMC) on large datasets has developed rapidly in recent years. However, the underlying methods are generally limited to relatively simple settings where the data have specific forms of…

Methodology · Statistics 2020-02-18 Robert Salomone , Matias Quiroz , Robert Kohn , Mattias Villani , Minh-Ngoc Tran

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman