English
Related papers

Related papers: Channel-Driven Monte Carlo Sampling for Bayesian D…

200 papers

Recent developments in big data and analytics research have produced an abundance of large data sets that are too big to be analyzed in their entirety, due to limits on computer memory or storage capacity. To address these issues,…

Methodology · Statistics 2016-01-06 Alexey Miroshnikov , Erin M. Conlon

Deep learning (DL)-based methods have achieved state-of-the-art performance for many medical image segmentation tasks. Nevertheless, recent studies show that deep neural networks (DNNs) can be miscalibrated and overconfident, leading to…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Yidong Zhao , Joao Tourais , Iain Pierce , Christian Nitsche , Thomas A. Treibel , Sebastian Weingärtner , Artur M. Schweidtmann , Qian Tao

Bayesian Federated Learning (FL) has been recently introduced to provide well-calibrated Machine Learning (ML) models quantifying the uncertainty of their predictions. Despite their advantages compared to frequentist FL setups, Bayesian FL…

Machine Learning · Computer Science 2024-05-12 Luca Barbieri , Stefano Savazzi , Monica Nicoli

As the complexity of our neural network models grow, so too do the data and computation requirements for successful training. One proposed solution to this problem is training on a distributed network of computational devices, thus…

Machine Learning · Computer Science 2020-05-22 Kyle Crandall , Dustin Webb

Many inference problems involve inferring the number $N$ of components in some region, along with their properties $\{\mathbf{x}_i\}_{i=1}^N$, from a dataset $\mathcal{D}$. A common statistical example is finite mixture modelling. In the…

Computation · Statistics 2015-01-15 Brendon J. Brewer

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

Many machine learning applications require operating on a spatially distributed dataset. Despite technological advances, privacy considerations and communication constraints may prevent gathering the entire dataset in a central unit. In…

Machine Learning · Statistics 2024-01-30 Alexandros E. Tzikas , Licio Romao , Mert Pilanci , Alessandro Abate , Mykel J. Kochenderfer

The conventional FL methods face critical challenges in realistic wireless edge networks, where training data is both limited and heterogeneous, often leading to unstable training and poor generalization. To address these challenges in a…

Signal Processing · Electrical Eng. & Systems 2025-06-09 Jun-Pyo Hong , Hyowoon Seo , Kisong Lee

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi

This work considers distributed sensing and transmission of sporadic random samples. Lower bounds are derived for the reconstruction error of a single normally or uniformly-distributed finite-dimensional vector imperfectly measured by a…

Information Theory · Computer Science 2015-11-20 Ayşe Ünsal , Raymond Knopp

Bayesian neural learning feature a rigorous approach to estimation and uncertainty quantification via the posterior distribution of weights that represent knowledge of the neural network. This not only provides point estimates of optimal…

Machine Learning · Computer Science 2018-11-13 Rohitash Chandra , Konark Jain , Ratneel V. Deo , Sally Cripps

Channel uncertainty and co-channel interference are two major challenges in the design of wireless systems such as future generation cellular networks. This paper studies receiver design for a wireless channel model with both time-varying…

Information Theory · Computer Science 2009-10-15 Yan Zhu , Dongning Guo , Michael L. Honig

Bayesian Federated Learning (FL) offers a principled framework to account for the uncertainty caused by limitations in the data available at the nodes implementing collaborative training. In Bayesian FL, nodes exchange information about…

Signal Processing · Electrical Eng. & Systems 2023-05-10 Luca Barbieri , Osvaldo Simeone , Monica Nicoli

Conventional frequentist FL schemes are known to yield overconfident decisions. Bayesian FL addresses this issue by allowing agents to process and exchange uncertainty information encoded in distributions over the model parameters. However,…

Machine Learning · Computer Science 2022-09-20 Jinu Gong , Osvaldo Simeone , Joonhyuk Kang

Sampling-based methods have become a cornerstone of contemporary approaches to Model Predictive Control (MPC), as they make no restrictions on the differentiability of the dynamics or cost function and are straightforward to parallelize.…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

Computer vision tasks are difficult because of the large variability in the data that is induced by changes in light, background, partial occlusion as well as the varying pose, texture, and shape of objects. Generative approaches to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Adam Kortylewski , Mario Wieser , Andreas Morel-Forster , Aleksander Wieczorek , Sonali Parbhoo , Volker Roth , Thomas Vetter

This paper considers the problem of distributed estimation in wireless sensor networks (WSN), which is anticipated to support a wide range of applications such as the environmental monitoring, weather forecasting, and location estimation.…

Signal Processing · Electrical Eng. & Systems 2023-10-26 Meng He , Ran Li , Chuan Huang , Shulong Zhang

This paper addresses the problem of summarizing the posterior distributions that typically arise, in a Bayesian framework, when dealing with signal decomposition problems with unknown number of components. Such posterior distributions are…

Computation · Statistics 2011-11-29 Alireza Roodaki , Julien Bect , Gilles Fleury

Bayesian learning is a powerful learning framework which combines the external information of the data (background information) with the internal information (training data) in a logically consistent way in inference and prediction. By…

Machine Learning · Statistics 2026-02-11 Erdong Guo , David Draper