English
Related papers

Related papers: D-MFVI: Distributed Mean Field Variational Inferen…

200 papers

Gaussian and discrete non-Gaussian spatial datasets are common across fields like public health, ecology, geosciences, and social sciences. Bayesian spatial generalized linear mixed models (SGLMMs) are a flexible class of models for…

Methodology · Statistics 2025-01-27 Jin Hyung Lee , Ben Seiyon Lee

Despite having various attractive qualities such as high prediction accuracy and the ability to quantify uncertainty and avoid over-fitting, Bayesian Matrix Factorization has not been widely adopted because of the prohibitive cost of…

Machine Learning · Computer Science 2015-03-11 Sungjin Ahn , Anoop Korattikara , Nathan Liu , Suju Rajan , Max Welling

State estimation of dynamical systems is crucial for providing new decision-making and system automation information in different applications. However, the assumptions on the standard computational models for sensor measurements can be…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Aamir Hussain Chughtai , Arslan Majal , Muhammad Tahir , Momin Uppal

We propose the Binary Diffusion Probabilistic Model (BDPM), a generative framework specifically designed for data representations in binary form. Conventional denoising diffusion probabilistic models (DDPMs) assume continuous inputs, use…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Vitaliy Kinakh , Slava Voloshynovskiy

Federated systems enable collaborative training on highly heterogeneous data through model personalization, which can be facilitated by employing multi-task learning algorithms. However, significant variation in device computing…

In modern computer experiment applications, one often encounters the situation where various models of a physical system are considered, each implemented as a simulator on a computer. An important question in such a setting is determining…

Methodology · Statistics 2023-05-08 John C. Yannotty , Thomas J. Santner , Richard J. Furnstahl , Matthew T. Pratola

This paper introduces Distributed Stein Variational Gradient Descent (DSVGD), a non-parametric generalized Bayesian inference framework for federated learning. DSVGD maintains a number of non-random and interacting particles at a central…

Machine Learning · Computer Science 2021-03-31 Rahif Kassab , Osvaldo Simeone

Variable selection for a multiple regression model (Noisy Linear Perceptron) is studied with a mean field approximation. In our Bayesian framework, variable selection is formulated as estimation of discrete parameters that indicate a subset…

Disordered Systems and Neural Networks · Physics 2007-05-23 Yukito Iba

Classical linear metric learning methods have recently been extended along two distinct lines: deep metric learning methods for learning embeddings of the data using neural networks, and Bregman divergence learning approaches for extending…

Machine Learning · Computer Science 2020-05-07 Kubra Cilingir , Rachel Manzelli , Brian Kulis

Hidden Markov Models (HMM) have been used for several years in many time series analysis or pattern recognitions tasks. HMM are often trained by means of the Baum-Welch algorithm which can be seen as a special variant of an expectation…

Machine Learning · Computer Science 2016-05-30 Christian Gruhl , Bernhard Sick

Deep learning-based techniques for the analysis of multimodal remote sensing data have become popular due to their ability to effectively integrate complementary spatial, spectral, and structural information from different sensors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hao Liu , Yongjie Zheng , Yuhan Kang , Mingyang Zhang , Maoguo Gong , Lorenzo Bruzzone

This paper proposes a simple, novel, and fully-Bayesian approach for causal inference in partially linear models with high-dimensional control variables. Off-the-shelf machine learning methods can introduce biases in the causal parameter…

Econometrics · Economics 2025-08-19 Francis J. DiTraglia , Laura Liu

This paper presents a methodology for creating streaming, distributed inference algorithms for Bayesian nonparametric (BNP) models. In the proposed framework, processing nodes receive a sequence of data minibatches, compute a variational…

Machine Learning · Computer Science 2015-11-02 Trevor Campbell , Julian Straub , John W. Fisher , Jonathan P. How

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

Frequently, population studies feature pyramidally-organized data represented using Hierarchical Bayesian Models (HBM) enriched with plates. These models can become prohibitively large in settings such as neuroimaging, where a sample is…

Machine Learning · Computer Science 2022-03-09 Louis Rouillard , Demian Wassermann

Beam management (BM) protocols are critical for establishing and maintaining connectivity between network radio nodes and User Equipments (UEs). In Distributed Multiple Input Multiple Output systems (D-MIMO), a number of access points…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Karthik R M , Dhiraj Nagaraja Hegde , Muris Sarajlic , Abhishek Sarkar

The problem of modulation classification for a multiple-antenna (MIMO) system employing orthogonal frequency division multiplexing (OFDM) is investigated under the assumption of unknown frequency-selective fading channels and…

Information Theory · Computer Science 2016-04-11 Yu Liu , Osvaldo Simeone , Alexander M. Haimovich , Wei Su

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

In this paper we consider Bayesian parameter inference for partially observed fractional Brownian motion (fBM) models. The approach we follow is to time-discretize the hidden process and then to design Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2022-11-02 Mohamed Maama , Ajay Jasra , Hernando Ombao

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek