English
Related papers

Related papers: Variational Bayes Inference in Digital Receivers

200 papers

Current methods for learning graphical models with latent variables and a fixed structure estimate optimal values for the model parameters. Whereas this approach usually produces overfitting and suboptimal generalization performance,…

Machine Learning · Computer Science 2013-01-30 Hagai Attias

The Variational Bayesian method (VB) is used to solve the probability distributions of latent variables with the minimum free energy criterion. This criterion is not easy to understand, and the computation is complex. For these reasons,…

Machine Learning · Computer Science 2026-05-01 Chenguang Lu

In Bayesian inference, the posterior distributions are difficult to obtain analytically for complex models such as neural networks. Variational inference usually uses a parametric distribution for approximation, from which we can easily…

Machine Learning · Statistics 2019-02-01 Futoshi Futami , Zhenghang Cui , Issei Sato , Masashi Sugiyama

Extremely large antenna arrays and high-frequency operation are two key technologies that advance performance metrics such as higher data rates, lower latency, and wider coverage in sixth-generation communications. However, the adoption of…

Signal Processing · Electrical Eng. & Systems 2026-02-26 Van-Chung Luu , Toan-Van Nguyen , Nuria González-Prelcic , Duy H. N. Nguyen

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Bayesian neural networks (BNNs) hold great promise as a flexible and principled solution to deal with uncertainty when learning from finite data. Among approaches to realize probabilistic inference in deep neural networks, variational Bayes…

Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the…

Machine Learning · Statistics 2021-07-01 Ghassen Jerfel , Serena Wang , Clara Fannjiang , Katherine A. Heller , Yian Ma , Michael I. Jordan

Variational Autoencoders (VAEs) are expressive latent variable models that can be used to learn complex probability distributions from training data. However, the quality of the resulting model crucially relies on the expressiveness of the…

Machine Learning · Computer Science 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

Variational inference (VI) is a specific type of approximate Bayesian inference that approximates an intractable posterior distribution with a tractable one. VI casts the inference problem as an optimization problem, more specifically, the…

Machine Learning · Computer Science 2022-12-20 Felix Leibfried

Approximate inference in probability models is a fundamental task in machine learning. Approximate inference provides powerful tools to Bayesian reasoning, decision making, and Bayesian deep learning. The main goal is to estimate the…

Machine Learning · Computer Science 2020-03-10 Jun Han

Massive multiple-input multiple-output (MIMO) stands as a key technology for advancing performance metrics such as data rate, reliability, and spectrum efficiency in the fifth generation (5G) and beyond of wireless networks. However, its…

Signal Processing · Electrical Eng. & Systems 2025-05-19 Sajjad Nassirpour , Toan-Van Nguyen , Duy H. N. Nguyen

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

Machine Learning · Computer Science 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

It is now widely accepted that knowledge can be acquired from networks by clustering their vertices according to connection profiles. Many methods have been proposed and in this paper we concentrate on the Stochastic Block Model (SBM). The…

Applications · Statistics 2010-07-27 Pierre Latouche , Etienne Birmele , Christophe Ambroise

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung

Variational inference (VI) is a method to approximate the computationally intractable posterior distributions that arise in Bayesian statistics. Typically, VI fits a simple parametric distribution to the target posterior by minimizing an…

Machine Learning · Statistics 2023-07-18 Chirag Modi , Charles Margossian , Yuling Yao , Robert Gower , David Blei , Lawrence Saul

Variational Bayes (VB) is a popular tool for Bayesian inference in statistical modeling. Recently, some VB algorithms are proposed to handle intractable likelihoods with applications such as approximate Bayesian computation. In this paper,…

Numerical Analysis · Mathematics 2021-09-28 Zhijian He , Zhenghang Xu , Xiaoqun Wang

Variational Bayes (VB) has become a widely-used tool for Bayesian inference in statistics and machine learning. Nonetheless, the development of the existing VB algorithms is so far generally restricted to the case where the variational…

Machine Learning · Computer Science 2021-08-04 Minh-Ngoc Tran , Dang H. Nguyen , Duy Nguyen

Hybrid Bayesian Networks (HBNs), which contain both discrete and continuous variables, arise naturally in many application areas (e.g., image understanding, data fusion, medical diagnosis, fraud detection). This paper concerns inference in…

Artificial Intelligence · Computer Science 2019-05-21 Cheol Young Park , Kathryn Blackmond Laskey , Paulo C. G. Costa , Shou Matsumoto

In this work we examine blind adaptive and iterative decision feedback (DF) receivers for direct sequence code division multiple access (DS-CDMA) systems in frequency selective channels. Code-constrained minimum variance (CMV) and constant…

Information Theory · Computer Science 2013-01-23 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart