English
Related papers

Related papers: Efficient Mixture Learning in Black-Box Variationa…

200 papers

Semi-supervised entity alignment (EA) is a practical and challenging task because of the lack of adequate labeled mappings as training data. Most works address this problem by generating pseudo mappings for unlabeled entities. However, they…

Machine Learning · Computer Science 2023-11-09 Feng Xie , Xin Song , Xiang Zeng , Xuechen Zhao , Lei Tian , Bin Zhou , Yusong Tan

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

Machine Learning · Computer Science 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

A trade-off exists between reconstruction quality and the prior regularisation in the Evidence Lower Bound (ELBO) loss that Variational Autoencoder (VAE) models use for learning. There are few satisfactory approaches to deal with a balance…

Machine Learning · Computer Science 2019-09-10 Shuyu Lin , Stephen Roberts , Niki Trigoni , Ronald Clark

Accurate and real-time prediction of wireless channel conditions, particularly the Signal-to-Interference-plus-Noise Ratio (SINR), is a foundational requirement for enabling Ultra-Reliable Low-Latency Communication (URLLC) in highly dynamic…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Rahul Gulia , Amlan Ganguly , Michael E. Kuhl , Ehsan Rashedi , Clark Hochgraf

We consider the problem of handling missing data with deep latent variable models (DLVMs). First, we present a simple technique to train DLVMs when the training set contains missing-at-random data. Our approach, called MIWAE, is based on…

Machine Learning · Statistics 2019-02-05 Pierre-Alexandre Mattei , Jes Frellsen

Boosting variational inference (BVI) approximates an intractable probability density by iteratively building up a mixture of simple component distributions one at a time, using techniques from sparse convex optimization to provide both…

Machine Learning · Statistics 2019-10-29 Trevor Campbell , Xinglong Li

Hybrid recommendations have recently attracted a lot of attention where user features are utilized as auxiliary information to address the sparsity problem caused by insufficient user-item interactions. However, extracted user features…

Information Retrieval · Computer Science 2022-11-22 Yaochen Zhu , Zhenzhong Chen

Variational Autoencoders and their many variants have displayed impressive ability to perform dimensionality reduction, often achieving state-of-the-art performance. Many current methods however, struggle to learn good representations in…

Machine Learning · Computer Science 2023-06-28 Navindu Leelarathna , Andrei Margeloiu , Mateja Jamnik , Nikola Simidjievski

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

Optimization and Control · Mathematics 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

Score matching (SM) is a convenient method for training flexible probabilistic models, which is often preferred over the traditional maximum-likelihood (ML) approach. However, these models are less interpretable than normalized models; as…

Machine Learning · Statistics 2022-10-25 Li Kevin Wenliang

The Gauss Markov theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models. In this paper, we take a first step towards extending this result to non linear settings via…

Machine Learning · Computer Science 2023-11-30 Tzvi Diskin , Yonina C. Eldar , Ami Wiesel

Optimizing multiple competing black-box objectives is a challenging problem in many fields, including science, engineering, and machine learning. Multi-objective Bayesian optimization (MOBO) is a sample-efficient approach for identifying…

Machine Learning · Computer Science 2021-10-28 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

A new maximum likelihood estimation approach for blind channel equalization, using variational autoencoders (VAEs), is introduced. Significant and consistent improvements in the error rate of the reconstructed symbols, compared to constant…

Signal Processing · Electrical Eng. & Systems 2018-03-06 Avi Caciularu , David Burshtein

Variational autoencoders (VAE) are powerful generative models that learn the latent representations of input data as random variables. Recent studies show that VAE can flexibly learn the complex temporal dynamics of time series and achieve…

Machine Learning · Computer Science 2023-11-14 Borui Cai , Shuiqiao Yang , Longxiang Gao , Yong Xiang

Models often need to be constrained to a certain size for them to be considered interpretable. For example, a decision tree of depth 5 is much easier to understand than one of depth 50. Limiting model size, however, often reduces accuracy.…

Machine Learning · Computer Science 2020-07-02 Abhishek Ghose , Balaraman Ravindran

Recent work in unsupervised learning has focused on efficient inference and learning in latent variables models. Training these models by maximizing the evidence (marginal likelihood) is typically intractable. Thus, a common approximation…

Machine Learning · Computer Science 2021-02-15 Linh Tran , Maja Pantic , Marc Peter Deisenroth

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

Understanding the gradient variance of black-box variational inference (BBVI) is a crucial step for establishing its convergence and developing algorithmic improvements. However, existing studies have yet to show that the gradient variance…

Machine Learning · Computer Science 2023-06-06 Kyurae Kim , Kaiwen Wu , Jisu Oh , Jacob R. Gardner

The recently proposed identifiable variational autoencoder (iVAE) framework provides a promising approach for learning latent independent components (ICs). iVAEs use auxiliary covariates to build an identifiable generation structure from…

Machine Learning · Statistics 2022-10-17 Young-geun Kim , Ying Liu , Xuexin Wei

Deep Learning-based Vulnerability Detection (DLVD) techniques have garnered significant interest due to their ability to automatically learn vulnerability patterns from previously compromised code. Despite the notable accuracy demonstrated…

Software Engineering · Computer Science 2025-02-14 Xu Yang , Shaowei Wang , Jiayuan Zhou , Wenhan Zhu