English
Related papers

Related papers: Multi-Facet Clustering Variational Autoencoders

200 papers

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

Variational auto-encoder (VAE) is a powerful unsupervised learning framework for image generation. One drawback of VAE is that it generates blurry images due to its Gaussianity assumption and thus L2 loss. To allow the generation of high…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Lei Cai , Hongyang Gao , Shuiwang Ji

We demonstrate the application of machine learning for rapid and accurate extraction of plasmonic particles cluster geometries from hyperspectral image data via a dual variational autoencoder (dual-VAE). In this approach, the information is…

Disordered Systems and Neural Networks · Physics 2022-08-09 Muammer Y. Yaman , Sergei V. Kalinin , Kathryn N. Guye , David Ginger , Maxim Ziatdinov

The unsupervised training of GANs and VAEs has enabled them to generate realistic images mimicking real-world distributions and perform image-based unsupervised clustering or semi-supervised classification. Combining the power of these two…

Machine Learning · Computer Science 2019-06-18 Abdullah-Al-Zubaer Imran , Demetri Terzopoulos

Visual generative models (e.g., diffusion models) typically operate in compressed latent spaces to balance training efficiency and sample quality. In parallel, there has been growing interest in leveraging high-quality pre-trained visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yuan Gao , Chen Chen , Tianrong Chen , Jiatao Gu

Autoencoders offer a general way of learning low-dimensional, non-linear representations from data without labels. This is achieved without making any particular assumptions about the data type or other domain knowledge. The generality and…

Machine Learning · Computer Science 2025-05-27 Collin Leiber , Lukas Miklautz , Claudia Plant , Christian Böhm

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua

Free energy biasing methods have proven to be powerful tools to accelerate the simulation of important conformational changes of molecules by modifying the sampling measure. However, most of these methods rely on the prior knowledge of…

Biological Physics · Physics 2021-10-20 Zineb Belkacemi , Paraskevi Gkeka , Tony Lelièvre , Gabriel Stoltz

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Layout design with complex constraints is a challenging problem to solve due to the non-uniqueness of the solution and the difficulties in incorporating the constraints into the conventional optimization-based methods. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2018-06-11 Yujie Zhang , Wenjing Ye

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

Machine Learning · Statistics 2021-01-05 Carl Doersch

This paper introduces the Descriptive Variational Autoencoder (DVAE), an unsupervised and end-to-end trainable neural network for predicting vehicle trajectories that provides partial interpretability. The novel approach is based on the…

Machine Learning · Computer Science 2021-06-25 Marion Neumeier , Andreas Tollkühn , Thomas Berberich , Michael Botsch

Fine-grained visual classification (FGVC) aims to classify sub-classes of objects in the same super-class (e.g., species of birds, models of cars). For the FGVC tasks, the essential solution is to find discriminative subtle information of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Chenyu Guo , Jiyang Xie , Kongming Liang , Xian Sun , Zhanyu Ma

We present fast, realistic image generation on high-resolution, multimodal datasets using hierarchical variational autoencoders (VAEs) trained on a deterministic autoencoder's latent space. In this two-stage setup, the autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Troy Luhman , Eric Luhman

Multi-view clustering has attracted much attention thanks to the capacity of multi-source information integration. Although numerous advanced methods have been proposed in past decades, most of them generally overlook the significance of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Rui Chen , Yongqiang Tang , Wensheng Zhang , Wenlong Feng

3D geometric contents are becoming increasingly popular. In this paper, we study the problem of analyzing deforming 3D meshes using deep neural networks. Deforming 3D meshes are flexible to represent 3D animation sequences as well as…

Graphics · Computer Science 2018-03-30 Qingyang Tan , Lin Gao , Yu-Kun Lai , Shihong Xia

Deep generative models have achieved great success in unsupervised learning with the ability to capture complex nonlinear relationships between latent generating factors and observations. Among them, a factorized hierarchical variational…

Machine Learning · Statistics 2018-06-18 Wei-Ning Hsu , James Glass

We propose a deep mixture of multimodal hierarchical variational auto-encoders called MMHVAE that synthesizes missing images from observed images in different modalities. MMHVAE's design focuses on tackling four challenges: (i) creating a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Reuben Dorent , Nazim Haouchine , Alexandra Golby , Sarah Frisken , Tina Kapur , William Wells

Late fusion multi-view clustering (LFMVC) has become a rapidly growing class of methods in the multi-view clustering (MVC) field, owing to its excellent computational speed and clustering performance. One bottleneck faced by existing late…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qiyuan Ou , Pei Zhang , Sihang Zhou , En Zhu