English
Related papers

Related papers: M^2VAE: Multi-Modal Multi-View Variational Autoenc…

200 papers

Graph neural networks (GNNs) have revolutionized recommender systems by effectively modeling complex user-item interactions, yet data sparsity and the item cold-start problem significantly impair performance, particularly for new items with…

Machine Learning · Computer Science 2026-03-04 Jialin Liu , Zhaorui Zhang , Ray C. C. Cheung

Clustering high-dimensional data, such as images or biological measurements, is a long-standingproblem and has been studied extensively. Recently, Deep Clustering has gained popularity due toits flexibility in fitting the specific…

Machine Learning · Computer Science 2020-12-21 Andreas Kopf , Vincent Fortuin , Vignesh Ram Somnath , Manfred Claassen

Machine learning systems are often deployed in domains that entail data from multiple modalities, for example, phenotypic and genotypic characteristics describe patients in healthcare. Previous works have developed multimodal variational…

Machine Learning · Computer Science 2022-04-12 Jannik Wolff , Tassilo Klein , Moin Nabi , Rahul G. Krishnan , Shinichi Nakajima

We would like to learn a representation of the data which decomposes an observation into factors of variation which we can independently control. Specifically, we want to use minimal supervision to learn a latent representation that…

Machine Learning · Computer Science 2017-05-25 Diane Bouchacourt , Ryota Tomioka , Sebastian Nowozin

Multiple signal modalities, such as vision and sounds, are naturally present in real-world phenomena. Recently, there has been growing interest in learning generative models, in particular variational autoencoder (VAE), to for multimodal…

Machine Learning · Computer Science 2024-12-31 Peijie Qiu , Wenhui Zhu , Sayantan Kumar , Xiwen Chen , Xiaotong Sun , Jin Yang , Abolfazl Razi , Yalin Wang , Aristeidis Sotiras

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned representations. We…

Machine Learning · Computer Science 2020-05-29 Andriy Serdega , Dae-Shik Kim

Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common latent space, they…

Machine Learning · Computer Science 2024-10-23 Alejandro Guerrero-López , Carlos Sevilla-Salcedo , Vanessa Gómez-Verdejo , Pablo M. Olmos

Hybrid recommendations have recently attracted a lot of attention where user features are utilized as auxiliary information to address the sparsity problem caused by insufficient user-item interactions. However, extracted user features…

Information Retrieval · Computer Science 2022-11-22 Yaochen Zhu , Zhenzhong Chen

We consider the problem of diversifying automated reply suggestions for a commercial instant-messaging (IM) system (Skype). Our conversation model is a standard matching based information retrieval architecture, which consists of two…

Computation and Language · Computer Science 2019-03-27 Budhaditya Deb , Peter Bailey , Milad Shokouhi

Multi-View Clustering (MVC) has gained significant attention for its ability to leverage complementary information across diverse views. However, existing deep MVC methods often struggle with view-distribution entanglement during cross-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Xin Zou , Ruimeng Liu , Chang Tang , Zhenglai Li , Xinwang Liu , Kunlun He , Wanqing Li

Multimodal sensory data resembles the form of information perceived by humans for learning, and are easy to obtain in large quantities. Compared to unimodal data, synchronization of concepts between modalities in such data provides…

Machine Learning · Statistics 2018-05-30 Wei-Ning Hsu , James Glass

Learning latent representations that are simultaneously expressive, geometrically well-structured, and reliably calibrated remains a central challenge for Variational Autoencoders (VAEs). Standard VAEs typically assume a diagonal Gaussian…

Machine Learning · Computer Science 2025-12-02 Mehmet Can Yavuz

Sequential recommendation is a fundamental task for network applications, and it usually suffers from the item cold start problem due to the insufficiency of user feedbacks. There are currently three kinds of popular approaches which are…

Information Retrieval · Computer Science 2018-11-21 Qiang Cui , Shu Wu , Qiang Liu , Wen Zhong , Liang Wang

Multimodal variational autoencoders (VAEs) are widely used for weakly supervised generative learning with multiple modalities. Predominant methods aggregate unimodal inference distributions using either a product of experts (PoE), a mixture…

Machine Learning · Computer Science 2026-04-01 Huyen Vo , Isabel Valera

We investigate deep generative models that can exchange multiple modalities bi-directionally, e.g., generating images from corresponding texts and vice versa. A major approach to achieve this objective is to train a model that integrates…

Machine Learning · Statistics 2018-01-29 Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in sequential…

Information Retrieval · Computer Science 2021-03-22 Zhe Xie , Chengxuan Liu , Yichi Zhang , Hongtao Lu , Dong Wang , Yue Ding

Multi-view data from the same source often exhibit correlation. This is mirrored in correlation between the latent spaces of separate variational autoencoders (VAEs) trained on each data-view. A multi-view VAE approach is proposed that…

Machine Learning · Statistics 2025-08-01 Ella S. C. Orme , Marina Evangelou , Ulrich Paquet

Human perception is inherently multimodal. We integrate, for instance, visual, proprioceptive and tactile information into one experience. Hence, multimodal learning is of importance for building robotic systems that aim at robustly…

Machine Learning · Computer Science 2024-11-04 Carlotta Langer , Yasmin Kim Georgie , Ilja Porohovoj , Verena Vanessa Hafner , Nihat Ay

Multimodal Variational Autoencoders (VAEs) have been the subject of intense research in the past years as they can integrate multiple modalities into a joint representation and can thus serve as a promising tool for both data classification…

Machine Learning · Computer Science 2024-09-18 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova , Tadahiro Taniguchi

The integrative analysis of histopathological images and genomic data has received increasing attention for survival prediction of human cancers. However, the existing studies always hold the assumption that full modalities are available.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Junjie Zhou , Jiao Tang , Yingli Zuo , Peng Wan , Daoqiang Zhang , Wei Shao