English
Related papers

Related papers: Multimodal Transformer for Parallel Concatenated V…

200 papers

Long-term human motion can be represented as a series of motion modes---motion sequences that capture short-term temporal dynamics---with transitions between them. We leverage this structure and present a novel Motion Transformation…

Machine Learning · Computer Science 2018-08-15 Xinchen Yan , Akash Rastogi , Ruben Villegas , Kalyan Sunkavalli , Eli Shechtman , Sunil Hadap , Ersin Yumer , Honglak Lee

Recently, deep learning methods have been widely used for tumor segmentation of multimodal medical images with promising results. However, most existing methods are limited by insufficient representational ability, specific modality number…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jun Shi , Hongyu Kan , Shulan Ruan , Ziqi Zhu , Minfan Zhao , Liang Qiao , Zhaohui Wang , Hong An , Xudong Xue

We deal with the problem of learning the underlying disentangled latent factors that are shared between the paired bi-modal data in cross-modal retrieval. Our assumption is that the data in both modalities are complex, structured, and high…

Machine Learning · Computer Science 2020-12-02 Minyoung Kim , Ricardo Guerrero , Vladimir Pavlovic

Variation Autoencoder (VAE) has become a powerful tool in modeling the non-linear generative process of data from a low-dimensional latent space. Recently, several studies have proposed to use VAE for unsupervised clustering by using…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Nicolas Honnorat , Ehsan Adeli , Kilian M. Pohl

Generative models have been successfully applied to image style transfer and domain translation. However, there is still a wide gap in the quality of results when learning such tasks on musical audio. Furthermore, most translation models…

Sound · Computer Science 2018-10-02 Adrien Bitton , Philippe Esling , Axel Chemla-Romeu-Santos

A fully disentangled variational auto-encoder (VAE) aims to identify disentangled latent components from observations. However, enforcing full independence between all latent components may be too strict for certain datasets. In some cases,…

Machine Learning · Computer Science 2025-02-05 Chengrui Li , Yunmiao Wang , Yule Wang , Weihan Li , Dieter Jaeger , Anqi Wu

Learning a generative model from partial data (data with missingness) is a challenging area of machine learning research. We study a specific implementation of the Auto-Encoding Variational Bayes (AEVB) algorithm, named in this paper as a…

Machine Learning · Computer Science 2021-01-05 Amir Zadeh , Yao-Chong Lim , Paul Pu Liang , Louis-Philippe Morency

Longitudinal datasets measured repeatedly over time from individual subjects, arise in many biomedical, psychological, social, and other studies. A common approach to analyse high-dimensional data that contains missing values is to learn a…

Machine Learning · Statistics 2021-04-21 Siddharth Ramchandran , Gleb Tikhonov , Kalle Kujanpää , Miika Koskinen , Harri Lähdesmäki

Applying Transformers to irregular time-series typically requires specializations to their baseline architecture, which can result in additional computational overhead and increased method complexity. We present the Rotary Masked…

Machine Learning · Computer Science 2026-05-13 Uros Zivanovic , Serafina Di Gioia , Andre Scaffidi , Martín de los Rios , Gabriella Contardo , Roberto Trotta

Multimodal generative models require a unified approach to handle both discrete data (e.g., text and code) and continuous data (e.g., image, audio, video). In this work, we propose Latent Language Modeling (LatentLM), which seamlessly…

Computation and Language · Computer Science 2024-12-12 Yutao Sun , Hangbo Bao , Wenhui Wang , Zhiliang Peng , Li Dong , Shaohan Huang , Jianyong Wang , Furu Wei

Extracting insight from the enormous quantity of data generated from molecular simulations requires the identification of a small number of collective variables whose corresponding low-dimensional free-energy landscape retains the essential…

Chemical Physics · Physics 2019-12-30 Yasemin Bozkurt Varolgunes , Tristan Bereau , Joseph F. Rudzinski

Videos captured from multiple viewpoints can help in perceiving the 3D structure of the world and benefit computer vision tasks such as action recognition, tracking, etc. In this paper, we present a method for self-supervised learning from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Ketul Shah , Robert Crandall , Jie Xu , Peng Zhou , Marian George , Mayank Bansal , Rama Chellappa

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Pilot contamination (PC) is a well-known problem that affects massive multiple-input multiple-output (MIMO) systems. When frequency and pilots are reused between different cells, PC constitutes one of the main bottlenecks of the system's…

Signal Processing · Electrical Eng. & Systems 2024-09-12 Amar Kasibovic , Benedikt Fesl , Michael Baur , Wolfgang Utschick

Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and most of their…

Machine Learning · Computer Science 2019-10-03 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed…

Machine Learning · Computer Science 2019-12-20 Da Tang , Dawen Liang , Nicholas Ruozzi , Tony Jebara

Imitation learning is an intuitive approach for teaching motion to robotic systems. Although previous studies have proposed various methods to model demonstrated movement primitives, one of the limitations of existing methods is that the…

Robotics · Computer Science 2020-09-24 Takayuki Osa , Shuhei Ikemoto

Variational autoencoders (VAEs) have recently been used for unsupervised disentanglement learning of complex density distributions. Numerous variants exist to encourage disentanglement in latent space while improving reconstruction.…

Machine Learning · Statistics 2022-06-10 Kenneth Ezukwoke , Anis Hoayek , Mireille Batton-Hubert , Xavier Boucher

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

Machine Learning · Computer Science 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other…

Disordered Systems and Neural Networks · Physics 2021-04-22 Yongtao Liu , Rama K. Vasudevan , Kyle Kelley , Dohyung Kim , Yogesh Sharma , Mahshid Ahmadi , Sergei V. Kalinin , Maxim Ziatdinov