中文
相关论文

相关论文: DeCo-VAE: Learning Compact Latents for Video Recon…

200 篇论文

The ability of Variational Autoencoders (VAEs) to learn disentangled representations has made them popular for practical applications. However, their behaviour is not yet fully understood. For example, the questions of when they can provide…

机器学习 · 计算机科学 2022-09-27 Lisa Bonheme , Marek Grzes

Variational Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora and other latent video diffusion generation models. While most of existing video VAEs inflate a…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Pingyu Wu , Kai Zhu , Yu Liu , Liming Zhao , Wei Zhai , Yang Cao , Zheng-Jun Zha

Variational autoencoders (VAEs) learn representations of data by jointly training a probabilistic encoder and decoder network. Typically these models encode all features of the data into a single variable. Here we are interested in learning…

Vector quantised variational autoencoders (VQ-VAE) are characterised by three main components: 1) encoding visual data, 2) assigning $k$ different vectors in the so-called embedding space, and 3) decoding the learnt features. While images…

计算机视觉与模式识别 · 计算机科学 2020-10-01 Arash Akbarinia , Raquel Gil-Rodríguez , Alban Flachot , Matteo Toscani

Disentangled representation learning aims to represent the underlying generative factors of a dataset in a latent representation independently of one another. In our work, we propose a discrete variational autoencoder (VAE) based model…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Gulcin Baykal , Melih Kandemir , Gozde Unal

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

机器学习 · 计算机科学 2023-02-08 Fareed Sheriff , Sameer Pai

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

机器学习 · 计算机科学 2022-11-16 Rafael Pastrana

Independent components within low-dimensional representations are essential inputs in several downstream tasks, and provide explanations over the observed data. Video-based disentangled factors of variation provide low-dimensional…

计算机视觉与模式识别 · 计算机科学 2022-02-22 Juan F. Hernández Albarracín , Adín Ramírez Rivera

Given a dataset of images containing different objects with different features such as shape, size, rotation, and x-y position; and a Variational Autoencoder (VAE); creating a disentangled encoding of these features in the hidden space…

计算机视觉与模式识别 · 计算机科学 2022-08-10 Mohammad Haghir Ebrahimabadi

In generative modeling, tokenization simplifies complex data into compact, structured representations, creating a more efficient, learnable space. For high-dimensional visual data, it reduces redundancy and emphasizes key features for…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Long Zhao , Sanghyun Woo , Ziyu Wan , Yandong Li , Han Zhang , Boqing Gong , Hartwig Adam , Xuhui Jia , Ting Liu

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

机器学习 · 计算机科学 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

机器学习 · 计算机科学 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

机器学习 · 统计学 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

Variational autoencoders (VAEs) typically encode images into a compact latent space, reducing computational cost but introducing an optimization dilemma: a higher-dimensional latent space improves reconstruction fidelity but often hampers…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Xunzhi Xiang , Xingye Tian , Guiyu Zhang , Yabo Chen , Shaofeng Zhang , Xuebo Wang , Xin Tao , Qi Fan

In this paper, we propose a novel model called Learnable VAE (L-VAE), which learns a disentangled representation together with the hyperparameters of the cost function. L-VAE can be considered as an extension of \b{eta}-VAE, wherein the…

机器学习 · 计算机科学 2025-07-04 Hazal Mogultay Ozcan , Sinan Kalkan , Fatos T. Yarman-Vural

In this work, we introduce long-video masked-embedding autoencoders (LV-MAE), a self-supervised learning framework for long video representation. Our approach treats short- and long-span dependencies as two separate tasks. Such decoupling…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Ilan Naiman , Emanuel Ben-Baruch , Oron Anschel , Alon Shoshan , Igor Kviatkovsky , Manoj Aggarwal , Gerard Medioni

In one-class novelty detection, a model learns solely on the in-class data to single out out-class instances. Autoencoder (AE) variants aim to compactly model the in-class data to reconstruct it exclusively, thus differentiating the…

机器学习 · 计算机科学 2022-07-25 Jaewoo Park , Yoon Gyo Jung , Andrew Beng Jin Teoh

Learning representations from videos requires understanding continuous motion and visual correspondences between frames. In this paper, we introduce the Concatenated Masked Autoencoders (CatMAE) as a spatial-temporal learner for…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Zhouqiang Jiang , Bowen Wang , Tong Xiang , Zhaofeng Niu , Hong Tang , Guangshun Li , Liangzhi Li

Variational autoencoders (VAEs) combine latent variables with amortized variational inference, whose optimization usually converges into a trivial local optimum termed posterior collapse, especially in text modeling. By tracking the…

计算与语言 · 计算机科学 2020-04-21 Chen Wu , Prince Zizhuang Wang , William Yang Wang

Variational autoencoders (VAEs) are fundamental for generative modeling and image reconstruction, yet their performance often struggles to maintain high fidelity in reconstructions. This study introduces a hybrid model, quantum variational…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Farina Riaz , Fakhar Zaman , Hajime Suzuki , Sharif Abuadbba , David Nguyen