English
Related papers

Related papers: TC-AE: Unlocking Token Capacity for Deep Compressi…

200 papers

Spatio-temporal compression of videos, utilizing networks such as Variational Autoencoders (VAE), plays a crucial role in OpenAI's SORA and numerous other video generative models. For instance, many LLM-like video models learn the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Sijie Zhao , Yong Zhang , Xiaodong Cun , Shaoshu Yang , Muyao Niu , Xiaoyu Li , Wenbo Hu , Ying Shan

Representation Autoencoders (RAEs) leverage frozen vision foundation models (VFMs) as tokenizer encoders, providing robust high-level representations that facilitate fast convergence and high-quality generation in latent diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tianhang Wang , Yitong Chen , Wei Song , Zuxuan Wu , Min Li , Jiaqi Wang

Is there really much more to say about sparse autoencoders (SAEs)? Autoencoders in general, and SAEs in particular, represent deep architectures that are capable of modeling low-dimensional latent structure in data. Such structure could…

Machine Learning · Computer Science 2025-06-09 Yin Lu , Xuening Zhu , Tong He , David Wipf

The Variational Autoencoder (VAE) is a powerful architecture capable of representation learning and generative modeling. When it comes to learning interpretable (disentangled) representations, VAE and its variants show unparalleled…

Machine Learning · Computer Science 2019-04-17 Michal Rolinek , Dominik Zietlow , Georg Martius

The electrocardiogram (ECG) is an inexpensive and widely available tool for cardiovascular assessment. Despite its standardized format and small file size, the high complexity and inter-individual variability of ECG signals (typically a…

Machine Learning · Computer Science 2024-10-31 Christopher J. Harvey , Sumaiya Shomaji , Zijun Yao , Amit Noheria

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

Machine Learning · Computer Science 2019-04-25 Jason Chou

We present a VAE architecture for encoding and generating high dimensional sequential data, such as video or audio. Our deep generative model learns a latent representation of the data which is split into a static and dynamic part, allowing…

Machine Learning · Computer Science 2018-06-13 Yingzhen Li , Stephan Mandt

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Aerosol-cloud--radiation interactions remain among the most uncertain components of the Earth's climate system, in partdue to the high dimensionality of aerosol state representations and the difficulty of obtaining complete \textit{in situ}…

Atmospheric and Oceanic Physics · Physics 2025-10-14 Ehsan Saleh , Saba Ghaffari , Jeffrey H. Curtis , Lekha Patel , Peter A. Bosler , Nicole Riemer , Matthew West

Variation Autoencoder (VAE) has become a powerful tool in modeling the non-linear generative process of data from a low-dimensional latent space. Recently, several studies have proposed to use VAE for unsupervised clustering by using…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Nicolas Honnorat , Ehsan Adeli , Kilian M. Pohl

Recent research has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate-distortion theory. Motivated by this, we consider the problem of lossy image compression from the perspective of generative…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Zhihao Duan , Ming Lu , Zhan Ma , Fengqing Zhu

Generative AI has received substantial attention in recent years due to its ability to synthesize data that closely resembles the original data source. While Generative Adversarial Networks (GANs) have provided innovative approaches for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Xuan Xu , Saarthak Kapse , Rajarsi Gupta , Prateek Prasanna

Variational autoencoders (VAEs) combine latent variables with amortized variational inference, whose optimization usually converges into a trivial local optimum termed posterior collapse, especially in text modeling. By tracking the…

Computation and Language · Computer Science 2020-04-21 Chen Wu , Prince Zizhuang Wang , William Yang Wang

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

This paper presents variable bitrate lossy image compression using a VAE-based neural network. An adaptable image quality adjustment strategy is proposed. The key innovation involves adeptly adjusting the input scale exclusively during the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Bouzid Arezki , Fangchen Feng , Anissa Mokraoui

Among the wide variety of image generative models, two models stand out: Variational Auto Encoders (VAE) and Generative Adversarial Networks (GAN). GANs can produce realistic images, but they suffer from mode collapse and do not provide…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Next-generation communication networks are expected to exploit recent advances in data science and cutting-edge communications technologies to improve the utilization of the available communications resources. In this article, we introduce…

Signal Processing · Electrical Eng. & Systems 2024-01-15 Abdullah Zayat , Mahmoud A. Hasabelnaby , Mohanad Obeed , Anas Chaaban

The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we…

Machine Learning · Computer Science 2019-11-12 Adam Roberts , Jesse Engel , Colin Raffel , Curtis Hawthorne , Douglas Eck

Representation learning (RL) methods for cyberattack detection face the diversity and sophistication of attack data, leading to the issue of mixed representations of different classes, particularly as the number of classes increases. To…

Cryptography and Security · Computer Science 2025-04-30 Phai Vu Dinh , Quang Uy Nguyen , Thai Hoang Dinh , Diep N. Nguyen , Bao Son Pham , Eryk Dutkiewicz

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

Machine Learning · Computer Science 2023-02-08 Fareed Sheriff , Sameer Pai