English
Related papers

Related papers: Variable Rate Deep Image Compression with Modulate…

200 papers

Living organisms rely on internal models of the world to act adaptively. These models, because of resource limitations, cannot encode every detail and hence need to compress information. From a cognitive standpoint, information compression…

Neurons and Cognition · Quantitative Biology 2025-02-18 Leo D'Amato , Gian Luca Lancia , Giovanni Pezzulo

Deep learning based image compression methods have achieved superior performance compared with transform based conventional codec. With end-to-end Rate-Distortion Optimization (RDO) in the codec, compression model is optimized with Lagrange…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Jing Zhou , Akira Nakagawa , Keizo Kato , Sihan Wen , Kimihiko Kazui , Zhiming Tan

In this paper we present a a deep generative model for lossy video compression. We employ a model that consists of a 3D autoencoder with a discrete latent space and an autoregressive prior used for entropy coding. Both autoencoder and prior…

Image and Video Processing · Electrical Eng. & Systems 2020-05-11 Amirhossein Habibian , Ties van Rozendaal , Jakub M. Tomczak , Taco S. Cohen

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned representations. We…

Machine Learning · Computer Science 2020-05-29 Andriy Serdega , Dae-Shik Kim

Discrete latent bottlenecks in variational autoencoders (VAEs) offer high bit efficiency and can be modeled with autoregressive discrete distributions, enabling parameter-efficient multimodal search with transformers. However, discrete…

Machine Learning · Computer Science 2026-02-12 Michael Drolet , Firas Al-Hafez , Aditya Bhatt , Jan Peters , Oleg Arenz

We propose a versatile deep image compression network based on Spatial Feature Transform (SFT arXiv:1804.02815), which takes a source image and a corresponding quality map as inputs and produce a compressed image with variable rates. Our…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Myungseo Song , Jinyoung Choi , Bohyung Han

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

Sound · Computer Science 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

Recently, the field of Image Coding for Machines (ICM) has garnered heightened interest and significant advances thanks to the rapid progress of learning-based techniques for image compression and analysis. Previous studies often require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jinming Liu , Ruoyu Feng , Yunpeng Qi , Qiuyu Chen , Zhibo Chen , Wenjun Zeng , Xin Jin

This paper presents variable bitrate lossy image compression using a VAE-based neural network. An adaptable image quality adjustment strategy is proposed. The key innovation involves adeptly adjusting the input scale exclusively during the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Bouzid Arezki , Fangchen Feng , Anissa Mokraoui

Variational Autoencoders (VAEs), as a form of deep generative model, have been widely used in recent years, and shown great great peformance in a number of different domains, including image generation and anomaly detection, etc.. This…

Machine Learning · Computer Science 2024-08-28 Liang Cheng , Peiyuan Guan , Amir Taherkordi , Lei Liu , Dapeng Lan

The framework of variational autoencoders (VAEs) provides a principled method for jointly learning latent-variable models and corresponding inference models. However, the main drawback of this approach is the blurriness of the generated…

Machine Learning · Computer Science 2020-07-01 Ioannis Gatopoulos , Maarten Stol , Jakub M. Tomczak

Learned image compression codecs have recently achieved impressive compression performances surpassing the most efficient image coding architectures. However, most approaches are trained to minimize rate and distortion which often leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Daniele Mari , Simone Milani

When training end-to-end learned models for lossy compression, one has to balance the rate and distortion losses. This is typically done by manually setting a tradeoff parameter $\beta$, an approach called $\beta$-VAE. Using this approach…

Machine Learning · Computer Science 2020-05-11 Ties van Rozendaal , Guillaume Sautière , Taco S. Cohen

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jun Han , Salvator Lombardo , Christopher Schroers , Stephan Mandt

Recently, many neural network-based image compression methods have shown promising results superior to the existing tool-based conventional codecs. However, most of them are often trained as separate models for different target bit rates,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Jooyoung Lee , Seyoon Jeong , Munchurl Kim

Learned image compression has exhibited promising compression performance, but variable bitrates over a wide range remain a challenge. State-of-the-art variable rate methods compromise the loss of model performance and require numerous…

Image and Video Processing · Electrical Eng. & Systems 2023-03-13 Kedeng Tong , Yaojun Wu , Yue Li , Kai Zhang , Li Zhang , Xin Jin

3D geometric contents are becoming increasingly popular. In this paper, we study the problem of analyzing deforming 3D meshes using deep neural networks. Deforming 3D meshes are flexible to represent 3D animation sequences as well as…

Graphics · Computer Science 2018-03-30 Qingyang Tan , Lin Gao , Yu-Kun Lai , Shihong Xia

We propose a novel algorithm for quantizing continuous latent representations in trained models. Our approach applies to deep probabilistic models, such as variational autoencoders (VAEs), and enables both data and model compression. Unlike…

Image and Video Processing · Electrical Eng. & Systems 2020-09-09 Yibo Yang , Robert Bamler , Stephan Mandt

Recently it has been shown that deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increases the…

Image and Video Processing · Electrical Eng. & Systems 2019-12-13 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

In recent years, neural network-based image compression techniques have been able to outperform traditional codecs and have opened the gates for the development of learning-based video codecs. However, to take advantage of the high temporal…

Image and Video Processing · Electrical Eng. & Systems 2020-08-25 Aishwarya Jadhav