English
Related papers

Related papers: Variable Rate Deep Image Compression with Modulate…

200 papers

The lack of ability to adapt the motion compensation model to video content is an important limitation of current end-to-end learned video compression models. This paper advances the state-of-the-art by proposing an adaptive…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 M. Akın Yılmaz , O. Ugur Ulas , A. Murat Tekalp

Neural image compression (NIC) has outperformed traditional image codecs in rate-distortion (R-D) performance. However, it usually requires a dedicated encoder-decoder pair for each point on R-D curve, which greatly hinders its practical…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Chenjian Gao , Tongda Xu , Dailan He , Hongwei Qin , Yan Wang

End-to-end optimized neural image compression (NIC) has obtained superior lossy compression performance recently. In this paper, we consider the problem of rate-distortion (R-D) characteristic analysis and modeling for NIC. We make efforts…

Image and Video Processing · Electrical Eng. & Systems 2022-01-14 Chuanmin Jia , Ziqing Ge , Shanshe Wang , Siwei Ma , Wen Gao

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Despite a short history, neural image codecs have been shown to surpass classical image codecs in terms of rate-distortion performance. However, most of them suffer from significantly longer decoding times, which hinders the practical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Yixin Gao , Runsen Feng , Zongyu Guo , Zhibo Chen

This paper presents improvements and novel additions to our recent work on end-to-end optimized hierarchical bi-directional video compression to further advance the state-of-the-art in learned video compression. As an improvement, we…

Image and Video Processing · Electrical Eng. & Systems 2022-06-29 Eren Cetin , M. Akin Yilmaz , A. Murat Tekalp

Gastrointestinal (GI) imaging via Wireless Capsule Endoscopy (WCE) generates a large number of images requiring manual screening. Deep learning-based Clinical Decision Support (CDS) systems can assist screening, yet their performance relies…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Dimitrios E. Diamantis , Dimitris K. Iakovidis

Deep video compression has made significant progress in recent years, achieving rate-distortion performance that surpasses that of traditional video compression methods. However, rate control schemes tailored for deep video compression have…

Multimedia · Computer Science 2025-05-09 Bowen Gu , Hao Chen , Ming Lu , Jie Yao , Zhan Ma

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

This paper presents a Transformer-based image compression system that allows for a variable image quality objective according to the user's preference. Optimizing a learned codec for different quality objectives leads to reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Chia-Hao Kao , Yi-Hsin Chen , Cheng Chien , Wei-Chen Chiu , Wen-Hsiao Peng

We propose a MultiScale AutoEncoder(MSAE) based extreme image compression framework to offer visually pleasing reconstruction at a very low bitrate. Our method leverages the "priors" at different resolution scale to improve the compression…

Image and Video Processing · Electrical Eng. & Systems 2020-01-06 Chao Huang , Haojie Liu , Tong Chen , Qiu Shen , Zhan Ma

Masked Autoencoder (MAE) is a notable method for self-supervised pretraining in visual representation learning. It operates by randomly masking image patches and reconstructing these masked patches using the unmasked ones. A key limitation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Han Guo , Ramtin Hosseini , Ruiyi Zhang , Sai Ashish Somayajula , Ranak Roy Chowdhury , Rajesh K. Gupta , Pengtao Xie

Masked autoencoders (MAEs) have emerged recently as art self-supervised spatiotemporal representation learners. Inheriting from the image counterparts, however, existing video MAEs still focus largely on static appearance learning whilst…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Haosen Yang , Deng Huang , Bin Wen , Jiannan Wu , Hongxun Yao , Yi Jiang , Xiatian Zhu , Zehuan Yuan

Dark image enhancement aims at converting dark images to normal-light images. Existing dark image enhancement methods take uncompressed dark images as inputs and achieve great performance. However, in practice, dark images are often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Yi Zeng , Zhengning Wang , Yuxuan Liu , Tianjiao Zeng , Xuhang Liu , Xinglong Luo , Shuaicheng Liu , Shuyuan Zhu , Bing Zeng

Variational autoencoders (VAEs) rely on amortized variational inference to enable efficient posterior approximation, but this efficiency comes at the cost of a shared parametrization, giving rise to the amortization gap. We propose the…

Machine Learning · Computer Science 2026-04-21 Andrea Pollastro , Andrea Apicella , Francesco Isgrò , Roberto Prevete

Variational autoencoder (VAE) is one of the most common techniques in the field of medical image generation, where this architecture has shown advanced researchers in recent years and has developed into various architectures. VAE has…

Machine Learning · Computer Science 2024-11-13 Khadija Rais , Mohamed Amroune , Abdelmadjid Benmachiche , Mohamed Yassine Haouam

To analyze high-dimensional and complex data in the real world, deep generative models, such as variational autoencoder (VAE) embed data in a low-dimensional space (latent space) and learn a probabilistic model in the latent space. However,…

Machine Learning · Computer Science 2020-09-01 Keizo Kato , Jing Zhou , Tomotake Sasaki , Akira Nakagawa

Discrete latent variables are considered important for real world data, which has motivated research on Variational Autoencoders (VAEs) with discrete latents. However, standard VAE training is not possible in this case, which has motivated…

Machine Learning · Statistics 2023-03-27 Enrico Guiraud , Jakob Drefs , Jörg Lücke

Variational autoencoders (VAEs) have ushered in a new era of unsupervised learning methods for complex distributions. Although these techniques are elegant in their approach, they are typically not useful for representation learning. In…

Machine Learning · Computer Science 2020-01-10 Ali Lotfi Rezaabad , Sriram Vishwanath

In end-to-end optimized learned image compression, it is standard practice to use a convolutional variational autoencoder with generalized divisive normalization (GDN) to transform images into a latent space. Recently, Operational Neural…

Image and Video Processing · Electrical Eng. & Systems 2021-05-31 M. Akın Yılmaz , Onur Keleş , Hilal Güven , A. Murat Tekalp , Junaid Malik , Serkan Kıranyaz