English
Related papers

Related papers: Non-local Attention Optimized Deep Image Compressi…

200 papers

We make the following striking observation: fully convolutional VAE models trained on 32x32 ImageNet can generalize well, not just to 64x64 but also to far larger photographs, with no changes to the model. We use this property, applying…

Image and Video Processing · Electrical Eng. & Systems 2019-12-23 James Townsend , Thomas Bird , Julius Kunze , David Barber

Recently, numerous end-to-end optimized image compression neural networks have been developed and proved themselves as leaders in rate-distortion performance. The main strength of these learnt compression methods is in powerful nonlinear…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Xi Zhang , Xiaolin Wu

Neural-network-based approaches recently emerged in the field of data compression and have already led to significant progress in image compression, especially in achieving a higher compression ratio. In the lossless image compression…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Yuan Lan , Liang Qin , Zhaoyi Sun , Yang Xiang , Jie Sun

Spatial frequency analysis and transforms serve a central role in most engineered image and video lossy codecs, but are rarely employed in neural network (NN)-based approaches. We propose a novel NN-based image coding framework that…

Image and Video Processing · Electrical Eng. & Systems 2023-01-04 Hyomin Choi , Fabien Racape , Shahab Hamidi-Rad , Mateen Ulhaq , Simon Feltman

A Transformer-based Image Compression (TIC) approach is developed which reuses the canonical variational autoencoder (VAE) architecture with paired main and hyper encoder-decoders. Both main and hyper encoders are comprised of a sequence of…

Image and Video Processing · Electrical Eng. & Systems 2021-11-15 Ming Lu , Peiyao Guo , Huiqing Shi , Chuntong Cao , Zhan Ma

Deep variational autoencoders for image and video compression have gained significant attraction in the recent years, due to their potential to offer competitive or better compression rates compared to the decades long traditional codecs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Bharath Bhushan Damodaran , Muhammet Balcilar , Franck Galpin , Pierre Hellier

Existing learning-based stereo image codec adopt sophisticated transformation with simple entropy models derived from single image codecs to encode latent representations. However, those entropy models struggle to effectively capture the…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Xinjie Zhang , Shenyuan Gao , Zhening Liu , Jiawei Shao , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Jun Zhang

Normalizing flows, autoregressive models, variational autoencoders (VAEs), and deep energy-based models are among competing likelihood-based frameworks for deep generative learning. Among them, VAEs have the advantage of fast and tractable…

Machine Learning · Statistics 2021-01-11 Arash Vahdat , Jan Kautz

Recently, deep learning technology has been successfully applied in the field of image compression, leading to superior rate-distortion performance. It is crucial to design an effective and efficient entropy model to estimate the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-03 Yongqiang Wang , Haisheng Fu , Qi Cao , Shang Wang , Zhenjiao Chen , Feng Liang

Learning-based image compression was shown to achieve a competitive performance with state-of-the-art transform-based codecs. This motivated the development of new learning-based visual compression standards such as JPEG-AI. Of particular…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Yingpeng Deng , Lina J. Karam

Recently, more and more images are compressed and sent to the back-end devices for the machine analysis tasks~(\textit{e.g.,} object detection) instead of being purely watched by humans. However, most traditional or learned image codecs are…

Image and Video Processing · Electrical Eng. & Systems 2022-06-14 Guo Lu , Xingtong Ge , Tianxiong Zhong , Jing Geng , Qiang Hu

We introduce a paradigm for nonlocal sparsity reinforced deep convolutional neural network denoising. It is a combination of a local multiscale denoising by a convolutional neural network (CNN) based denoiser and a nonlocal denoising based…

Image and Video Processing · Electrical Eng. & Systems 2018-08-15 Cristóvão Cruz , Alessandro Foi , Vladimir Katkovnik , Karen Egiazarian

This paper presents variable bitrate lossy image compression using a VAE-based neural network. An adaptable image quality adjustment strategy is proposed. The key innovation involves adeptly adjusting the input scale exclusively during the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Bouzid Arezki , Fangchen Feng , Anissa Mokraoui

The field of video compression has developed some of the most sophisticated and efficient compression algorithms known in the literature, enabling very high compressibility for little loss of information. Whilst some of these techniques are…

With advancements of deep learning techniques, it is now possible to generate super-realistic images and videos, i.e., deepfakes. These deepfakes could reach mass audience and result in adverse impacts on our society. Although lots of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Mengnan Du , Shiva Pentyala , Yuening Li , Xia Hu

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

Modern visual world modeling systems increasingly rely on high-capacity architectures and large-scale data to produce plausible motion, yet they often fail to preserve underlying 3D geometry or physically consistent camera dynamics. A key…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Andrew Bond , Ilkin Umut Melanlioglu , Erkut Erdem , Aykut Erdem

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

Machine Learning · Computer Science 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Raw images preserve linear sensor measurements and high bit-depth information crucial for advanced vision tasks and photography applications, yet their storage remains challenging due to large file sizes, varying bit depths, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Chunhang Zheng , Tongda Xu , Mingli Xie , Yan Wang , Dou Li

The design of a neural image compression network is governed by how well the entropy model matches the true distribution of the latent code. Apart from the model capacity, this ability is indirectly under the effect of how close the relaxed…

Image and Video Processing · Electrical Eng. & Systems 2023-09-21 Ali Zafari , Atefeh Khoshkhahtinat , Piyush Mehta , Mohammad Saeed Ebrahimi Saadabadi , Mohammad Akyash , Nasser M. Nasrabadi