English
Related papers

Related papers: Universal End-to-End Neural Network for Lossy Imag…

200 papers

This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale…

Machine Learning · Statistics 2018-05-17 Ken Nakanishi , Shin-ichi Maeda , Takeru Miyato , Daisuke Okanohara

Learning a robust video Variational Autoencoder (VAE) is essential for reducing video redundancy and facilitating efficient video generation. Directly applying image VAEs to individual frames in isolation can result in temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yazhou Xing , Yang Fei , Yingqing He , Jingye Chen , Jiaxin Xie , Xiaowei Chi , Qifeng Chen

Layout design with complex constraints is a challenging problem to solve due to the non-uniqueness of the solution and the difficulties in incorporating the constraints into the conventional optimization-based methods. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2018-06-11 Yujie Zhang , Wenjing Ye

Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…

Machine Learning · Computer Science 2022-01-31 Yann Dubois , Benjamin Bloem-Reddy , Karen Ullrich , Chris J. Maddison

The visual signal compression is a long-standing problem. Fueled by the recent advances of deep learning, exciting progress has been made. Despite better compression performance, existing end-to-end compression algorithms are still designed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Shurun Wang , Zhao Wang , Shiqi Wang , Yan Ye

We extensively study how to combine Generative Adversarial Networks and learned compression to obtain a state-of-the-art generative lossy compression system. In particular, we investigate normalization layers, generator and discriminator…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Fabian Mentzer , George Toderici , Michael Tschannen , Eirikur Agustsson

We propose an end-to-end image compression and analysis model with Transformers, targeting to the cloud-based image classification application. Instead of placing an existing Transformer-based image classification model directly after an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yuanchao Bai , Xu Yang , Xianming Liu , Junjun Jiang , Yaowei Wang , Xiangyang Ji , Wen Gao

Lossy image compression is generally formulated as a joint rate-distortion optimization to learn encoder, quantizer, and decoder. However, the quantizer is non-differentiable, and discrete entropy estimation usually is required for rate…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Mu Li , Wangmeng Zuo , Shuhang Gu , Debin Zhao , David Zhang

Recently, learned image compression methods have developed rapidly and exhibited excellent rate-distortion performance when compared to traditional standards, such as JPEG, JPEG2000 and BPG. However, the learning-based methods suffer from…

Image and Video Processing · Electrical Eng. & Systems 2022-06-24 Bowen Li , Yao Xin , Youneng Bao , Fanyang Meng , Yongsheng Liang , Wen Tan

Variational Convertor-Encoder (VCE) converts an image to various styles; we present this novel architecture for the problem of one-shot generalization and its transfer to new tasks not seen before without additional training. We also…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Chengshuai Li , Shuai Han , Jianping Xing

Recent studies reveal a significant theoretical link between variational autoencoders (VAEs) and rate-distortion theory, notably in utilizing VAEs to estimate the theoretical upper bound of the information rate-distortion function of…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Yichi Zhang , Zhihao Duan , Yuning Huang , Fengqing Zhu

The leading approach for image compression with artificial neural networks (ANNs) is to learn a nonlinear transform and a fixed entropy model that are optimized for rate-distortion performance. We show that this approach can be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 David Minnen , George Toderici , Saurabh Singh , Sung Jin Hwang , Michele Covell

Recently, Learning-based image compression has reached comparable performance with traditional image codecs(such as JPEG, BPG, WebP). However, computational complexity and rate flexibility are still two major challenges for its practical…

Image and Video Processing · Electrical Eng. & Systems 2022-02-25 Shanzhi Yin , Chao Li , Youneng Bao , Yongsheng Liang

Recently, many deep image compression methods have been proposed and achieved remarkable performance. However, these methods are dedicated to optimizing the compression performance and speed at medium and high bitrates, while research on…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhiyuan Li , Chenyang Ge , Shun Li

In the advent of a digital health revolution, vast amounts of clinical data are being generated, stored and processed on a daily basis. This has made the storage and retrieval of large volumes of health-care data, especially,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Asif Shahriyar Sushmit , Shakib Uz Zaman , Ahmed Imtiaz Humayun , Taufiq Hasan , Mohammed Imamul Hassan Bhuiyan

Recent advancements in neural compression have surpassed traditional codecs in PSNR and MS-SSIM measurements. However, at low bit-rates, these methods can introduce visually displeasing artifacts, such as blurring, color shifting, and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Daxin Li , Yuanchao Bai , Kai Wang , Junjun Jiang , Xianming Liu

Deep neural networks represent a powerful class of function approximators that can learn to compress and reconstruct images. Existing image compression algorithms based on neural networks learn quantized representations with a constant…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 David Minnen , George Toderici , Michele Covell , Troy Chinen , Nick Johnston , Joel Shor , Sung Jin Hwang , Damien Vincent , Saurabh Singh

Despite progress in training neural networks for lossy image compression, current approaches fail to maintain both perceptual quality and abstract features at very low bitrates. Encouraged by recent success in learning discrete…

Machine Learning · Computer Science 2020-10-19 Will Williams , Sam Ringer , Tom Ash , John Hughes , David MacLeod , Jamie Dougherty

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

We develop a simple and elegant method for lossless compression using latent variable models, which we call 'bits back with asymmetric numeral systems' (BB-ANS). The method involves interleaving encode and decode steps, and achieves an…

Machine Learning · Computer Science 2021-04-23 James Townsend