English
Related papers

Related papers: Image Compression using only Attention based Neura…

200 papers

In wireless communications, efficient image transmission must balance reliability, throughput, and latency, especially under dynamic channel conditions. This paper presents an adaptive and progressive pipeline for learned image compression…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Mostafa Naseri , Pooya Ashtari , Mohamed Seif , Eli De Poorter , H. Vincent Poor , Adnan Shahid

Most learning-based image compression methods lack efficiency for high image quality due to their non-invertible design. The decoding function of the frequently applied compressive autoencoder architecture is only an approximated inverse of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Marc Windsheimer , Fabian Brand , André Kaup

Interests in digital image processing are growing enormously in recent decades. As a result, different data compression techniques have been proposed which are concerned mostly with the minimization of information used for the…

Image and Video Processing · Electrical Eng. & Systems 2021-12-10 Suman Kunwar

Aiming at the problems that the convolutional neural networks neglect to capture the inherent attributes of natural images and extract features only in a single scale in the field of image super-resolution reconstruction, a network…

Image and Video Processing · Electrical Eng. & Systems 2020-04-09 Jiawen Lyn , Sen Yan

In this paper, we present a general framework for low-level vision tasks including image compression artifacts reduction and image denoising. Under this framework, a novel concatenated attention neural network (CANet) is specifically…

Image and Video Processing · Electrical Eng. & Systems 2020-06-22 Tian YingJie , Wang YiQi , Yang LinRui , Qi ZhiQuan

In recent decades, digital image processing has gained enormous popularity. Consequently, a number of data compression strategies have been put forth, with the goal of minimizing the amount of information required to represent images. Among…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Suman Kunwar

Entropy modeling is a key component for high-performance image compression algorithms. Recent developments in autoregressive context modeling helped learning-based methods to surpass their classical counterparts. However, the performance of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 A. Burakhan Koyuncu , Han Gao , Atanas Boev , Georgii Gaikov , Elena Alshina , Eckehard Steinbach

Recent advances in learning-based image compression typically come at the cost of high complexity. Designing computationally efficient architectures remains an open challenge. In this paper, we empirically investigate the impact of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-18 Yichi Zhang , Zhihao Duan , Fengqing Zhu

Overparameterized networks trained to convergence have shown impressive performance in domains such as computer vision and natural language processing. Pushing state of the art on salient tasks within these domains corresponds to these…

Machine Learning · Computer Science 2020-08-04 James O' Neill

Image compression is a fundamental research field and many well-known compression standards have been developed for many decades. Recently, learned compression methods exhibit a fast development trend with promising results. However, there…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Entropy estimation is essential for the performance of learned image compression. It has been demonstrated that a transformer-based entropy model is of critical importance for achieving a high compression ratio, however, at the expense of a…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 A. Burakhan Koyuncu , Panqi Jia , Atanas Boev , Elena Alshina , Eckehard Steinbach

We propose a novel Convolutional Neural Network (CNN) compression algorithm based on coreset representations of filters. We exploit the redundancies extant in the space of CNN weights and neuronal activations (across samples) in order to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Abhimanyu Dubey , Moitreya Chatterjee , Narendra Ahuja

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

Optical and hybrid convolutional neural networks (CNNs) recently have become of increasing interest to achieve low-latency, low-power image classification and computer vision tasks. However, implementing optical nonlinearity is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Anna Wirth-Singh , Jinlin Xiang , Minho Choi , Johannes E. Fröch , Luocheng Huang , Shane Colburn , Eli Shlizerman , Arka Majumdar

Attention mechanisms, and most prominently self-attention, are a powerful building block for processing not only text but also images. These provide a parameter efficient method for aggregating inputs. We focus on self-attention in vision…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Nichita Diaconu , Daniel E Worrall

Transform and entropy models are the two core components in deep image compression neural networks. Most existing learning-based image compression methods utilize convolutional-based transform, which lacks the ability to model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Atefeh Khoshkhahtinat , Ali Zafari , Piyush M. Mehta , Mohammad Akyash , Hossein Kashiani , Nasser M. Nasrabadi

Lossy image compression algorithms are pervasively used to reduce the size of images transmitted over the web and recorded on data storage media. However, we pay for their high compression rate with visual artifacts degrading the user…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Lukas Cavigelli , Pascal Hager , Luca Benini

Convolutional neural networks (CNNs) based solutions have achieved state-of-the-art performances for many computer vision tasks, including classification and super-resolution of images. Usually the success of these methods comes with a cost…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Yawei Li , Shuhang Gu , Luc Van Gool , Radu Timofte

While standardized codecs like JPEG and HEVC-intra represent the industry standard in image compression, neural Learned Image Compression (LIC) codecs represent a promising alternative. In detail, integrating attention mechanisms from…

Image and Video Processing · Electrical Eng. & Systems 2024-10-07 Gabriele Spadaro , Alberto Presta , Enzo Tartaglione , Jhony H. Giraldo , Marco Grangetto , Attilio Fiandrotti

Although transformers have become the neural architectures of choice for natural language processing, they require orders of magnitude more training data, GPU memory, and computations in order to compete with convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Pranav Jeevan , Amit Sethi