English
Related papers

Related papers: Transformer-based Learned Image Compression for Jo…

200 papers

Retinex model is an effective tool for low-light image enhancement. It assumes that observed images can be decomposed into the reflectance and illumination. Most existing Retinex-based methods have carefully designed hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Chen Wei , Wenjing Wang , Wenhan Yang , Jiaying Liu

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu

Demosaicking and denoising are among the most crucial steps of modern digital camera pipelines and their joint treatment is a highly ill-posed inverse problem where at-least two-thirds of the information are missing and the rest are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-13 Filippos Kokkinos , Stamatios Lefkimmiatis

We present a novel usage of Transformers to make image classification interpretable. Unlike mainstream classifiers that wait until the last fully connected layer to incorporate class information to make predictions, we investigate a…

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passages into single dense vector representations for efficient…

Computation and Language · Computer Science 2021-09-22 Luyu Gao , Jamie Callan

A rapidly increasing portion of Internet traffic is dominated by requests from mobile devices with limited- and metered-bandwidth constraints. To satisfy these requests, it has become standard practice for websites to transmit small and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Shumeet Baluja , Dave Marwood , Nick Johnston , Michele Covell

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

The emerging Learned Compression (LC) replaces the traditional codec modules with Deep Neural Networks (DNN), which are trained end-to-end for rate-distortion performance. This approach is considered as the future of image/video…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Farhad Pakdaman , Moncef Gabbouj

Learned image compression have attracted considerable interests in recent years. It typically comprises an analysis transform, a synthesis transform, quantization and an entropy coding model. The analysis transform and synthesis transform…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Yanbo Gao , Meng Fu , Shuai Li , Chong Lv , Xun Cai , Hui Yuan , Mao Ye

Existing learning-based stereo image codec adopt sophisticated transformation with simple entropy models derived from single image codecs to encode latent representations. However, those entropy models struggle to effectively capture the…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Xinjie Zhang , Shenyuan Gao , Zhening Liu , Jiawei Shao , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Jun Zhang

In this study, we propose a simple and effective fine-tuning algorithm called "restore-from-restored", which can greatly enhance the performance of fully pre-trained image denoising networks. Many supervised denoising approaches can produce…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Seunghwan Lee , Dongkyu Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

Low-light imaging on mobile devices is typically challenging due to insufficient incident light coming through the relatively small aperture, resulting in a low signal-to-noise ratio. Most of the previous works on low-light image processing…

Image and Video Processing · Electrical Eng. & Systems 2022-09-05 Yucheng Lu , Seung-Won Jung

Transformers-based methods have achieved significant performance in image deraining as they can model the non-local information which is vital for high-quality image reconstruction. In this paper, we find that most existing Transformers…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xiang Chen , Hao Li , Mingqiang Li , Jinshan Pan

This paper studies 3D low-dose computed tomography (CT) imaging. Although various deep learning methods were developed in this context, typically they focus on 2D images and perform denoising due to low-dose and deblurring for…

Image and Video Processing · Electrical Eng. & Systems 2024-01-10 Zhihao Chen , Chuang Niu , Qi Gao , Ge Wang , Hongming Shan

Recently, denoising methods based on supervised learning have exhibited promising performance. However, their reliance on external datasets containing noisy-clean image pairs restricts their applicability. To address this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jaekyun Ko , Sanghwan Lee

During the acquisition of an image from its source, noise always becomes an integral part of it. Various algorithms have been used in past to denoise the images. Image denoising still has scope for improvement. Visual information…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Santosh Paudel , Ajay Kumar Shrestha , Pradip Singh Maharjan , Rameshwar Rijal

We propose a learned-structured unfolding neural network for the problem of compressive sparse multichannel blind-deconvolution. In this problem, each channel's measurements are given as convolution of a common source signal and sparse…

Signal Processing · Electrical Eng. & Systems 2021-02-15 Bahareh Tolooshams , Satish Mulleti , Demba Ba , Yonina C. Eldar

With the increasing popularity of deep learning in image processing, many learned lossless image compression methods have been proposed recently. One group of algorithms that have shown good performance are based on learned pixel-based…

Image and Video Processing · Electrical Eng. & Systems 2022-12-27 Fatih Kamisli

Transformers process tokens in parallel but are temporally shallow: at position $t$, each layer attends to key-value pairs computed based on the previous layer, yielding a depth capped by the number of layers. Recurrent models offer…

Machine Learning · Computer Science 2026-04-24 Costin-Andrei Oncescu , Depen Morwani , Samy Jelassi , Alexandru Meterez , Mujin Kwun , Sham Kakade