English
Related papers

Related papers: Restormer: Efficient Transformer for High-Resoluti…

200 papers

Deep Convolutional Neural Networks (CNNs) are powerful models that have achieved excellent performance on difficult computer vision tasks. Although CNNs perform well whenever large labeled training samples are available, they work badly on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Zhouyong Liu , Shun Luo , Wubin Li , Jingben Lu , Yufan Wu , Shilei Sun , Chunguo Li , Luxi Yang

Is it possible to recover an image from its noisy version using convolutional neural networks? This is an interesting problem as convolutional layers are generally used as feature detectors for tasks like classification, segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Nithish Divakar , R. Venkatesh Babu

Convolutional Neural Networks (CNNs) have emerged as highly successful tools for image generation, recovery, and restoration. A major contributing factor to this success is that convolutional networks impose strong prior assumptions about…

Machine Learning · Computer Science 2020-02-25 Reinhard Heckel , Mahdi Soltanolkotabi

Learning powerful feature representations for image retrieval has always been a challenging task in the field of remote sensing. Traditional methods focus on extracting low-level hand-crafted features which are not only time-consuming but…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Weixun Zhou , Shawn Newsam , Congmin Li , Zhenfeng Shao

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

Compared to CNN-based methods, Transformer-based methods achieve impressive image restoration outcomes due to their abilities to model remote dependencies. However, how to apply Transformer-based methods to the field of blind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Qingguo Liu , Pan Gao , Kang Han , Ningzhong Liu , Wei Xiang

Convolutional Neural Networks (CNNs) have advanced existing medical systems for automatic disease diagnosis. However, there are still concerns about the reliability of deep medical diagnosis systems against the potential threats of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Omid Nejati Manzari , Hamid Ahmadabadi , Hossein Kashiani , Shahriar B. Shokouhi , Ahmad Ayatollahi

Image restoration is a critical task in low-level computer vision, aiming to restore high-quality images from degraded inputs. Various models, such as convolutional neural networks (CNNs), generative adversarial networks (GANs),…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuan Shi , Bin Xia , Xiaoyu Jin , Xing Wang , Tianyu Zhao , Xin Xia , Xuefeng Xiao , Wenming Yang

Restoring images affected by various types of degradation, such as noise, blur, or improper exposure, remains a significant challenge in computer vision. While recent trends favor complex monolithic all-in-one architectures, these models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Joanna Wiekiera , Martyna Zur

Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this work, we propose a data driven non-iterative algorithm to overcome the shortcomings of earlier…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Suhas Lohit , Kuldeep Kulkarni , Ronan Kerviche , Pavan Turaga , Amit Ashok

Transformer model architectures have garnered immense interest lately due to their effectiveness across a range of domains like language, vision and reinforcement learning. In the field of natural language processing for example,…

Machine Learning · Computer Science 2022-03-15 Yi Tay , Mostafa Dehghani , Dara Bahri , Donald Metzler

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

Transformers have demonstrated their effectiveness in image restoration tasks. Existing Transformer architectures typically comprise two essential components: multi-head self-attention and feed-forward network (FFN). The former captures…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Cong Wang , Jinshan Pan , Yeying Jin , Liyan Wang , Wei Wang , Gang Fu , Wenqi Ren , Xiaochun Cao

We propose a deep learning method for single image super-resolution (SR). Our method directly learns an end-to-end mapping between the low/high-resolution images. The mapping is represented as a deep convolutional neural network (CNN) that…

Computer Vision and Pattern Recognition · Computer Science 2015-08-03 Chao Dong , Chen Change Loy , Kaiming He , Xiaoou Tang

Understanding the mechanisms underlying deep neural networks remains a fundamental challenge in machine learning and computer vision. One promising, yet only preliminarily explored approach, is feature inversion, which attempts to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Jan Rathjens , Shirin Reyhanian , David Kappel , Laurenz Wiskott

In this work, we address the problem of improvement of robustness of feature representations learned using convolutional neural networks (CNNs) to image deformation. We argue that higher moment statistics of feature distributions could be…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Recently, learned image compression methods have outperformed traditional hand-crafted ones including BPG. One of the keys to this success is learned entropy models that estimate the probability distribution of the quantized latent…

Image and Video Processing · Electrical Eng. & Systems 2022-07-22 Jun-Hyuk Kim , Byeongho Heo , Jong-Seok Lee

Large Transformer models routinely achieve state-of-the-art results on a number of tasks but training these models can be prohibitively costly, especially on long sequences. We introduce two techniques to improve the efficiency of…

Machine Learning · Computer Science 2020-02-19 Nikita Kitaev , Łukasz Kaiser , Anselm Levskaya

We present a fully convolutional network(FCN) based approach for color image restoration. FCNs have recently shown remarkable performance for high-level vision problem like semantic segmentation. In this paper, we investigate if FCN models…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Subhajit Chaudhury , Hiya Roy