English
Related papers

Related papers: Restormer: Efficient Transformer for High-Resoluti…

200 papers

The increasing demand for high image quality in mobile devices brings forth the need for better computational enhancement techniques, and image denoising in particular. At the same time, the images captured by these devices can be…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Tal Remez , Or Litany , Raja Giryes , Alex M. Bronstein

We present Reversible Vision Transformers, a memory efficient architecture design for visual recognition. By decoupling the GPU memory requirement from the depth of the model, Reversible Vision Transformers enable scaling up architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Karttikeya Mangalam , Haoqi Fan , Yanghao Li , Chao-Yuan Wu , Bo Xiong , Christoph Feichtenhofer , Jitendra Malik

Image denoising is a fundamental problem in image processing whose primary objective is to remove the noise while preserving the original image structure. In this work, we proposed a new architecture for image denoising. We have used…

Image and Video Processing · Electrical Eng. & Systems 2019-03-25 Sutanu Bera , Avisek Lahiri , Prabir Kumar Biswas

Several recent works have addressed the ability of deep learning to disclose rich, hierarchical and discriminative models for the most diverse purposes. Specifically in the super-resolution field, Convolutional Neural Networks (CNNs) using…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Eduardo Ribeiro , Andreas Uhl , Fernando Alonso-Fernandez

Convolutional Neural Networks (CNNs) have demonstrated great results for the single-image super-resolution (SISR) problem. Currently, most CNN algorithms promote deep and computationally expensive models to solve SISR. However, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Vandit Jain , Prakhar Bansal , Abhinav Kumar Singh , Rajeev Srivastava

Phoneme recognition is a very important part of speech recognition that requires the ability to extract phonetic features from multiple frames. In this paper, we compare and analyze CNN, RNN, Transformer, and Conformer models using phoneme…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-04 Kyuhong Shim , Wonyong Sung

In this paper, we propose a novel convolutional neural network (CNN) architecture considering both local and global features for image enhancement. Most conventional image enhancement methods, including Retinex-based methods, cannot restore…

Image and Video Processing · Electrical Eng. & Systems 2019-05-09 Yuma Kinoshita , Hitoshi Kiya

Transfer learning improves the performance of deep learning models by initializing them with parameters pre-trained on larger datasets. Intuitively, transfer learning is more effective when pre-training is on the in-domain datasets. A…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Khaled Alrfou , Tian Zhao , Amir Kordijazi

Transformers have achieved great success in effectively processing sequential data such as text. Their architecture consisting of several attention and feedforward blocks can model relations between elements of a sequence in parallel…

Machine Learning · Computer Science 2025-02-20 Jaemu Heo , Eldor Fozilov , Hyunmin Song , Taehwan Kim

Deep convolutional neural networks (CNN) are widely used in modern artificial intelligence (AI) and smart vision systems but also limited by computation latency, throughput, and energy efficiency on a resource-limited scenario, such as…

Hardware Architecture · Computer Science 2017-09-18 Yuan Du , Li Du , Yilei Li , Junjie Su , Mau-Chung Frank Chang

This work introduces a Transformer-based image compression system. It has the flexibility to switch between the standard image reconstruction and the denoising reconstruction from a single compressed bitstream. Instead of training separate…

Image and Video Processing · Electrical Eng. & Systems 2024-02-21 Yi-Hsin Chen , Kuan-Wei Ho , Shiau-Rung Tsai , Guan-Hsun Lin , Alessandro Gnutti , Wen-Hsiao Peng , Riccardo Leonardi

Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

We present a new method for image reconstruction which replaces the projector in a projected gradient descent (PGD) with a convolutional neural network (CNN). CNNs trained as high-dimensional (image-to-image) regressors have recently been…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Harshit Gupta , Kyong Hwan Jin , Ha Q. Nguyen , Michael T. McCann , Michael Unser

The landscape of computational building blocks of efficient image restoration architectures is dominated by a combination of convolutional processing and various attention mechanisms. However, convolutional filters, while efficient, are…

Image and Video Processing · Electrical Eng. & Systems 2025-01-23 Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Qingzhong Wang , Antoni B. Chan

The layers of convolutional neural networks (CNNs) can be used to alter the resolution of their inputs, but the scaling factors are limited to integer values. However, in many image and video processing applications, the ability to resize…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Li-Heng Chen , Christos G. Bampis , Zhi Li , Chao Chen , Alan C. Bovik

Traditional image resizing methods usually work in pixel space and use various saliency measures. The challenge is to adjust the image shape while trying to preserve important content. In this paper we perform image resizing in feature…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Moab Arar , Dov Danon , Daniel Cohen-Or , Ariel Shamir

Recent works based on convolutional encoder-decoder architecture and 3DMM parameterization have shown great potential for canonical view reconstruction from a single input image. Conventional CNN architectures benefit from exploiting the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zhiqian Lin , Jiangke Lin , Lincheng Li , Yi Yuan , Zhengxia Zou

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

Adaptive image restoration models can restore images with different degradation levels at inference time without the need to retrain the model. We present an approach that is highly accurate and allows a significant reduction in the number…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Shai Aharon , Gil Ben-Artzi