English
Related papers

Related papers: WaveHiT-SR: Hierarchical Wavelet Network for Effic…

200 papers

Recently, masked image modeling (MIM) has offered a new methodology of self-supervised pre-training of vision transformers. A key idea of efficient implementation is to discard the masked image patches (or tokens) throughout the target…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Xiaosong Zhang , Yunjie Tian , Wei Huang , Qixiang Ye , Qi Dai , Lingxi Xie , Qi Tian

Low-light images suffer from complex degradation, and existing enhancement methods often encode all degradation factors within a single latent space. This leads to highly entangled features and strong black-box characteristics, making the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Shuangli Du , Siming Yan , Zhenghao Shi , Zhenzhen You , Lu Sun

We present Multiscale Vision Transformers (MViT) for video and image recognition, by connecting the seminal idea of multiscale feature hierarchies with transformer models. Multiscale Transformers have several channel-resolution scale…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Haoqi Fan , Bo Xiong , Karttikeya Mangalam , Yanghao Li , Zhicheng Yan , Jitendra Malik , Christoph Feichtenhofer

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

Due to its deficiency in prior knowledge (inductive bias), Vision Transformer (ViT) requires pre-training on large-scale datasets to perform well. Moreover, the growing layers and parameters in ViT models impede their applicability to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Chenhao Xu , Chang-Tsun Li , Chee Peng Lim , Douglas Creighton

Vision transformers have gained significant attention and achieved state-of-the-art performance in various computer vision tasks, including image classification, instance segmentation, and object detection. However, challenges remain in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Badri N. Patro , Vijay Srinivas Agneeswaran

In many computer vision applications, obtaining images of high resolution in both the spatial and spectral domains are equally important. However, due to hardware limitations, one can only expect to acquire images of high resolution in…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Ying Qu , Hairong Qi , Chiman Kwan

Recent progress in single-image super-resolution (SISR) has achieved remarkable performance, yet the computational costs of these methods remain a challenge for deployment on resource-constrained devices. In particular, transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Gang Wu , Junjun Jiang , Junpeng Jiang , Xianming Liu

Face Super-Resolution (FSR) aims to recover high-resolution (HR) face images from low-resolution (LR) ones. Despite the progress made by convolutional neural networks in FSR, the results of existing approaches are not ideal due to their low…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Hao Liu , Yang Yang , Yunxia Liu

Transformer architectures have exhibited remarkable performance in image super-resolution (SR). Since the quadratic computational complexity of the self-attention (SA) in Transformer, existing methods tend to adopt SA in a local region to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zheng Chen , Yulun Zhang , Jinjin Gu , Linghe Kong , Xiaokang Yang

Although many recent works have made advancements in the image restoration (IR) field, they often suffer from an excessive number of parameters. Another issue is that most Transformer-based IR methods focus only on either local or global…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Haram Choi , Cheolwoong Na , Jihyeon Oh , Seungjae Lee , Jinseop Kim , Subeen Choe , Jeongmin Lee , Taehoon Kim , Jihoon Yang

This paper presents a novel Diffusion-Wavelet (DiWa) approach for Single-Image Super-Resolution (SISR). It leverages the strengths of Denoising Diffusion Probabilistic Models (DDPMs) and Discrete Wavelet Transformation (DWT). By enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Brian Moser , Stanislav Frolov , Federico Raue , Sebastian Palacio , Andreas Dengel

Very recently, Window-based Transformers, which computed self-attention within non-overlapping local windows, demonstrated promising results on image classification, semantic segmentation, and object detection. However, less study has been…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Zilong Huang , Youcheng Ben , Guozhong Luo , Pei Cheng , Gang Yu , Bin Fu

The Internet has turned the entire world into a small village;this is because it has made it possible to share millions of images and videos. However, sending and receiving a huge amount of data is considered to be a main challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Hassan Mohamed Muhi-Aldeen , Asma A. Abdulrahman , Jabbar Abed Eleiwy , Fouad S. Tahir , Yurii Khlaponin

High-resolution images enable neural networks to learn richer visual representations. However, this improved performance comes at the cost of growing computational complexity, hindering their usage in latency-sensitive applications. As not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Xuanyao Chen , Zhijian Liu , Haotian Tang , Li Yi , Hang Zhao , Song Han

Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. - 256x256, 384384). For gigapixel…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Richard J. Chen , Chengkuan Chen , Yicong Li , Tiffany Y. Chen , Andrew D. Trister , Rahul G. Krishnan , Faisal Mahmood

Lightweight and efficiency are critical drivers for the practical application of image super-resolution (SR) algorithms. We propose a simple and effective approach, ShuffleMixer, for lightweight image super-resolution that explores large…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Long Sun , Jinshan Pan , Jinhui Tang

Learned Image Compression (LIC) models have achieved superior rate-distortion performance than traditional codecs. Existing LIC models use CNN, Transformer, or Mixed CNN-Transformer as basic blocks. However, limited by the shifted window…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Heng Xu , Bowen Hai , Yushun Tang , Zhihai He

Remote sensing image super-resolution (RSISR) plays a vital role in enhancing spatial detials and improving the quality of satellite imagery. Recently, Transformer-based models have shown competitive performance in RSISR. To mitigate the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Yuting Lu , Lingtong Min , Binglu Wang , Le Zheng , Xiaoxu Wang , Yongqiang Zhao , Teng Long

The tradeoff between receptive field size and efficiency is a crucial issue in low level vision. Plain convolutional networks (CNNs) generally enlarge the receptive field at the expense of computational cost. Recently, dilated filtering has…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Pengju Liu , Hongzhi Zhang , Kai Zhang , Liang Lin , Wangmeng Zuo