English
Related papers

Related papers: GRFormer: Grouped Residual Self-Attention for Ligh…

200 papers

In this paper we tackle Image Super Resolution (ISR), using recent advances in Visual Auto-Regressive (VAR) modeling. VAR iteratively estimates the residual in latent space between gradually increasing image scales, a process referred to as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Enrique Sanchez , Isma Hadji , Adrian Bulat , Christos Tzelepis , Brais Martinez , Georgios Tzimiropoulos

Transformers have emerged as a preferred model for many tasks in natural langugage processing and vision. Recent efforts on training and deploying Transformers more efficiently have identified many strategies to approximate the…

Machine Learning · Computer Science 2022-07-22 Zhanpeng Zeng , Sourav Pal , Jeffery Kline , Glenn M Fung , Vikas Singh

Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the over-smoothing problem in deep GNNs, global attention was…

Machine Learning · Computer Science 2025-12-17 Chaohao Yuan , Zhenjie Song , Ercan Engin Kuruoglu , Kangfei Zhao , Yang Liu , Deli Zhao , Hong Cheng , Yu Rong

While lightweight ViT framework has made tremendous progress in image super-resolution, its uni-dimensional self-attention modeling, as well as homogeneous aggregation scheme, limit its effective receptive field (ERF) to include more…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Hang Wang , Xuanhong Chen , Bingbing Ni , Yutian Liu , Jinfan Liu

General-purpose super-resolution models, particularly Vision Transformers, have achieved remarkable success but exhibit fundamental inefficiencies in common infrared imaging scenarios like surveillance and autonomous driving, which operate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Youngwan Jin , Incheol Park , Yagiz Nalcakan , Hyeongjin Ju , Sanghyeop Yeo , Shiho Kim

Vision Transformers with various attention modules have demonstrated superior performance on vision tasks. While using sparsity-adaptive attention, such as in DAT, has yielded strong results in image classification, the key-value pairs…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Nguyen Huu Bao Long , Chenyu Zhang , Yuzhi Shi , Tsubasa Hirakawa , Takayoshi Yamashita , Tohgoroh Matsui , Hironobu Fujiyoshi

Transformer-based architectures have demonstrated remarkable success across various domains, but their deployment on edge devices remains challenging due to high memory and computational demands. In this paper, we introduce a novel Reuse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Seul-Ki Yeom , Tae-Ho Kim

In this paper, we propose GuideSR, a novel single-step diffusion-based image super-resolution (SR) model specifically designed to enhance image fidelity. Existing diffusion-based SR approaches typically adapt pre-trained generative models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-02 Aditya Arora , Zhengzhong Tu , Yufei Wang , Ruizheng Bai , Jian Wang , Sizhuo Ma

Skeleton-based action recognition (SAR) has achieved impressive progress with transformer architectures. However, existing methods often rely on complex module compositions and heavy designs, leading to increased parameter counts, high…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Wenhan Wu , Zhishuai Guo , Chen Chen , Aidong Lu

Reference-based image super-resolution (RefSR) aims to exploit auxiliary reference (Ref) images to super-resolve low-resolution (LR) images. Recently, RefSR has been attracting great attention as it provides an alternative way to surpass…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jiezhang Cao , Jingyun Liang , Kai Zhang , Yawei Li , Yulun Zhang , Wenguan Wang , Luc Van Gool

Existing real-world super-resolution (RSR) methods based on generative priors have achieved remarkable progress in producing high-quality and globally consistent reconstructions. However, they often struggle to recover fine-grained details…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Zixin Guo , Kai Zhao , Luyan Zhang

Recently, Transformer-based architecture has been introduced into single image deraining task due to its advantage in modeling non-local information. However, existing approaches tend to integrate global features based on a dense…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhentao Fan , Hongming Chen , Yufeng Li

By developing sophisticated image priors or designing deep(er) architectures, a variety of image Super-Resolution (SR) approaches have been proposed recently and achieved very promising performance. A natural question that arises is whether…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Junjun Jiang , Yi Yu , Zheng Wang , Suhua Tang , Ruimin Hu , Jiayi Ma

In the field of single image super-resolution (SISR), transformer-based models, have demonstrated significant advancements. However, the potential and efficiency of these models in applied fields such as real-world image super-resolution…

Image and Video Processing · Electrical Eng. & Systems 2025-02-26 Alireza Aghelan , Ali Amiryan , Abolfazl Zarghani , Modjtaba Rouhani

Recently, Transformers have shown promising performance in various vision tasks. To reduce the quadratic computation complexity caused by the global self-attention, various methods constrain the range of attention within a local region to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Sitong Wu , Tianyi Wu , Haoru Tan , Guodong Guo

Transformer-based methods have exhibited remarkable potential in single image super-resolution (SISR) by effectively extracting long-range dependencies. However, most of the current research in this area has prioritized the design of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Ao Li , Le Zhang , Yun Liu , Ce Zhu

Single image super-resolution (SISR) is of great importance as a low-level computer vision task. The fast development of Generative Adversarial Network (GAN) based deep learning architectures realises an efficient and effective SISR to…

Image and Video Processing · Electrical Eng. & Systems 2019-01-14 Jin Zhu , Guang Yang , Pietro Lio

Transformers have achieved remarkable results in single-image super-resolution (SR). However, the challenge of balancing model performance and complexity has hindered their application in lightweight SR (LSR). To tackle this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Jinpeng Shi , Hui Li , Tianle Liu , Yulong Liu , Mingjian Zhang , Jinchen Zhu , Ling Zheng , Shizhuang Weng

Deep neural networks have greatly promoted the performance of single image super-resolution (SISR). Conventional methods still resort to restoring the single high-resolution (HR) solution only based on the input of image modality. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Chenxi Ma , Bo Yan , Qing Lin , Weimin Tan , Siming Chen

An important development direction in the Single-Image Super-Resolution (SISR) algorithms is to improve the efficiency of the algorithms. Recently, efficient Super-Resolution (SR) research focuses on reducing model complexity and improving…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chengxu Wu , Qinrui Fan , Shu Hu , Xi Wu , Xin Wang , Jing Hu