English
Related papers

Related papers: GRFormer: Grouped Residual Self-Attention for Ligh…

200 papers

Given the broad application of infrared technology across diverse fields, there is an increasing emphasis on investigating super-resolution techniques for infrared images within the realm of deep learning. Despite the impressive results of…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Feiwei Qin , Kang Yan , Changmiao Wang , Ruiquan Ge , Yong Peng , Kai Zhang

Image restoration and spectral reconstruction are longstanding computer vision tasks. Currently, CNN-transformer hybrid models provide state-of-the-art performance for these tasks. The key common ingredient in the architectural designs of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Zaid Ilyas , Naveed Akhtar , David Suter , Syed Zulqarnain Gilani

Deep learning methods have shown outstanding performance in many applications, including single-image super-resolution (SISR). With residual connection architecture, deeply stacked convolutional neural networks provide a substantial…

Image and Video Processing · Electrical Eng. & Systems 2022-01-02 Karam Park , Jae Woong Soh , Nam Ik Cho

Image restoration has witnessed significant advancements with the development of deep learning models. Transformer-based models, particularly those using window-based self-attention, have become a dominant force. However, their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu , Liqiang Nie

Transformer-based methods have recently achieved significant success in 3D human pose estimation, owing to their strong ability to model long-range dependencies. However, relying solely on the global attention mechanism is insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guangsheng Xu , Guoyi Zhang , Lejia Ye , Shuwei Gan , Xiaohu Zhang , Xia Yang

Super-resolution plays an essential role in medical imaging because it provides an alternative way to achieve high spatial resolutions and image quality with no extra acquisition costs. In the past few decades, the rapid development of deep…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Jin Zhu , Guang Yang , Pietro Lio

Deep learning based methods have achieved significant success in the task of single image reflection removal (SIRR). However, the majority of these methods are focused on High-Definition/Standard-Definition (HD/SD) images, while ignoring…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Zhenyuan Zhang , Zhenbo Song , Kaihao Zhang , Zhaoxin Fan , Jianfeng Lu

Single Image Super-Resolution (SISR) is a fundamental computer vision task that aims to reconstruct a high-resolution (HR) image from a low-resolution (LR) input. Transformer-based methods have achieved remarkable performance by modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Chunyu Meng , Wei Long , Shuhang Gu

Video super-resolution (VSR) aims to estimate a high-resolution (HR) frame from a low-resolution (LR) frames. The key challenge for VSR lies in the effective exploitation of spatial correlation in an intra-frame and temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

Despite the exciting performance, Transformer is criticized for its excessive parameters and computation cost. However, compressing Transformer remains as an open problem due to its internal complexity of the layer designs, i.e., Multi-Head…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Gen Luo , Yiyi Zhou , Xiaoshuai Sun , Yan Wang , Liujuan Cao , Yongjian Wu , Feiyue Huang , Rongrong Ji

Recently, Transformer-based methods have achieved impressive results in single image super-resolution (SISR). However, the lack of locality mechanism and high complexity limit their application in the field of super-resolution (SR). To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ling Zheng , Jinchen Zhu , Jinpeng Shi , Shizhuang Weng

Transformers have demonstrated a competitive performance across a wide range of vision tasks, while it is very expensive to compute the global self-attention. Many methods limit the range of attention within a local window to reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Zhenzhe Hechen , Wei Huang , Yixin Zhao

Transformers, renowned for their self-attention mechanism, have achieved state-of-the-art performance across various tasks in natural language processing, computer vision, time-series modeling, etc. However, one of the challenges with deep…

Machine Learning · Computer Science 2024-11-04 Jeongwhan Choi , Hyowon Wi , Jayoung Kim , Yehjin Shin , Kookjin Lee , Nathaniel Trask , Noseong Park

We propose an effective lightweight dynamic local and global self-attention network (DLGSANet) to solve image super-resolution. Our method explores the properties of Transformers while having low computational costs. Motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Xiang Li , Jinshan Pan , Jinhui Tang , Jiangxin Dong

Parameter-efficient fine-tuning for pre-trained Vision Transformers aims to adeptly tailor a model to downstream tasks by learning a minimal set of new adaptation parameters while preserving the frozen majority of pre-trained parameters.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Wei Dong , Xing Zhang , Bihui Chen , Dawei Yan , Zhijun Lin , Qingsen Yan , Peng Wang , Yang Yang

The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Li Ke , Liu Yukai

As the core building block of vision transformers, attention is a powerful tool to capture long-range dependency. However, such power comes at a cost: it incurs a huge computation burden and heavy memory footprint as pairwise token…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Lei Zhu , Xinjiang Wang , Zhanghan Ke , Wayne Zhang , Rynson Lau

Transformer architectures prominently lead single-image super-resolution (SISR) benchmarks, reconstructing high-resolution (HR) images from their low-resolution (LR) counterparts. Their strong representative power, however, comes with a…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Björn Möller , Lucas Görnhardt , Tim Fingscheidt

Since context modeling is critical for estimating depth from a single image, researchers put tremendous effort into obtaining global context. Many global manipulations are designed for traditional CNN-based architectures to overcome the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Chang Shu , Ziming Chen , Lei Chen , Kuan Ma , Minghui Wang , Haibing Ren

Transformer-based methods have achieved remarkable results in image super-resolution tasks because they can capture non-local dependencies in low-quality input images. However, this feature-intensive modeling approach is computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wei Long , Xingyu Zhou , Leheng Zhang , Shuhang Gu