English
Related papers

Related papers: HIPA: Hierarchical Patch Transformer for Single Im…

200 papers

Transformer has achieved great success in computer vision, while how to split patches in an image remains a problem. Existing methods usually use a fixed-size patch embedding which might destroy the semantics of objects. To address this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Zhiyang Chen , Yousong Zhu , Chaoyang Zhao , Guosheng Hu , Wei Zeng , Jinqiao Wang , Ming Tang

Recent work has shown the potential of transformers for computer vision applications. An image is first partitioned into patches, which are then used as input tokens for the attention mechanism. Due to the expensive quadratic cost of the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Shelly Sheynin , Sagie Benaim , Adam Polyak , Lior Wolf

Transformer-based methods have shown impressive performance in image restoration tasks, such as image super-resolution and denoising. However, we find that these networks can only utilize a limited spatial range of input information through…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiangyu Chen , Xintao Wang , Wenlong Zhang , Xiangtao Kong , Yu Qiao , Jiantao Zhou , Chao Dong

Transformer-based approaches have achieved superior performance in image restoration, since they can model long-term dependencies well. However, the limitation in capturing local information restricts their capacity to remove degradations.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shihao Zhou , Duosheng Chen , Jinshan Pan , Jufeng Yang

Image pyramids are widely adopted in top-performing methods to obtain multi-scale features for precise visual perception and understanding. However, current image pyramids use the same large-scale model to process multiple resolutions of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Zhaokai Wang , Xizhou Zhu , Xue Yang , Gen Luo , Hao Li , Changyao Tian , Wenhan Dou , Junqi Ge , Lewei Lu , Yu Qiao , Jifeng Dai

We present a new encoder-decoder Vision Transformer architecture, Patcher, for medical image segmentation. Unlike standard Vision Transformers, it employs Patcher blocks that segment an image into large patches, each of which is further…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Yanglan Ou , Ye Yuan , Xiaolei Huang , Stephen T. C. Wong , John Volpi , James Z. Wang , Kelvin Wong

Recent advancements in learned image compression (LIC) methods have demonstrated superior performance over traditional hand-crafted codecs. These learning-based methods often employ convolutional neural networks (CNNs) or Transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Hamidreza Soltani , Erfan Ghasemi

Pansharpening aims to fuse a registered high-resolution panchromatic image (PAN) with a low-resolution hyperspectral image (LR-HSI) to generate an enhanced HSI with high spectral and spatial resolution. Existing pansharpening approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Wele Gedara Chaminda Bandara , Vishal M. Patel

Image restoration is a long-standing low-level vision problem, e.g., deblurring and deraining. In the process of image restoration, it is necessary to consider not only the spatial details and contextual information of restoration to ensure…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Hu Gao , Depeng Dang

The main challenge of single image super resolution (SISR) is the recovery of high frequency details such as tiny textures. However, most of the state-of-the-art methods lack specific modules to identify high frequency areas, causing the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Yuan Liu , Yuancheng Wang , Nan Li , Xu Cheng , Yifeng Zhang , Yongming Huang , Guojun Lu

Vision Transformers (ViTs) take all the image patches as tokens and construct multi-head self-attention (MHSA) among them. Complete leverage of these image tokens brings redundant computations since not all the tokens are attentive in MHSA.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Youwei Liang , Chongjian Ge , Zhan Tong , Yibing Song , Jue Wang , Pengtao Xie

Both local details and global context are crucial in medical image segmentation, and effectively integrating them is essential for achieving high accuracy. However, existing mainstream methods based on CNN-Transformer hybrid architectures…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Dayu Tan , Zhenpeng Xu , Yansen Su , Xin Peng , Chunhou Zheng , Weimin Zhong

In recent years, attention mechanisms have been exploited in single image super-resolution (SISR), achieving impressive reconstruction results. However, these advancements are still limited by the reliance on simple training strategies and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yuxuan Jiang , Chengxi Zeng , Siyue Teng , Fan Zhang , Xiaoqing Zhu , Joel Sole , David Bull

Vision transformers have achieved remarkable progress in vision tasks such as image classification and detection. However, in instance-level image retrieval, transformers have not yet shown good performance compared to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Chull Hwan Song , Jooyoung Yoon , Shunghyun Choi , Yannis Avrithis

Deep learning-based methods have been extensively explored for automatic building mapping from high-resolution remote sensing images over recent years. While most building mapping models produce vector polygons of buildings for geographic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mingming Zhang , Qingjie Liu , Yunhong Wang

Recent advances have demonstrated the powerful capability of transformer architecture in image restoration. However, our analysis indicates that existing transformerbased methods can not establish both exact global and local dependencies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhijun Tu , Kunpeng Du , Hanting Chen , Hailing Wang , Wei Li , Jie Hu , Yunhe Wang

The landscape of computational building blocks of efficient image restoration architectures is dominated by a combination of convolutional processing and various attention mechanisms. However, convolutional filters, while efficient, are…

Image and Video Processing · Electrical Eng. & Systems 2025-01-23 Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

Image superresolution involves the processing of an image sequence to generate a still image with higher resolution. Classical approaches, such as bayesian MAP methods, require iterative minimization procedures, with high computational…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Carlos Miravet , Francisco B. Rodriguez

In this work, we introduce SPFormer, a novel Vision Transformer enhanced by superpixel representation. Addressing the limitations of traditional Vision Transformers' fixed-size, non-adaptive patch partitioning, SPFormer employs superpixels…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Jieru Mei , Liang-Chieh Chen , Alan Yuille , Cihang Xie

The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Li Ke , Liu Yukai