English
Related papers

Related papers: SPFormer: Enhancing Vision Transformer with Superp…

200 papers

Image deblurring continues to achieve impressive performance with the development of generative models. Nonetheless, there still remains a displeasing problem if one wants to improve perceptual quality and quantitative scores of recovered…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Pengwei Liang , Junjun Jiang , Xianming Liu , Jiayi Ma

Although numerous solutions have been proposed for image super-resolution, they are usually incompatible with low-power devices with many computational and memory constraints. In this paper, we address this problem by proposing a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Long Sun , Jiangxin Dong , Jinhui Tang , Jinshan Pan

Hyperspectral image classification (HSIC) has gained significant attention because of its potential in analyzing high-dimensional data with rich spectral and spatial information. In this work, we propose the Differential Spatial-Spectral…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Muhammad Ahmad , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Silvia Liberata Ullo

Extensive work has demonstrated the effectiveness of Vision Transformers. The plain Vision Transformer tends to obtain multi-scale features by selecting fixed layers, or the last layer of features aiming to achieve higher performance in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Fangjian Lin , Yizhe Ma , Shengwei Tian

Vision Transformer (ViT) architectures traditionally employ a grid-based approach to tokenization independent of the semantic content of an image. We propose a modular superpixel tokenization strategy which decouples tokenization and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Marius Aasan , Odd Kolbjørnsen , Anne Schistad Solberg , Adín Ramirez Rivera

Prototypical part network (ProtoPNet) has drawn wide attention and boosted many follow-up studies due to its self-explanatory property for explainable artificial intelligence (XAI). However, when directly applying ProtoPNet on vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengqi Xue , Qihan Huang , Haofei Zhang , Jingwen Hu , Jie Song , Mingli Song , Canghong Jin

We introduce dense vision transformers, an architecture that leverages vision transformers in place of convolutional networks as a backbone for dense prediction tasks. We assemble tokens from various stages of the vision transformer into…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 René Ranftl , Alexey Bochkovskiy , Vladlen Koltun

This paper presents a new vision Transformer, called Swin Transformer, that capably serves as a general-purpose backbone for computer vision. Challenges in adapting Transformer from language to vision arise from differences between the two…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ze Liu , Yutong Lin , Yue Cao , Han Hu , Yixuan Wei , Zheng Zhang , Stephen Lin , Baining Guo

Spiking Neural Networks (SNNs) offer notable advantages in biological plausibility and energy efficiency, making them promising candidates for building low-power Transformers. However, existing Spiking Transformers largely adhere to a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zequan Xie , Weiming Zeng , Yunhua Chen , Sichang Ling , Tongyang Chen , Jinsheng Xiao

Self-supervised representation learning methods often fail to learn subtle or complex features, which can be dominated by simpler patterns which are much easier to learn. This limitation is particularly problematic in applications to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Lucas Farndale , Paul Henderson , Edward W Roberts , Ke Yuan

Benefited from the deep learning, image Super-Resolution has been one of the most developing research fields in computer vision. Depending upon whether using a discriminator or not, a deep convolutional neural network can provide an image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Zhi-Song Liu , Wan-Chi Siu , Li-Wen Wang , Chu-Tak Li , Marie-Paule Cani , Yui-Lam Chan

Image Captioning is an important Language and Vision task that finds application in a variety of contexts, ranging from healthcare to autonomous vehicles. As many real-world applications rely on devices with limited resources, much effort…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jia Cheng Hu , Roberto Cavicchioli , Alessandro Capotondi

Along with predictive performance and runtime speed, reliability is a key requirement for real-world semantic segmentation. Reliability encompasses robustness, predictive uncertainty and reduced bias. To improve reliability, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Gianni Franchi , Nacim Belkhir , Mai Lan Ha , Yufei Hu , Andrei Bursuc , Volker Blanz , Angela Yao

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

Vision transformers have demonstrated remarkable success in classification by leveraging global self-attention to capture long-range dependencies. However, this same mechanism can obscure fine-grained spatial details crucial for tasks such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sina Hajimiri , Farzad Beizaee , Fereshteh Shakeri , Christian Desrosiers , Ismail Ben Ayed , Jose Dolz

Hyperspectral image segmentation is crucial for many fields such as agriculture, remote sensing, biomedical imaging, battlefield sensing and astronomy. However, the challenge of hyper and multi spectral imaging is its large data footprint.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Jackson Arnold , Sophia Rossi , Chloe Petrosino , Ethan Mitchell , Sanjeev J. Koppal

This paper introduces an approach, named DFormer, for universal image segmentation. The proposed DFormer views universal image segmentation task as a denoising process using a diffusion model. DFormer first adds various levels of Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Hefeng Wang , Jiale Cao , Rao Muhammad Anwer , Jin Xie , Fahad Shahbaz Khan , Yanwei Pang

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

The accurate analysis of medical images is vital for diagnosing and predicting medical conditions. Traditional approaches relying on radiologists and clinicians suffer from inconsistencies and missed diagnoses. Computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yulong Shisu , Susano Mingwin , Yongshuai Wanwag , Zengqiang Chenso , Sunshin Huing

Superpixels have long been used in image simplification to enable more efficient data processing and storage. However, despite their computational potential, their irregular spatial distribution has often forced deep learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jack Roberts , Jeova Farias Sales Rocha Neto