English
Related papers

Related papers: Lightweight Structure-aware Transformer Network fo…

200 papers

Recent progress in single-image super-resolution (SISR) has achieved remarkable performance, yet the computational costs of these methods remain a challenge for deployment on resource-constrained devices. In particular, transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Gang Wu , Junjun Jiang , Junpeng Jiang , Xianming Liu

Vision Transformer (ViT) has achieved remarkable results in object detection for synthetic aperture radar (SAR) images, owing to its exceptional ability to extract global features. However, it struggles with the extraction of multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yang Zhang , Jingyi Cao , Yanan You , Yuanyuan Qiao

The integration of Convolutional Neural Network (ConvNet) and Transformer has emerged as a strong candidate for image registration, leveraging the strengths of both models and a large parameter space. However, this hybrid model, treating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yufeng Zhou , Wenming Cao

Transformers exhibit great advantages in handling computer vision tasks. They model image classification tasks by utilizing a multi-head attention mechanism to process a series of patches consisting of split images. However, for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Haichao Zhang , Kuangrong Hao , Witold Pedrycz , Lei Gao , Xuesong Tang , Bing Wei

Transformer-based approaches have revolutionized image super-resolution by modeling long-range dependencies. However, the quadratic computational complexity of vanilla self-attention mechanisms poses significant challenges, often leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Dinh Phu Tran , Thao Do , Saad Wazir , Seongah Kim , Seon Kwon Kim , Daeyoung Kim

Due to spatial redundancy in remote sensing images, sparse tokens containing rich information are usually involved in self-attention (SA) to reduce the overall token numbers within the calculation, avoiding the high computational cost issue…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Wentao Jiang , Jing Zhang , Di Wang , Qiming Zhang , Zengmao Wang , Bo Du

The Transformer architecture has achieved significant success in natural language processing, motivating its adaptation to computer vision tasks. Unlike convolutional neural networks, vision transformers inherently capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zherui Zhang , Rongtao Xu , Jie Zhou , Changwei Wang , Xingtian Pei , Wenhao Xu , Jiguang Zhang , Li Guo , Longxiang Gao , Wenbo Xu , Shibiao Xu

Image restoration (IR) is a long-standing task to recover a high-quality image from its corrupted observation. Recently, transformer-based algorithms and some attention-based convolutional neural networks (CNNs) have presented promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Fangwei Hao , Ji Du , Weiyun Liang , Jing Xu , Xiaoxuan Xu

The deep learning model Transformer has achieved remarkable success in the hyperspectral image (HSI) restoration tasks by leveraging Spectral and Spatial Self-Attention (SA) mechanisms. However, applying these designs to remote sensing (RS)…

Image and Video Processing · Electrical Eng. & Systems 2023-12-13 Yo-Yu Lai , Chia-Hsiang Lin , Zi-Chao Leng

Recent deep multi-view stereo (MVS) methods have widely incorporated transformers into cascade network for high-resolution depth estimation, achieving impressive results. However, existing transformer-based methods are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Sicheng Wang , Hao Jiang , Lei Xiang

Automated change detection in remote sensing imagery is critical for urban management, environmental monitoring, and disaster assessment. While deep learning models have advanced this field, they often struggle with challenges like low…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Emad Gholibeigi , Abbas Koochari , Azadeh ZamaniFar

Table structure recognition (TSR) aims to convert tabular images into a machine-readable format, where a visual encoder extracts image features and a textual decoder generates table-representing tokens. Existing approaches use classic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 ShengYun Peng , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

Vision Transformers has demonstrated competitive performance on computer vision tasks benefiting from their ability to capture long-range dependencies with multi-head self-attention modules and multi-layer perceptron. However, calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xiangyu Chen , Qinghao Hu , Kaidong Li , Cuncong Zhong , Guanghui Wang

Convolution neural networks (CNNs) based methods have dominated the low-light image enhancement tasks due to their outstanding performance. However, the convolution operation is based on a local sliding window mechanism, which is difficult…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Keqi Wang , Ziteng Cui , Jieru Jia , Hao Xu , Ge Wu , Yin Zhuang , Lu Chen , Zhiguo Hu , Yuhua Qian

Current medical image segmentation approaches have limitations in deeply exploring multi-scale information and effectively combining local detail textures with global contextual semantic information. This results in over-segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Zhenkun Lu , Chaoyin She , Wei Wang , Qinghua Huang

Recently, the methods based on implicit neural representations have shown excellent capabilities for arbitrary-scale super-resolution (ASSR). Although these methods represent the features of an image by generating latent codes, these latent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Jinchen Zhu , Mingjian Zhang , Ling Zheng , Shizhuang Weng

Recently, Transformer architecture has been introduced into image restoration to replace convolution neural network (CNN) with surprising results. Considering the high computational complexity of Transformer with global attention, some…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zheng Chen , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

Remote sensing change detection (RSCD) is a complex task, where changes often appear at different scales and orientations. Convolutional neural networks (CNNs) are good at capturing local spatial patterns but cannot model global semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Humza Naveed , Xina Zeng , Mitch Bryson , Nagita Mehrseresht

Light field (LF) images containing information for multiple views have numerous applications, which can be severely affected by low-light imaging. Recent learning-based methods for low-light enhancement have some disadvantages, such as a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Shansi Zhang , Nan Meng , Edmund Y. Lam

Deep learning based single image super resolution (SISR) algorithms has revolutionized the overall diagnosis framework by continually improving the architectural components and training strategies associated with convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Fayaz Ali Dharejo , Muhammad Zawish , Farah Deeba Yuanchun Zhou , Kapal Dev , Sunder Ali Khowaja , Nawab Muhammad Faseeh Qureshi