English
Related papers

Related papers: HIPA: Hierarchical Patch Transformer for Single Im…

200 papers

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao

In this paper, we propose HiTSR, a hierarchical transformer model for reference-based image super-resolution, which enhances low-resolution input images by learning matching correspondences from high-resolution reference images. Diverging…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Masoomeh Aslahishahri , Jordan Ubbens , Ian Stavness

Transformer-based architectures have recently advanced the image reconstruction quality of super-resolution (SR) models. Yet, their scalability remains limited by quadratic attention costs and coarse patch embeddings that weaken pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Sanath Budakegowdanadoddi Nagaraju , Brian Bernhard Moser , Tobias Christian Nauen , Stanislav Frolov , Federico Raue , Andreas Dengel

Although transformer has achieved great progress on computer vision tasks, the scale variation in dense image prediction is still the key challenge. Few effective multi-scale techniques are applied in transformer and there are two main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Zekun Li , Yufan Liu , Bing Li , Weiming Hu , Kebin Wu , Pei Wang

Although convolutional networks have been the dominant architecture for vision tasks for many years, recent experiments have shown that Transformer-based models, most notably the Vision Transformer (ViT), may exceed their performance in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Asher Trockman , J. Zico Kolter

Transformers are widely used deep learning architectures. Existing transformers are mostly designed for sequences (texts or time series), images or videos, and graphs. This paper proposes a novel transformer model for massive (up to a…

Machine Learning · Computer Science 2023-11-09 Wenchong He , Zhe Jiang , Tingsong Xiao , Zelin Xu , Shigang Chen , Ronald Fick , Miles Medina , Christine Angelini

We propose a novel solution for the task of video panoptic segmentation, that simultaneously predicts pixel-level semantic and instance segmentation and generates clip-level instance tracks. Our network, named VPS-Transformer, with a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Andra Petrovai , Sergiu Nedevschi

Given the broad application of infrared technology across diverse fields, there is an increasing emphasis on investigating super-resolution techniques for infrared images within the realm of deep learning. Despite the impressive results of…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Feiwei Qin , Kang Yan , Changmiao Wang , Ruiquan Ge , Yong Peng , Kai Zhang

As a de facto solution, the vanilla Vision Transformers (ViTs) are encouraged to model long-range dependencies between arbitrary image patches while the global attended receptive field leads to quadratic computational cost. Another branch…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Jiayu Jiao , Yu-Ming Tang , Kun-Yu Lin , Yipeng Gao , Jinhua Ma , Yaowei Wang , Wei-Shi Zheng

Vision Transformer (ViT) has made significant advancements in computer vision, thanks to its token mixer's sophisticated ability to capture global dependencies between all tokens. However, the quadratic growth in computational demands as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Guoan Xu , Wenfeng Huang , Wenjing Jia , Jiamao Li , Guangwei Gao , Guo-Jun Qi

Removing noise from images is a challenging and fundamental problem in the field of computer vision. Images captured by modern cameras are inevitably degraded by noise which limits the accuracy of any quantitative measurements on those…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Nikhil Verma , Deepkamal Kaur , Lydia Chau

Transformers have achieved the state-of-the-art performance on solving the inverse problem of Snapshot Compressive Imaging (SCI) for video, whose ill-posedness is rooted in the mixed degradation of spatial masking and temporal aliasing.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Ping Wang , Yulun Zhang , Lishun Wang , Xin Yuan

Compressed Image Super-resolution has achieved great attention in recent years, where images are degraded with compression artifacts and low-resolution artifacts. Since the complex hybrid distortions, it is hard to restore the distorted…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Bingchen Li , Xin Li , Yiting Lu , Sen Liu , Ruoyu Feng , Zhibo Chen

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

In the field of computer vision, recent works show that a pure MLP architecture mainly stacked by fully-connected layers can achieve competing performance with CNN and transformer. An input image of vision MLP is usually split into multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yehui Tang , Kai Han , Jianyuan Guo , Chang Xu , Yanxi Li , Chao Xu , Yunhe Wang

Multi-scale features have been proven highly effective for object detection but often come with huge and even prohibitive extra computation costs, especially for the recent Transformer-based detectors. In this paper, we propose Iterative…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Gongjie Zhang , Zhipeng Luo , Zichen Tian , Jingyi Zhang , Xiaoqin Zhang , Shijian Lu

This paper tackles the problem of motion deblurring of dynamic scenes. Although end-to-end fully convolutional designs have recently advanced the state-of-the-art in non-uniform motion deblurring, their performance-complexity trade-off is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Maitreya Suin , Kuldeep Purohit , A. N. Rajagopalan

With the rapid development of deep learning, low-light RAW image enhancement (LLRIE) has achieved remarkable progress. However, the challenge that how to simultaneously achieve strong enhancement quality and high efficiency still remains.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xianmin Chen , Peiliang Huang , Longfei Han , Dingwen Zhang , Junwei Han

Recently, Transformer-based methods have achieved impressive results in single image super-resolution (SISR). However, the lack of locality mechanism and high complexity limit their application in the field of super-resolution (SR). To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ling Zheng , Jinchen Zhu , Jinpeng Shi , Shizhuang Weng

Since the introduction of the Transformer architecture for large language models, the softmax-based attention layer has faced increasing scrutinity due to its quadratic-time computational complexity. Attempts have been made to replace it…

Machine Learning · Computer Science 2026-02-02 Robert Forchheimer