English
Related papers

Related papers: Pattern Attention Transformer with Doughnut Kernel

200 papers

Vision Transformers (ViTs) have recently taken computer vision by storm. However, the softmax attention underlying ViTs comes with a quadratic complexity in time and memory, hindering the application of ViTs to high-resolution images. We…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Chuanyang Zheng

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

This paper introduces a novel attention mechanism, called dual attention, which is both efficient and effective. The dual attention mechanism consists of two parallel components: local attention generated by Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhengkai Jiang , Liang Liu , Jiangning Zhang , Yabiao Wang , Mingang Chen , Chengjie Wang

While originally designed for natural language processing tasks, the self-attention mechanism has recently taken various computer vision areas by storm. However, the 2D nature of images brings three challenges for applying self-attention in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Meng-Hao Guo , Cheng-Ze Lu , Zheng-Ning Liu , Ming-Ming Cheng , Shi-Min Hu

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Vision Transformer (ViT) has brought new breakthroughs to the field of image classification by introducing the self-attention mechanism and Graph Convolutional Networks(GCN) have been proposed and successfully applied in data representation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Haibin Jiao

The prosperity of deep learning contributes to the rapid progress in scene text detection. Among all the methods with convolutional networks, segmentation-based ones have drawn extensive attention due to their superiority in detecting text…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Jingyu Lin , Jie Jiang , Yan Yan , Chunchao Guo , Hongfa Wang , Wei Liu , Hanzi Wang

In recent years, Vision Transformer-based approaches for low-level vision tasks have achieved widespread success. Unlike CNN-based models, Transformers are more adept at capturing long-range dependencies, enabling the reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chih-Chung Hsu , Chia-Ming Lee , Yi-Shiuan Chou

This paper provides a novel 3D medical image segmentation model structure called nnY-Net. This name comes from the fact that our model adds a cross-attention module at the bottom of the U-net structure to form a Y structure. We integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Haixu Liu , Zerui Tao , Wenzhen Dong , Qiuzhuang Sun

The success of Vision Transformer (ViT) in various computer vision tasks has promoted the ever-increasing prevalence of this convolution-free network. The fact that ViT works on image patches makes it potentially relevant to the problem of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Yingyi Chen , Xi Shen , Yahui Liu , Qinghua Tao , Johan A. K. Suykens

Transformers have sprung up in the field of computer vision. In this work, we explore whether the core self-attention module in Transformer is the key to achieving excellent performance in image recognition. To this end, we build an…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Chuanxin Tang , Yucheng Zhao , Guangting Wang , Chong Luo , Wenxuan Xie , Wenjun Zeng

In this paper, we aim to redesign the vision Transformer (ViT) as a new backbone to realize semantic image transmission, termed wireless image transmission transformer (WITT). Previous works build upon convolutional neural networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Ke Yang , Sixian Wang , Jincheng Dai , Kailin Tan , Kai Niu , Ping Zhang

Shape assembly, which aims to reassemble separate parts into a complete object, has gained significant interest in recent years. Existing methods primarily rely on networks to predict the poses of individual parts, but often fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jiahan Li , Chaoran Cheng , Jianzhu Ma , Ge Liu

The advent of Vision Transformers (ViTs) marks a substantial paradigm shift in the realm of computer vision. ViTs capture the global information of images through self-attention modules, which perform dot product computations among…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shuoxi Zhang , Hanpeng Liu , Stephen Lin , Kun He

Vision Transformers are at the heart of the current surge of interest in foundation models for histopathology. They process images by breaking them into smaller patches following a regular grid, regardless of their content. Yet, not all…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Clément Grisi , Geert Litjens , Jeroen van der Laak

We present Token-UNet, adopting the TokenLearner and TokenFuser modules to encase Transformers into UNets. While Transformers have enabled global interactions among input elements in medical imaging, current computational challenges hinder…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Louis Fabrice Tshimanga , Andrea Zanola , Federico Del Pup , Manfredo Atzori

Inspired by the success of Transformers in Computer vision, Transformers have been widely investigated for medical imaging segmentation. However, most of Transformer architecture are using the recent transformer architectures as encoder or…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Fares Bougourzi , Fadi Dornaika , Abdelmalik Taleb-Ahmed , Vinh Truong Hoang

Inspired by the tremendous success of the self-attention mechanism in natural language processing, the Vision Transformer (ViT) creatively applies it to image patch sequences and achieves incredible performance. However, the scaled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Yanhong Fei , Yingjie Liu , Xian Wei , Mingsong Chen

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed