English
Related papers

Related papers: Sparse MLP for Image Recognition: Is Self-Attentio…

200 papers

Existing Transformers for monocular 3D human shape and pose estimation typically have a quadratic computation and memory complexity with respect to the feature length, which hinders the exploitation of fine-grained information in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Xiangyu Xu , Lijuan Liu , Shuicheng Yan

Mixture-of-Experts (MoE), a conditional computation architecture, achieved promising performance by scaling local module (i.e. feed-forward network) of transformer. However, scaling the cross-token module (i.e. self-attention) is…

Machine Learning · Computer Science 2022-01-17 Yuxuan Lou , Fuzhao Xue , Zangwei Zheng , Yang You

Continual learning is a problem for artificial neural networks that their biological counterparts are adept at solving. Building on work using Sparse Distributed Memory (SDM) to connect a core neural circuit with the powerful Transformer…

Neural and Evolutionary Computing · Computer Science 2023-03-28 Trenton Bricken , Xander Davies , Deepak Singh , Dmitry Krotov , Gabriel Kreiman

The Transformer is an extremely powerful and prominent deep learning architecture. In this work, we challenge the commonly held belief in deep learning that going deeper is better, and show an alternative design approach that is building…

Machine Learning · Computer Science 2022-11-10 Jason Ross Brown , Yiren Zhao , Ilia Shumailov , Robert D Mullins

Medical image segmentation remains particularly challenging for complex and low-contrast anatomical structures. In this paper, we introduce the U-Transformer network, which combines a U-shaped architecture for image segmentation with self-…

Image and Video Processing · Electrical Eng. & Systems 2021-03-15 Olivier Petit , Nicolas Thome , Clément Rambour , Luc Soler

Recently, numerous studies have been conducted on supervised learning-based image denoising methods. However, these methods rely on large-scale noisy-clean image pairs, which are difficult to obtain in practice. Denoising methods with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Young-Joo Han , Ha-Jin Yu

The attention mechanism is the primary component of the transformer architecture; it has led to significant advancements in deep learning spanning many domains and covering multiple tasks. In computer vision, the attention mechanism was…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Abdullah Nazhat Abdullah , Tarkan Aydin

Transformers have demonstrated a competitive performance across a wide range of vision tasks, while it is very expensive to compute the global self-attention. Many methods limit the range of attention within a local window to reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Zhenzhe Hechen , Wei Huang , Yixin Zhao

Since its inception in "Attention Is All You Need", transformer architecture has led to revolutionary advancements in NLP. The attention layer within the transformer admits a sequence of input tokens $X$ and makes them interact through…

Machine Learning · Computer Science 2024-02-23 Davoud Ataee Tarzanagh , Yingcong Li , Christos Thrampoulidis , Samet Oymak

Transformer-based Spiking Neural Networks (SNNs) integrate SNNs with global self-attention and have demonstrated impressive performance. However, existing Transformer-based SNNs suffer from two fundamental limitations. First, they typically…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Lingdong Li , Hangming Zhang , Qiang Yu

Among the current mainstream change detection networks, transformer is deficient in the ability to capture accurate low-level details, while convolutional neural network (CNN) is wanting in the capacity to understand global information and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Dalong Zheng , Zebin Wu , Jia Liu , Zhihui Wei

Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Libin Lan , Yanxin Li , Xiaojuan Liu , Juan Zhou , Jianxun Zhang , Nannan Huang , Yudong Zhang

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

In this paper, we present Vision Permutator, a conceptually simple and data efficient MLP-like architecture for visual recognition. By realizing the importance of the positional information carried by 2D feature representations, unlike…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Qibin Hou , Zihang Jiang , Li Yuan , Ming-Ming Cheng , Shuicheng Yan , Jiashi Feng

Deep Neural Networks (DNNs) have been proven to be exceptionally effective and have been applied across diverse domains within deep learning. However, as DNN models increase in complexity, the demand for reduced computational costs and…

Neural and Evolutionary Computing · Computer Science 2025-06-12 Xiaotian Chen , Hongyun Liu , Seyed Sahand Mohammadi Ziabari

Window-based transformers have demonstrated outstanding performance in super-resolution tasks due to their adaptive modeling capabilities through local self-attention (SA). However, they exhibit higher computational complexity and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zhenyu Hu , Wanjie Sun

With the popularity of Transformer architectures in computer vision, the research focus has shifted towards developing computationally efficient designs. Window-based local attention is one of the major techniques being adopted in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ammarah Farooq , Muhammad Awais , Sara Ahmed , Josef Kittler

Convolutional neural networks (CNNs) and vision transformers (ViTs) are widely employed for medical image segmentation, but they are still challenged by their intrinsic characteristics. CNNs are limited from capturing varying-scaled…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However, many existing vision transformer (ViT) works simply inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Leijie Wu , Song Guo , Yaohong Ding , Junxiao Wang , Wenchao Xu , Richard Yida Xu , Jie Zhang

Benefiting from the vigorous development of deep learning, many CNN-based image super-resolution methods have emerged and achieved better results than traditional algorithms. However, it is difficult for most algorithms to adaptively adjust…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yuxi Cai , Huicheng Lai , Zhenghong Jia