English
Related papers

Related papers: VIViT: Variable-Input Vision Transformer Framework…

200 papers

Deep learning approaches to the segmentation of magnetic resonance images have shown significant promise in automating the quantitative analysis of brain images. However, a continuing challenge has been its sensitivity to the variability of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-05 Dzung L. Pham , Yi-Yu Chou , Blake E. Dewey , Daniel S. Reich , John A. Butman , Snehashis Roy

The relations expressed in user queries are vital for cross-modal information retrieval. Relation-focused cross-modal retrieval aims to retrieve information that corresponds to these relations, enabling effective retrieval across different…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yan Gong , Georgina Cosma , Axel Finke

Accurate and scalable cancer diagnosis remains a critical challenge in modern pathology, particularly for malignancies such as breast, prostate, bone, and cervical, which exhibit complex histological variability. In this study, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Faisal Ahmed

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Vision Transformers (ViTs) have gained significant popularity in the natural image domain but have been less successful in 3D medical image segmentation. Nevertheless, 3D ViTs are particularly interesting for large medical imaging volumes…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Benjamin Jin , Grant Mair , Joanna M. Wardlaw , Maria del C. Valdés Hernández

Vision transformer (ViT) recently has drawn great attention in computer vision due to its remarkable model capability. However, most prevailing ViT models suffer from huge number of parameters, restricting their applicability on devices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Kan Wu , Jinnian Zhang , Houwen Peng , Mengchen Liu , Bin Xiao , Jianlong Fu , Lu Yuan

The Masked Autoencoder (MAE) has recently demonstrated effectiveness in pre-training Vision Transformers (ViT) for analyzing natural images. By reconstructing complete images from partially masked inputs, the ViT encoder gathers contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Haofei Zhang , Jiarui Duan , Mengqi Xue , Jie Song , Li Sun , Mingli Song

Vision Transformers (ViTs) have demonstrated strong potential in medical imaging; however, their high computational demands and tendency to overfit on small datasets limit their applicability in real-world clinical scenarios. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Aon Safdar , Mohamed Saadeldin

Recently, masked image modeling (MIM) has offered a new methodology of self-supervised pre-training of vision transformers. A key idea of efficient implementation is to discard the masked image patches (or tokens) throughout the target…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Xiaosong Zhang , Yunjie Tian , Wei Huang , Qixiang Ye , Qi Dai , Lingxi Xie , Qi Tian

Self-supervised learning methods are gaining increasing traction in computer vision due to their recent success in reducing the gap with supervised learning. In natural language processing (NLP) self-supervised learning and transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Sara Atito , Muhammad Awais , Josef Kittler

Vision transformers (ViTs) have demonstrated great potential in various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. In this paper, we introduce a ternary…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Sheng Xu , Yanjing Li , Teli Ma , Bohan Zeng , Baochang Zhang , Peng Gao , Jinhu Lv

Vision Transformers (ViTs) have revolutionized computer vision by leveraging self-attention to model long-range dependencies. However, ViTs face challenges such as high computational costs due to the quadratic scaling of self-attention and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhoujie Qian

This paper tackles a significant challenge faced by Vision Transformers (ViTs): their constrained scalability across different image resolutions. Typically, ViTs experience a performance decline when processing resolutions different from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Qihang Fan , Quanzeng You , Xiaotian Han , Yongfei Liu , Yunzhe Tao , Huaibo Huang , Ran He , Hongxia Yang

A key feature of magnetic resonance (MR) imaging is its ability to manipulate how the intrinsic tissue parameters of the anatomy ultimately contribute to the contrast properties of the final, acquired image. This flexibility, however, can…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Dzung L. Pham , Snehashis Roy

A Vision Transformer (ViT) is a simple neural architecture amenable to serve several computer vision tasks. It has limited built-in architectural priors, in contrast to more recent architectures that incorporate priors either about the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Hugo Touvron , Matthieu Cord , Hervé Jégou

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis, pushing the state-of-the-art in classification, detection and segmentation tasks. Over the last years, vision…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Christos Matsoukas , Johan Fredin Haslum , Moein Sorkhei , Magnus Söderberg , Kevin Smith

Vision Transformers (ViT), when paired with large-scale pretraining, have shown remarkable performance across various computer vision tasks, primarily due to their weak inductive bias. However, while such weak inductive bias aids in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Dongyoon Hwang , Byungkun Lee , Hojoon Lee , Hyunseung Kim , Jaegul Choo

Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Daquan Zhou , Bingyi Kang , Xiaojie Jin , Linjie Yang , Xiaochen Lian , Zihang Jiang , Qibin Hou , Jiashi Feng

ViTs are often too computationally expensive to be fitted onto real-world resource-constrained devices, due to (1) their quadratically increased complexity with the number of input tokens and (2) their overparameterized self-attention heads…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Zhongzhi Yu , Yonggan Fu , Sicheng Li , Chaojian Li , Yingyan Lin