English
Related papers

Related papers: Improved EATFormer: A Vision Transformer for Medic…

200 papers

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Convolutional networks, transformers, hybrid models, and Mamba-based architectures have demonstrated strong performance across various medical image classification tasks. However, these methods were primarily designed to classify clean…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Omid Nejati Manzari , Hojat Asgariandehkordi , Taha Koleilat , Yiming Xiao , Hassan Rivaz

In breast ultrasound images, precise lesion segmentation is essential for early diagnosis; however, low contrast, speckle noise, and unclear boundaries make this difficult. Even though deep learning models have demonstrated potential,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Prateek Singh , Moumita Dholey , P. K. Vinod

Although Vision Transformers (ViTs) have recently demonstrated superior performance in medical imaging problems, they face explainability issues similar to previous architectures such as convolutional neural networks. Recent research…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Minjae Chung , Jong Bum Won , Ganghyun Kim , Yujin Kim , Utku Ozbulak

Vision Transformer (ViT) demonstrates that Transformer for natural language processing can be applied to computer vision tasks and result in comparable performance to convolutional neural networks (CNN), which have been studied and adopted…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yi-Lun Liao , Sertac Karaman , Vivienne Sze

This paper introduces the Neural Transcoding Vision Transformer (\modelname), a generative model designed to estimate high-resolution functional Magnetic Resonance Imaging (fMRI) samples from simultaneous Electroencephalography (EEG) data.…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Romeo Lanzino , Federico Fontana , Luigi Cinque , Francesco Scarcello , Atsuto Maki

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Andrew Kean Gao

The relations expressed in user queries are vital for cross-modal information retrieval. Relation-focused cross-modal retrieval aims to retrieve information that corresponds to these relations, enabling effective retrieval across different…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yan Gong , Georgina Cosma , Axel Finke

Traditional fault diagnosis methods using Convolutional Neural Networks (CNNs) often struggle with capturing the temporal dynamics of vibration signals. To overcome this, the application of Transformer-based Vision Transformer (ViT) methods…

Systems and Control · Electrical Eng. & Systems 2025-01-03 Shouhua Zhang , Jiehan Zhou , Xue Ma , Susanna Pirttikangas , Chunsheng Yang

Transformer-based methods have demonstrated impressive results in medical image restoration, attributed to the multi-head self-attention (MSA) mechanism in the spatial dimension. However, the majority of existing Transformers conduct…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Zhiwen Yang , Haowei Chen , Ziniu Qian , Yang Zhou , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

Convolutional architectures have proven extremely successful for vision tasks. Their hard inductive biases enable sample-efficient learning, but come at the cost of a potentially lower performance ceiling. Vision Transformers (ViTs) rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Stéphane d'Ascoli , Hugo Touvron , Matthew Leavitt , Ari Morcos , Giulio Biroli , Levent Sagun

Transformers are state-of-the-art deep learning models that are composed of stacked attention and point-wise, fully connected layers designed for handling sequential data. Transformers are not only ubiquitous throughout Natural Language…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Onur Kara , Arijit Sehanobish , Hector H Corzo

Medical image classification is crucial for diagnosis and treatment, benefiting significantly from advancements in artificial intelligence. The paper reviews recent progress in the field, focusing on three levels of solutions: basic,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Loan Dao , Ngoc Quoc Ly

The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Pengchen Liang , Bin Pu , Haishan Huang , Yiwei Li , Hualiang Wang , Weibo Ma , Qing Chang

Explainability is a highly demanded requirement for applications in high-risk areas such as medicine. Vision Transformers have mainly been limited to attention extraction to provide insight into the model's reasoning. Our approach combines…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Luisa Gallée , Catharina Silvia Lisson , Meinrad Beer , Michael Götz

Visual place recognition (VPR) aims to determine the general geographical location of a query image by retrieving visually similar images from a large geo-tagged database. To obtain a global representation for each place image, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tong Jin , Feng Lu , Shuyu Hu , Chun Yuan , Yunpeng Liu

Recently, medical report generation, which aims to automatically generate a long and coherent descriptive paragraph of a given medical image, has received growing research interests. Different from the general image captioning tasks,…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Di You , Fenglin Liu , Shen Ge , Xiaoxia Xie , Jing Zhang , Xian Wu

The examination of chest X-ray images is a crucial component in detecting various thoracic illnesses. This study introduces a new image description generation model that integrates a Vision Transformer (ViT) encoder with cross-modal…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Lakshita Agarwal , Bindu Verma

In the field of multi-organ medical image segmentation, recent methods frequently employ Transformers to capture long-range dependencies from image features. However, these methods overlook the high computational cost of Transformers and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Cheng Kong , Yansen Su , Hai Chen , Dongliang Yang , Junfeng Xia , Chunhou Zheng

This paper provides a comprehensive review of mechanical equipment fault diagnosis methods, focusing on the advancements brought by Transformer-based models. It details the structure, working principles, and benefits of Transformers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Guiran Liu , Binrong Zhu