中文
相关论文

相关论文: Efficiently Training Vision Transformers on Struct…

200 篇论文

Deep learning, a cutting-edge machine learning approach, outperforms traditional machine learning in identifying intricate structures in complex high-dimensional data, particularly in the domain of healthcare. This study focuses on…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Nida Nasir , Muneeb Ahmed , Neda Afreen , Mustafa Sameer

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

计算机视觉与模式识别 · 计算机科学 2024-02-08 Saebom Leem , Hyunseok Seo

The most recent year has witnessed the success of applying the Vision Transformer (ViT) for image classification. However, there are still evidences indicating that ViT often suffers following two aspects, i) the high computation and the…

计算机视觉与模式识别 · 计算机科学 2021-12-30 Xian Wei , Bin Wang , Mingsong Chen , Ji Yuan , Hai Lan , Jiehuang Shi , Xuan Tang , Bo Jin , Guozhang Chen , Dongping Yang

The ability to predict the future trajectory of a patient is a key step toward the development of therapeutics for complex diseases such as Alzheimer's disease (AD). However, most machine learning approaches developed for prediction of…

This study evaluates the trade-offs between convolutional and transformer-based architectures on both medical and general-purpose image classification benchmarks. We use ResNet-18 as our baseline and introduce a fine-tuning strategy applied…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Aidar Amangeldi , Angsar Taigonyrov , Muhammad Huzaifa Jawad , Chinedu Emmanuel Mbonu

Deep learning models have shown strong performance in diagnosing Alzheimer's disease (AD) using neuroimaging data, particularly 18F-FDG PET scans, with training datasets largely composed of North American cohorts such as those in the…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Hugo Massaroli , Hernan Chaves , Pilar Anania , Mauricio Farez , Emmanuel Iarussi , Viviana Siless

Deep learning is attracting significant interest in the neuroimaging community as a means to diagnose psychiatric and neurological disorders from structural magnetic resonance images. However, there is a tendency amongst researchers to…

机器学习 · 计算机科学 2019-10-22 David Wood , James Cole , Thomas Booth

Vision Transformer (ViT) models, utilizing self-attention mechanisms, have demonstrated robust generalization capabilities across various vision tasks, including image classification. However, these models, typically pretrained on general…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yuli Wang , Hyewon Jung , Dongshen Peng , Yuwei Dai , Jing Wu , Haoyue Guan , Yoko Kato , Zhicheng Jiao , Yu Sun , Ihab Kamel , Joao Lima , Cheng Ting Lin , Harrison Bai

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

图像与视频处理 · 电气工程与系统科学 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

This work validates the generalizability of MRI-based classification of Alzheimer's disease (AD) patients and controls (CN) to an external data set and to the task of prediction of conversion to AD in individuals with mild cognitive…

As shown in computer vision, the power of deep learning lies in automatically learning relevant and powerful features for any perdition task, which is made possible through end-to-end architectures. However, deep learning approaches applied…

计算机视觉与模式识别 · 计算机科学 2018-10-02 Soheil Esmaeilzadeh , Dimitrios Ioannis Belivanis , Kilian M. Pohl , Ehsan Adeli

Deep learning methods based on Convolutional Neural Networks (CNNs) have shown great potential to improve early and accurate diagnosis of Alzheimer's disease (AD) dementia based on imaging data. However, these methods have yet to be widely…

Vision Transformers (ViTs) have gained significant popularity in the natural image domain but have been less successful in 3D medical image segmentation. Nevertheless, 3D ViTs are particularly interesting for large medical imaging volumes…

计算机视觉与模式识别 · 计算机科学 2025-10-30 Benjamin Jin , Grant Mair , Joanna M. Wardlaw , Maria del C. Valdés Hernández

Although transformer networks are recently employed in various vision tasks with outperforming performance, extensive training data and a lengthy training time are required to train a model to disregard an inductive bias. Using trainable…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Heegon Jin , Jongwon Choi

Structural magnetic resonance imaging (sMRI) combined with deep learning has achieved remarkable progress in the prediction and diagnosis of Alzheimer's disease (AD). Existing studies have used CNN and transformer to build a well-performing…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Zheng Yang , Yanteng Zhang , Xupeng Kou , Yang Liu , Chao Ren

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

计算机视觉与模式识别 · 计算机科学 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

With the increasing popularity and the increasing size of vision transformers (ViTs), there has been an increasing interest in making them more efficient and less computationally costly for deployment on edge devices with limited computing…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Phuoc-Hoan Charles Le , Xinlin Li

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Chun-Fu Chen , Quanfu Fan , Rameswar Panda

Vision transformers (ViTs) have been an alternative design paradigm to convolutional neural networks (CNNs). However, the training of ViTs is much harder than CNNs, as it is sensitive to the training parameters, such as learning rate,…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Pichao Wang , Xue Wang , Hao Luo , Jingkai Zhou , Zhipeng Zhou , Fan Wang , Hao Li , Rong Jin