中文
相关论文

相关论文: MultiCrossViT: Multimodal Vision Transformer for S…

200 篇论文

We present ProtoViT, a method for interpretable image classification combining deep learning and case-based reasoning. This method classifies an image by comparing it to a set of learned prototypes, providing explanations of the form ``this…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Chiyu Ma , Jon Donnelly , Wenjun Liu , Soroush Vosoughi , Cynthia Rudin , Chaofan Chen

Vision Transformers (ViTs) have gained rapid adoption in computational pathology for their ability to model long-range dependencies through self-attention, addressing the limitations of convolutional neural networks that excel at local…

图像与视频处理 · 电气工程与系统科学 2026-01-15 Fuyao Chen , Yuexi Du , Elèonore V. Lieffrig , Nicha C. Dvornek , John A. Onofrey

Vision transformers (ViT) have been shown to allow for more flexible feature detection and can outperform convolutional neural network (CNN) when pre-trained on sufficient data. Due to their promising feature detection capabilities, we…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Nghia , Nguyen , Amer Wahed , Andy Quesada , Yasir Ali , Hanadi El Achi , Y. Helen Zhang , Jocelyn Ursua , Alex Banerjee , Sahib Kalra , L. Jeffrey Medeiros , Jie Xu

The cross-modal synthesis between structural magnetic resonance imaging (sMRI) and functional network connectivity (FNC) is a relatively unexplored area in medical imaging, especially with respect to schizophrenia. This study employs…

图像与视频处理 · 电气工程与系统科学 2023-09-18 Yuda Bi , Anees Abrol , Jing Sui , Vince Calhoun

Schizophrenia is a chronic neuropsychiatric disorder that causes distinct structural alterations within the brain. We hypothesize that deep learning applied to a structural neuroimaging dataset could detect disease-related alteration and…

图像与视频处理 · 电气工程与系统科学 2022-07-08 Junhao Zhang , Vishwanatha M. Rao , Ye Tian , Yanting Yang , Nicolas Acosta , Zihan Wan , Pin-Yu Lee , Chloe Zhang , Lawrence S. Kegeles , Scott A. Small , Jia Guo

Vision Transformers (ViTs) have achieved state-of-the-art performance in image classification, yet their attention mechanisms often remain opaque and exhibit dense, non-structured behaviors. In this work, we adapt our previously proposed…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Vasileios Arampatzakis , George Pavlidis , Nikolaos Mitianoudis , Nikos Papamarkos

Transformer-based architectures have revolutionized the landscape of deep learning. In computer vision domain, Vision Transformer demonstrates remarkable performance on par with or even surpassing that of convolutional neural networks.…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Hui Zhang , Qinglin Zhao , Mengchu Zhou , Li Feng

Vision Transformers (ViTs) are becoming more popular and dominating technique for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a demanding technique in computer vision, ViTs have been successfully solved various…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Khawar Islam

In this work, we propose a framework whereby flow imaging data is leveraged to extract relevant information from flowfield visualizations. To this end, a vision transformer (ViT) model is developed to predict the unsteady pressure…

流体动力学 · 物理学 2023-05-10 Renato F. Miotto , William R. Wolf

What constitutes an object? This has been a long-standing question in computer vision. Towards this goal, numerous learning-free and learning-based approaches have been developed to score objectness. However, they generally do not scale…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan , Rao Muhammad Anwer , Ming-Hsuan Yang

Tokens or patches within Vision Transformers (ViT) lack essential semantic information, unlike their counterparts in natural language processing (NLP). Typically, ViT tokens are associated with rectangular image patches that lack specific…

计算机视觉与模式识别 · 计算机科学 2024-02-29 Young Kyung Kim , J. Matías Di Martino , Guillermo Sapiro

Identifying brain hemorrhages from magnetic resonance imaging (MRI) is a critical task for healthcare professionals. The diverse nature of MRI acquisitions with varying contrasts and orientation introduce complexity in identifying…

图像与视频处理 · 电气工程与系统科学 2026-05-12 Badhan Kumar Das , Gengyan Zhao , Boris Mailhe , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Fine-grained visual classification (FGVC) which aims at recognizing objects from subcategories is a very challenging task due to the inherently subtle inter-class differences. Most existing works mainly tackle this problem by reusing the…

计算机视觉与模式识别 · 计算机科学 2021-12-03 Ju He , Jie-Neng Chen , Shuai Liu , Adam Kortylewski , Cheng Yang , Yutong Bai , Changhu Wang

Convolutional Neural Networks (CNNs) have advanced existing medical systems for automatic disease diagnosis. However, there are still concerns about the reliability of deep medical diagnosis systems against the potential threats of…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Omid Nejati Manzari , Hamid Ahmadabadi , Hossein Kashiani , Shahriar B. Shokouhi , Ahmad Ayatollahi

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

计算机视觉与模式识别 · 计算机科学 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

We design a family of image classification architectures that optimize the trade-off between accuracy and efficiency in a high-speed regime. Our work exploits recent findings in attention-based architectures, which are competitive on highly…

计算机视觉与模式识别 · 计算机科学 2021-05-07 Ben Graham , Alaaeldin El-Nouby , Hugo Touvron , Pierre Stock , Armand Joulin , Hervé Jégou , Matthijs Douze

Deep machine learning models including Convolutional Neural Networks (CNN) have been successful in the detection of Mild Cognitive Impairment (MCI) using medical images, questionnaires, and videos. This paper proposes a novel Multi-branch…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Jian Sun , Hiroko H. Dodge , Mohammad H. Mahoor

Recently, several Vision Transformer (ViT) based methods have been proposed for Fine-Grained Visual Classification (FGVC).These methods significantly surpass existing CNN-based ones, demonstrating the effectiveness of ViT in FGVC…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Zi-Chao Zhang , Zhen-Duo Chen , Yongxin Wang , Xin Luo , Xin-Shun Xu

Vision transformer (ViT) has been widely applied in many areas due to its self-attention mechanism that help obtain the global receptive field since the first layer. It even achieves surprising performance exceeding CNN in some vision…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Hanting Li , Mingzhe Sui , Zhaoqing Zhu , Feng Zhao

Background: Deep learning has significantly advanced medical image analysis, with Vision Transformers (ViTs) offering a powerful alternative to convolutional models by modeling long-range dependencies through self-attention. However, ViTs…