中文
相关论文

相关论文: MultiCrossViT: Multimodal Vision Transformer for S…

200 篇论文

Recent works have demonstrated that transformer can achieve promising performance in computer vision, by exploiting the relationship among image patches with self-attention. While they only consider the attention in a single feature layer,…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Nannan Li , Yaran Chen , Weifan Li , Zixiang Ding , Dongbin Zhao

Recent advances in Vision Transformers (ViTs) have significantly advanced semantic segmentation performance. However, their adaptation to new target domains remains challenged by distribution shifts, which often disrupt global attention…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Enming Zhang , Zhengyu Li , Yanru Wu , Jingge Wang , Yang Tan , Guan Wang , Yang Li , Xiaoping Zhang

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

Vision Transformers (ViT) have recently brought a new wave of research in the field of computer vision. These models have performed particularly well in image classification and segmentation. Research on semantic and instance segmentation…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

We propose a feature generator backbone composed of an ensemble of convolutional neuralnetworks (CNNs) to improve the recently emerging Vision Transformer (ViT) models. We tackled the RSNA intracranial hemorrhage classification problem,…

图像与视频处理 · 电气工程与系统科学 2023-02-01 Yassine Barhoumi , Ghulam Rasool

Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e.,…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Jongwoo Park , Kumara Kahatapitiya , Donghyun Kim , Shivchander Sudalairaj , Quanfu Fan , Michael S. Ryoo

Model binarization can significantly compress model size, reduce energy consumption, and accelerate inference through efficient bit-wise operations. Although binarizing convolutional neural networks have been extensively studied, there is…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Yefei He , Zhenyu Lou , Luoming Zhang , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

Recent deep multi-view stereo (MVS) methods have widely incorporated transformers into cascade network for high-resolution depth estimation, achieving impressive results. However, existing transformer-based methods are constrained by their…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Sicheng Wang , Hao Jiang , Lei Xiang

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis, pushing the state-of-the-art in classification, detection and segmentation tasks. Over the last years, vision…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Christos Matsoukas , Johan Fredin Haslum , Moein Sorkhei , Magnus Söderberg , Kevin Smith

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Intrigued by the inherent ability of the human visual system to identify salient regions in complex scenes, attention mechanisms have been seamlessly integrated into various Computer Vision (CV) tasks. Building upon this paradigm, Vision…

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

Convolutional Neural Network (CNN) has been successfully applied on classification of both natural images and medical images but not yet been applied to differentiating patients with schizophrenia from healthy controls. Given the subtle,…

计算机视觉与模式识别 · 计算机科学 2020-03-20 Mengjiao Hu , Kang Sim , Juan Helen Zhou , Xudong Jiang , Cuntai Guan

Vision Transformers (ViTs) have demonstrated strong capabilities in capturing global dependencies but often struggle to efficiently represent fine-grained local details. Existing multi-scale approaches alleviate this issue by integrating…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Qiyang Yu , Yu Fang , Tianrui Li , Xuemei Cao , Yan Chen , Jianghao Li , Fan Min

Vision Transformers (ViT) have advanced computer vision, yet their efficacy in complex tasks like driving remains less explored. This study enhances ViT by integrating human eye gaze, captured via eye-tracking, to increase prediction…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Sharath Koorathota , Nikolas Papadopoulos , Jia Li Ma , Shruti Kumar , Xiaoxiao Sun , Arunesh Mittal , Patrick Adelman , Paul Sajda

Exploring the trustworthiness of deep learning models is crucial, especially in critical domains such as medical imaging decision support systems. Conformal prediction has emerged as a rigorous means of providing deep learning models with…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Mehran Zoravar , Shadi Alijani , Homayoun Najjaran

Cross-subject motor imagery (CS-MI) classification in brain-computer interfaces (BCIs) is a challenging task due to the significant variability in Electroencephalography (EEG) patterns across different individuals. This variability often…

机器学习 · 计算机科学 2025-07-04 Ahmed G. Habashi , Ahmed M. Azab , Seif Eldawlatly , Gamal M. Aly

Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned…

Magnetic Resonance Imaging (MRI) plays a pivotal role in the early diagnosis and monitoring of Alzheimer's disease (AD). However, the subtle structural variations in brain MRI scans often pose challenges for conventional deep learning…

图像与视频处理 · 电气工程与系统科学 2025-12-22 Faisal Ahmed

The hybrid deep models of Vision Transformer (ViT) and Convolution Neural Network (CNN) have emerged as a powerful class of backbones for vision tasks. Scaling up the input resolution of such hybrid backbones naturally strengthes model…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Ting Yao , Yehao Li , Yingwei Pan , Tao Mei