English
Related papers

Related papers: Learning CNN on ViT: A Hybrid Model to Explicitly …

200 papers

Domain adaptation tasks such as cross-domain sentiment classification aim to utilize existing labeled data in the source domain and unlabeled or few labeled data in the target domain to improve the performance in the target domain via…

Computation and Language · Computer Science 2022-01-03 Dongbo Xi , Fuzhen Zhuang , Ganbin Zhou , Xiaohu Cheng , Fen Lin , Qing He

Convolutional Neural Networks (CNNs) have advanced existing medical systems for automatic disease diagnosis. However, there are still concerns about the reliability of deep medical diagnosis systems against the potential threats of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Omid Nejati Manzari , Hamid Ahmadabadi , Hossein Kashiani , Shahriar B. Shokouhi , Ahmad Ayatollahi

Real-world object detectors are often challenged by the domain gaps between different datasets. In this work, we present the Conditional Domain Normalization (CDN) to bridge the domain gap. CDN is designed to encode different domain inputs…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Peng Su , Kun Wang , Xingyu Zeng , Shixiang Tang , Dapeng Chen , Di Qiu , Xiaogang Wang

During the last half decade, convolutional neural networks (CNNs) have triumphed over semantic segmentation, which is one of the core tasks in many applications such as autonomous driving. However, to train CNNs requires a considerable…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Yang Zhang , Philip David , Boqing Gong

This paper presents a study on improving human action recognition through the utilization of knowledge distillation, and the combination of CNN and ViT models. The research aims to enhance the performance and efficiency of smaller student…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hamid Ahmadabadi , Omid Nejati Manzari , Ahmad Ayatollahi

In the field of medical imaging, the advent of deep learning, especially the application of convolutional neural networks (CNNs) has revolutionized the analysis and interpretation of medical images. Nevertheless, deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Xin Li , Wenhui Zhu , Peijie Qiu , Oana M. Dumitrascu , Amal Youssef , Yalin Wang

Unsupervised Domain Adaptation (UDA) methods facilitate knowledge transfer from a labeled source domain to an unlabeled target domain, navigating the obstacle of domain shift. While Convolutional Neural Networks (CNNs) are a staple in UDA,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Gauransh Sawhney , Daksh Dave , Adeel Ahmed , Jiechao Gao , Khalid Saleem

We here propose a novel hierarchical transformer model that adeptly integrates the feature extraction capabilities of Convolutional Neural Networks (CNNs) with the advanced representational potential of Vision Transformers (ViTs).…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Xiaoya Tang , Bodong Zhang , Beatrice S. Knudsen , Tolga Tasdizen

Human Action Recognition (HAR) encompasses the task of monitoring human activities across various domains, including but not limited to medical, educational, entertainment, visual surveillance, video retrieval, and the identification of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Khaled Alomar , Halil Ibrahim Aysel , Xiaohao Cai

Recent advances in machine learning are transforming medical image analysis, particularly in cancer detection and classification. Techniques such as deep learning, especially convolutional neural networks (CNNs) and vision transformers…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Arezoo Borji , Gernot Kronreif , Bernhard Angermayr , Sepideh Hatamikia

In breast ultrasound images, precise lesion segmentation is essential for early diagnosis; however, low contrast, speckle noise, and unclear boundaries make this difficult. Even though deep learning models have demonstrated potential,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Prateek Singh , Moumita Dholey , P. K. Vinod

Deep learning technology can be used as an assistive technology to help doctors quickly and accurately identify COVID-19 infections. Recently, Vision Transformer (ViT) has shown great potential towards image classification due to its global…

Image and Video Processing · Electrical Eng. & Systems 2022-07-06 Hongyan Xu , Xiu Su , Dadong Wang

We apply pre-trained architectures, originally developed for the ImageNet Large Scale Visual Recognition Challenge, for periocular recognition. These architectures have demonstrated significant success in various computer vision tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Fernando Alonso-Fernandez , Kevin Hernandez-Diaz , Prayag Tiwari , Josef Bigun

End-to-end deep learning improves breast cancer classification on diffusion-weighted MR images (DWI) using a convolutional neural network (CNN) architecture. A limitation of CNN as opposed to previous model-based approaches is the…

Vision-transformers (ViTs) and large-scale convolution-neural-networks (CNNs) have reshaped computer vision through pretrained feature representations that enable strong transfer learning for diverse tasks. However, their efficiency as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alon Kaya , Igal Bilik , Inna Stainvas

Domain adaptation refers to the problem of leveraging labeled data in a source domain to learn an accurate model in a target domain where labels are scarce or unavailable. A recent approach for finding a common representation of the two…

Machine Learning · Statistics 2018-03-20 Rui Shu , Hung H. Bui , Hirokazu Narui , Stefano Ermon

In this paper, we make two contributions to unsupervised domain adaptation (UDA) using the convolutional neural network (CNN). First, our approach transfers knowledge in all the convolutional layers through attention alignment. Most…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Guoliang Kang , Liang Zheng , Yan Yan , Yi Yang

Transformer, an attention-based encoder-decoder architecture, has not only revolutionized the field of natural language processing (NLP), but has also done some pioneering work in the field of computer vision (CV). Compared to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zujun Fu

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

Image classification is a difficult machine learning task, where Convolutional Neural Networks (CNNs) have been applied for over 20 years in order to solve the problem. In recent years, instead of the traditional way of only connecting the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Bin Wang , Yanan Sun , Bing Xue , Mengjie Zhang