English
Related papers

Related papers: Learning CNN on ViT: A Hybrid Model to Explicitly …

200 papers

While machine learning is currently transforming the field of histopathology, the domain lacks a comprehensive evaluation of state-of-the-art models based on essential but complementary quality requirements beyond a mere classification…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Maximilian Springenberg , Annika Frommholz , Markus Wenzel , Eva Weicken , Jackie Ma , Nils Strodthoff

Domain adaptation (DA) aims at improving the performance of a model on target domains by transferring the knowledge contained in different but related source domains. With recent advances in deep learning models which are extremely data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Gabriela Csurka

LBP is a successful hand-crafted feature descriptor in computer vision. However, in the deep learning era, deep neural networks, especially convolutional neural networks (CNNs) can automatically learn powerful task-aware features that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Zhuo Su , Matti Pietikäinen , Li Liu

Visual Domain Adaptation is a problem of immense importance in computer vision. Previous approaches showcase the inability of even deep neural networks to learn informative representations across domain shift. This problem is more severe…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Swami Sankaranarayanan , Yogesh Balaji , Arpit Jain , Ser Nam Lim , Rama Chellappa

Learning representations with self-supervision for convolutional networks (CNN) has been validated to be effective for vision tasks. As an alternative to CNN, vision transformers (ViT) have strong representation ability with spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Zhong-Yu Li , Shanghua Gao , Ming-Ming Cheng

Continual learning is a longstanding research topic due to its crucial role in tackling continually arriving tasks. Up to now, the study of continual learning in computer vision is mainly restricted to convolutional neural networks (CNNs).…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Mengqi Xue , Haofei Zhang , Jie Song , Mingli Song

Distilling knowledge from convolutional neural networks (CNNs) is a double-edged sword for vision transformers (ViTs). It boosts the performance since the image-friendly local-inductive bias of CNN helps ViT learn faster and better, but…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Borui Zhao , Renjie Song , Jiajun Liang

Age estimation from facial images is a complex and multifaceted challenge in computer vision. In this study, we present a novel hybrid architecture that combines ConvNeXt, a state-of-the-art advancement of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Gaby Maroun , Salah Eddine Bekhouche , Fadi Dornaika

In many modern computer application problems, the classification of image data plays an important role. Among many different supervised machine learning models, convolutional neural networks (CNNs) and linear discriminant analysis (LDA) as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Axel Klawonn , Martin Lanser , Janine Weber

Computer-aided diagnosis (CAD) based on histopathological imaging has progressed rapidly in recent years with the rise of machine learning based methodologies. Traditional approaches consist of training a classification model using features…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Junaid Malik , Serkan Kiranyaz , Suchitra Kunhoth , Turker Ince , Somaya Al-Maadeed , Ridha Hamila , Moncef Gabbouj

Deep models, such as convolutional neural networks (CNNs) and vision transformer (ViT), demonstrate remarkable performance in image classification. However, those deep models require large data to fine-tune, which is impractical in the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yihang Wu , Muhammad Owais , Reem Kateb , Ahmad Chaddad

Attention-based vision models, such as Vision Transformer (ViT) and its variants, have shown promising performance in various computer vision tasks. However, these emerging architectures suffer from large model sizes and high computational…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jinqi Xiao , Miao Yin , Yu Gong , Xiao Zang , Jian Ren , Bo Yuan

Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when trained with insufficient data due to lack of inherent…

Image and Video Processing · Electrical Eng. & Systems 2025-03-04 Omar S. EL-Assiouti , Ghada Hamed , Dina Khattab , Hala M. Ebied

This paper addresses the challenges in representation learning of 3D shape features by investigating state-of-the-art backbones paired with both contrastive supervised and self-supervised learning objectives. Computer vision methods…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Márcus Vinícius Lobo Costa , Sherlon Almeida da Silva , Bárbara Caroline Benato , Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Unsupervised domain adaptation (UDA) methods have been broadly utilized to improve the models' adaptation ability in general computer vision. However, different from the natural images, there exist huge semantic gaps for the nuclei from…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Canran Li , Dongnan Liu , Haoran Li , Zheng Zhang , Guangming Lu , Xiaojun Chang , Weidong Cai

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Accurate identification of late-life depression (LLD) using structural brain MRI is essential for monitoring disease progression and facilitating timely intervention. However, existing learning-based approaches for LLD detection are often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Yuzhen Gao , Qianqian Wang , Yongheng Sun , Cui Wang , Yongquan Liang , Mingxia Liu

This paper introduces the three-branch Dual Attention-Guided Compact Bilinear CNN (DACB-Net) by focusing on learning from disease-specific regions to enhance accuracy and alignment. A global branch compensates for lost discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Belal Ahmad , Mohd Usama , Tanvir Ahmad , Adnan Saeed , Shabnam Khatoon , Min Chen

The success of Vision Transformer (ViT) has been widely reported on a wide range of image recognition tasks. ViT can learn global dependencies superior to CNN, yet CNN's inherent locality can substitute for expensive training resources.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Chenghao Li , Chaoning Zhang

This paper introduces a groundbreaking classification model called the Controllable Ensemble Transformer and CNN (CETC) for the analysis of medical images. The CETC model combines the powerful capabilities of convolutional neural networks…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Javad Mirzapour Kaleybar , Hooman Saadat , Hooman Khaloo