English
Related papers

Related papers: Pretrained ViTs Yield Versatile Representations Fo…

200 papers

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

Recent escalation in the field of computer vision underpins a huddle of algorithms with the magnificent potential to unravel the information contained within images. These computer vision algorithms are being practised in medical image…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 Arshi Parvaiz , Muhammad Anwaar Khalid , Rukhsana Zafar , Huma Ameer , Muhammad Ali , Muhammad Moazam Fraz

This study examines various feature extraction techniques in computer vision, the primary focus of which is on Vision Transformers (ViTs) and other approaches such as Generative Adversarial Networks (GANs), deep feature models, traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Venant Niyonkuru , Sylla Sekou , Jimmy Jackson Sinzinkayo

In image classification, Convolutional Neural Network(CNN) models have achieved high performance with the rapid development in deep learning. However, some categories in the image datasets are more difficult to distinguished than others.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Yuntao Liu , Yong Dou , Ruochun Jin , Peng Qiao

Vision Transformer (ViT) has become one of the most popular neural architectures due to its great scalability, computational efficiency, and compelling performance in many vision tasks. However, ViT has shown inferior performance to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Junfei Xiao , Yutong Bai , Alan Yuille , Zongwei Zhou

Can a lightweight Vision Transformer (ViT) match or exceed the performance of Convolutional Neural Networks (CNNs) like ResNet on small datasets with small image resolutions? This report demonstrates that a pure ViT can indeed achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jen Hong Tan

The development of efficient segmentation strategies for medical images has evolved from its initial dependence on Convolutional Neural Networks (CNNs) to the current investigation of hybrid models that combine CNNs with Vision Transformers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-08 Pallabi Dutta , Soham Bose , Swalpa Kumar Roy , Sushmita Mitra

For computer vision, Vision Transformers (ViTs) have become one of the go-to deep net architectures. Despite being inspired by Convolutional Neural Networks (CNNs), ViTs' output remains sensitive to small spatial shifts in the input, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Renan A. Rojas-Gomez , Teck-Yian Lim , Minh N. Do , Raymond A. Yeh

With the increasing popularity and the increasing size of vision transformers (ViTs), there has been an increasing interest in making them more efficient and less computationally costly for deployment on edge devices with limited computing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Phuoc-Hoan Charles Le , Xinlin Li

Convolutional Neural Networks (CNNs) have been successful in solving tasks in computer vision including medical image segmentation due to their ability to automatically extract features from unstructured data. However, CNNs are sensitive to…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Minh Tran , Viet-Khoa Vo-Ho , Kyle Quinn , Hien Nguyen , Khoa Luu , Ngan Le

Vision Transformers (ViT) have recently brought a new wave of research in the field of computer vision. These models have performed particularly well in image classification and segmentation. Research on semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

Vision Transformers (ViT) are competing to replace Convolutional Neural Networks (CNN) for various computer vision tasks in medical imaging such as classification and segmentation. While the vulnerability of CNNs to adversarial attacks is a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Faris Almalik , Mohammad Yaqub , Karthik Nandakumar

Vision transformers (ViTs) have recently demonstrated state-of-the-art performance in a variety of vision tasks, replacing convolutional neural networks (CNNs). Meanwhile, since ViT has a different architecture than CNN, it may behave…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Bum Jun Kim , Hyeyeon Choi , Hyeonah Jang , Dong Gu Lee , Wonseok Jeong , Sang Woo Kim

The segmentation of medical images is important for the improvement and creation of healthcare systems, particularly for early disease detection and treatment planning. In recent years, the use of convolutional neural networks (CNNs) and…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Siddharth Tiwari

With the rapid development of deep learning, CNN-based U-shaped networks have succeeded in medical image segmentation and are widely applied for various tasks. However, their limitations in capturing global features hinder their performance…

Image and Video Processing · Electrical Eng. & Systems 2024-10-22 Xin Li , Wenhui Zhu , Xuanzhao Dong , Oana M. Dumitrascu , Yalin Wang

Transformer emerges as a powerful tool for visual recognition. In addition to demonstrating competitive performance on a broad range of visual benchmarks, recent works also argue that Transformers are much more robust than Convolutions…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Yutong Bai , Jieru Mei , Alan Yuille , Cihang Xie

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Convolutional Neural Networks (CNNs) are state-of-the-art models for document image classification tasks. However, many of these approaches rely on parameters and architectures designed for classifying natural images, which differ from…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Chris Tensmeyer , Tony Martinez

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

Despite the widespread adoption of transformers in medical applications, the exploration of multi-scale learning through transformers remains limited, while hierarchical representations are considered advantageous for computer-aided medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xiaoya Tang , Bodong Zhang , Man Minh Ho , Beatrice S. Knudsen , Tolga Tasdizen
‹ Prev 1 3 4 5 6 7 10 Next ›