English
Related papers

Related papers: Convolutional Neural Networks and Vision Transform…

200 papers

This study explores human action recognition using a three-class subset of the COCO image corpus, benchmarking models from simple fully connected networks to transformer architectures. The binary Vision Transformer (ViT) achieved 90% mean…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 MingZe Tang , Madiha Kazi

Convolutional Neural Networks (CNNs) have achieved comparable error rates to well-trained human on ILSVRC2014 image classification task. To achieve better performance, the complexity of CNNs is continually increasing with deeper and bigger…

Computer Vision and Pattern Recognition · Computer Science 2014-12-30 Wei Yu , Kuiyuan Yang , Yalong Bai , Hongxun Yao , Yong Rui

In recent years, Vision Transformers (ViTs) have shown promising classification performance over Convolutional Neural Networks (CNNs) due to their self-attention mechanism. Many researchers have incorporated ViTs for Hyperspectral Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Shyam Varahagiri , Aryaman Sinha , Shiv Ram Dubey , Satish Kumar Singh

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

Vision transformers are nowadays the de-facto choice for image classification tasks. There are two broad categories of classification tasks, fine-grained and coarse-grained. In fine-grained classification, the necessity is to discover…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Mohit Vaishnav , Thomas Fel , Ivań Felipe Rodríguez , Thomas Serre

Human Action Recognition (HAR) encompasses the task of monitoring human activities across various domains, including but not limited to medical, educational, entertainment, visual surveillance, video retrieval, and the identification of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Khaled Alomar , Halil Ibrahim Aysel , Xiaohao Cai

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) are two dominant models for image analysis. While CNNs excel at extracting multi-scale features and ViTs effectively capture global dependencies, both suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Shicheng Yin , Kaixuan Yin , Weixing Chen , Enbo Huang , Yang Liu

We design a family of image classification architectures that optimize the trade-off between accuracy and efficiency in a high-speed regime. Our work exploits recent findings in attention-based architectures, which are competitive on highly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Ben Graham , Alaaeldin El-Nouby , Hugo Touvron , Pierre Stock , Armand Joulin , Hervé Jégou , Matthijs Douze

The recognition and classification of the diversity of materials that exist in the environment around us are a key visual competence that computer vision systems focus on in recent years. Understanding the identification of materials in…

Computer Vision and Pattern Recognition · Computer Science 2017-10-20 Anca Sticlaru

Convolutional Neural Networks (CNNs) have become the de facto gold standard in computer vision applications in the past years. Recently, however, new model architectures have been proposed challenging the status quo. The Vision Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Philipp Benz , Soomin Ham , Chaoning Zhang , Adil Karjauv , In So Kweon

Convolutional neural network (CNN) approaches available in the current literature are designed to work primarily with low-resolution images. When applied on very large images, challenges related to GPU memory, smaller receptive field than…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Deepak K. Gupta , Udbhav Bamba , Abhishek Thakur , Akash Gupta , Suraj Sharan , Ertugrul Demir , Dilip K. Prasad

The seminal work of Gatys et al. demonstrated the power of Convolutional Neural Networks (CNNs) in creating artistic imagery by separating and recombining image content and style. This process of using CNNs to render a content image in…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Yongcheng Jing , Yezhou Yang , Zunlei Feng , Jingwen Ye , Yizhou Yu , Mingli Song

Tokens or patches within Vision Transformers (ViT) lack essential semantic information, unlike their counterparts in natural language processing (NLP). Typically, ViT tokens are associated with rectangular image patches that lack specific…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Young Kyung Kim , J. Matías Di Martino , Guillermo Sapiro

As deep learning models increasingly find applications in critical domains such as medical imaging, the need for transparent and trustworthy decision-making becomes paramount. Many explainability methods provide insights into how these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Piotr Komorowski , Hubert Baniecki , Przemysław Biecek

While machine learning is currently transforming the field of histopathology, the domain lacks a comprehensive evaluation of state-of-the-art models based on essential but complementary quality requirements beyond a mere classification…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Maximilian Springenberg , Annika Frommholz , Markus Wenzel , Eva Weicken , Jackie Ma , Nils Strodthoff

Over the past few decades, convolutional neural networks (CNNs) have been at the forefront of the detection and tracking of various retinal diseases (RD). Despite their success, the emergence of vision transformers (ViT) in the 2020s has…

Image and Video Processing · Electrical Eng. & Systems 2024-04-17 Wenhui Zhu , Peijie Qiu , Xiwen Chen , Xin Li , Natasha Lepore , Oana M. Dumitrascu , Yalin Wang

Transformer, an attention-based encoder-decoder architecture, has not only revolutionized the field of natural language processing (NLP), but has also done some pioneering work in the field of computer vision (CV). Compared to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zujun Fu

While convolutional neural networks (CNNs) and vision transformers (ViTs) have advanced medical image segmentation, they face inherent limitations such as local receptive fields in CNNs and high computational complexity in ViTs. This paper…

Image and Video Processing · Electrical Eng. & Systems 2025-04-02 Pooya Ashtari , Shahryar Noei , Fateme Nateghi Haredasht , Jonathan H. Chen , Giuseppe Jurman , Aleksandra Pizurica , Sabine Van Huffel

Robots operating in human-centered environments, such as retail stores, restaurants, and households, are often required to distinguish between similar objects in different contexts with a high degree of accuracy. However, fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Songsong Xiong , Georgios Tziafas , Hamidreza Kasaei

Human activity recognition is an emerging and important area in computer vision which seeks to determine the activity an individual or group of individuals are performing. The applications of this field ranges from generating highlight…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 James Wensel , Hayat Ullah , Arslan Munir