English
Related papers

Related papers: Convolutional Neural Networks and Vision Transform…

200 papers

Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Amr Farahat , Felix Effenberger , Martin Vinck

Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to directly search the optimal one via the widely used…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xiu Su , Shan You , Jiyang Xie , Mingkai Zheng , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Automated analysis of ancient coins has the potential to help researchers extract more historical insights from large collections of coins and to help collectors understand what they are buying or selling. Recent research in this area has…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 David Reid , Ognjen Arandjelovic

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

The rapid development of Convolutional Neural Networks (CNNs) in recent years has triggered significant breakthroughs in many machine learning (ML) applications. The ability to understand and compare various CNN models available is thus…

Machine Learning · Computer Science 2022-01-19 Xiwei Xuan , Xiaoyu Zhang , Oh-Hyun Kwon , Kwan-Liu Ma

Convolutional neural networks (CNNs) are one of the driving forces for the advancement of computer vision. Despite their promising performances on many tasks, CNNs still face major obstacles on the road to achieving ideal machine…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Boyang Deng , Qing Liu , Siyuan Qiao , Alan Yuille

The increasing reliance on machine learning systems has made their security a critical concern. Evasion attacks enable adversaries to manipulate the decision-making processes of AI systems, potentially causing security breaches or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Kasper Cools , Clara Maathuis , Alexander M. van Oers , Claudia S. Hübner , Nikos Deligiannis , Marijke Vandewal , Geert De Cubber

Vision transformers (ViTs) are usually considered to be less light-weight than convolutional neural networks (CNNs) due to the lack of inductive bias. Recent works thus resort to convolutions as a plug-and-play module and embed them in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Tao Huang , Lang Huang , Shan You , Fei Wang , Chen Qian , Chang Xu

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Rachid Reda Dokkar , Faten Chaieb , Hassen Drira , Arezki Aberkane

This paper presents a study on improving human action recognition through the utilization of knowledge distillation, and the combination of CNN and ViT models. The research aims to enhance the performance and efficiency of smaller student…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hamid Ahmadabadi , Omid Nejati Manzari , Ahmad Ayatollahi

Convolutional neural networks (CNNs) are the cutting edge model for supervised machine learning in computer vision. In recent years CNNs have outperformed traditional approaches in many computer vision tasks such as object detection, image…

Neural and Evolutionary Computing · Computer Science 2016-03-01 Nitzan Guberman

Although transformers have become the neural architectures of choice for natural language processing, they require orders of magnitude more training data, GPU memory, and computations in order to compete with convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Pranav Jeevan , Amit Sethi

Transformer has been applied in the field of computer vision due to its excellent performance in natural language processing, surpassing traditional convolutional neural networks and achieving new state-of-the-art. ViT divides an image into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuang Liu , Zhiheng Qiu , Xiaokai Qin

Although convolutional networks (ConvNets) have enjoyed great success in computer vision (CV), it suffers from capturing global information crucial to dense prediction tasks such as object detection and segmentation. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Haotian Yan , Zhe Li , Weijian Li , Changhu Wang , Ming Wu , Chuang Zhang

Convolutional neural networks (CNNs) and vision transformers (ViTs) have become essential in computer vision for local and global feature extraction. However, aggregating these architectures in existing methods often results in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Chunlei Meng , Jiacheng Yang , Wei Lin , Bowen Liu , Hongda Zhang , chun ouyang , Zhongxue Gan

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

Convolutional Neural Network (CNN) is the state-of-the-art for image classification task. Here we have briefly discussed different components of CNN. In this paper, We have explained different CNN architectures for image classification.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Farhana Sultana , A. Sufian , Paramartha Dutta

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Change detection in remote sensing images is essential for tracking environmental changes on the Earth's surface. Despite the success of vision transformers (ViTs) as backbones in numerous computer vision applications, they remain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Duowang Zhu , Xiaohu Huang , Haiyan Huang , Zhenfeng Shao , Qimin Cheng

Transformer, an attention-based encoder-decoder model, has already revolutionized the field of natural language processing (NLP). Inspired by such significant achievements, some pioneering works have recently been done on employing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Yang Liu , Yao Zhang , Yixin Wang , Feng Hou , Jin Yuan , Jiang Tian , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He