English
Related papers

Related papers: A Comparative Study of Transformer and Convolution…

200 papers

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

We introduce VistaFormer, a lightweight Transformer-based model architecture for the semantic segmentation of remote-sensing images. This model uses a multi-scale Transformer-based encoder with a lightweight decoder that aggregates global…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Ezra MacDonald , Derek Jacoby , Yvonne Coady

The focus of this paper is using a convolutional machine learning model with a modified U-Net structure for creating land cover classification mapping based on satellite imagery. The aim of the research is to train and test convolutional…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Priit Ulmas , Innar Liiv

In recent years, Vision Transformers (ViTs) have shown promising classification performance over Convolutional Neural Networks (CNNs) due to their self-attention mechanism. Many researchers have incorporated ViTs for Hyperspectral Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Shyam Varahagiri , Aryaman Sinha , Shiv Ram Dubey , Satish Kumar Singh

In the past few years, convolutional neural networks (CNNs) have achieved milestones in medical image analysis. Especially, the deep neural networks based on U-shaped architecture and skip-connections have been widely applied in a variety…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Hu Cao , Yueyue Wang , Joy Chen , Dongsheng Jiang , Xiaopeng Zhang , Qi Tian , Manning Wang

Earth observation (EO) satellite missions have been providing detailed images about the state of the Earth and its land cover for over 50 years. Long term missions, such as NASA's Landsat, Terra, and Aqua satellites, and more recently, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-27 Lynn Miller , Charlotte Pelletier , Geoffrey I. Webb

Convolutional Neural Networks (CNN) has been extensively studied for Hyperspectral Image Classification (HSIC) more specifically, 2D and 3D CNN models have proved highly efficient in exploiting the spatial and spectral information of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Muhammad Ahmad , Sidrah Shabbir , Rana Aamir Raza , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan

Modern Convolutional Neural Networks (CNN) are extremely powerful on a range of computer vision tasks. However, their performance may degrade when the data is characterised by large intra-class variability caused by spatial transformations.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Roberto Annunziata , Christos Sagonas , Jacques Calì

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

This study investigates the classification of aerial images depicting transmission towers, forests, farmland, and mountains. To complete the classification job, features are extracted from input photos using a Convolutional Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Mustafa Majeed Abd Zaid , Ahmed Abed Mohammed , Putra Sumari

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis. Recently, vision transformers (ViTs) have appeared as a competitive alternative to CNNs, yielding similar levels…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Christos Matsoukas , Johan Fredin Haslum , Magnus Söderberg , Kevin Smith

Precise crop yield prediction provides valuable information for agricultural planning and decision-making processes. However, timely predicting crop yields remains challenging as crop growth is sensitive to growing season weather variation…

This paper presents a comparative evaluation of convolutional and transformer-based object detection architectures for early weed detection in tomato plantations. Representative models from each paradigm are considered, including…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Alcides Toledo Espinosa , Gerardo Antonio Álvarez Hernández , Ángel Eduardo Zamora-Suárez , Miguel Bolaños , Juan Irving Vásquez

One unique property of time series is that the temporal relations are largely preserved after downsampling into two sub-sequences. By taking advantage of this property, we propose a novel neural network architecture that conducts sample…

Machine Learning · Computer Science 2022-10-14 Minhao Liu , Ailing Zeng , Muxi Chen , Zhijian Xu , Qiuxia Lai , Lingna Ma , Qiang Xu

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

Time series data of urban land cover is of great utility in analyzing urban growth patterns, changes in distribution of impervious surface and vegetation and resulting impacts on urban micro climate. While Landsat data is ideal for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Krishna Kumar Perikamana , Krishnachandran Balakrishnan , Pratyush Tripathy

Casting semantic segmentation of outdoor LiDAR point clouds as a 2D problem, e.g., via range projection, is an effective and popular approach. These projection-based methods usually benefit from fast computations and, when combined with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Angelika Ando , Spyros Gidaris , Andrei Bursuc , Gilles Puy , Alexandre Boulch , Renaud Marlet

Modern IoT deployments for environmental sensing produce high volume spatiotemporal data to support downstream tasks such as forecasting, typically powered by machine learning models. While existing filtering and strategic deployment…

Machine Learning · Computer Science 2025-12-02 Ragini Gupta , Naman Raina , Bo Chen , Li Chen , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

Agriculture is vital for human survival and remains a major driver of several economies around the world; more so in underdeveloped and developing economies. With increasing demand for food and cash crops, due to a growing global population…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Daniel K. Nkemelu , Daniel Omeiza , Nancy Lubalo