English
Related papers

Related papers: IncepFormerNet: A multi-scale multi-head attention…

200 papers

Predicting the performance of deep learning (DL) models, such as execution time and resource utilization, is crucial for Neural Architecture Search (NAS), DL cluster schedulers, and other technologies that advance deep learning. The…

Performance · Computer Science 2025-02-04 Xinlong Zhao , Jiande Sun , Jia Zhang , Sujuan Hou , Shuai Li , Tong Liu , Ke Liu

The quality and richness of feature maps extracted by convolution neural networks (CNNs) and vision Transformers (ViTs) directly relate to the robust model performance. In medical computer vision, these information-rich features are crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yassine Barhoumi , Nidhal C. Bouaynaya , Ghulam Rasool

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

In this paper, we propose a novel Convolutional Neural Network (CNN) approach for the classification of raw dry-EEG signals without any data pre-processing. To illustrate the effectiveness of our approach, we utilise the Steady State Visual…

Human-Computer Interaction · Computer Science 2019-01-23 Nik Khadijah Nik Aznan , Stephen Bonner , Jason D. Connolly , Noura Al Moubayed , Toby P. Breckon

Attention mechanisms, which enable a neural network to accurately focus on all the relevant elements of the input, have become an essential component to improve the performance of deep neural networks. There are mainly two attention…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Qing-Long Zhang Yu-Bin Yang

For supervised speech enhancement, contextual information is important for accurate spectral mapping. However, commonly used deep neural networks (DNNs) are limited in capturing temporal contexts. To leverage long-term contexts for tracking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-13 Xinmeng Xu , Jianjun Hao

Transformer-based architectures have demonstrated remarkable success across various domains, but their deployment on edge devices remains challenging due to high memory and computational demands. In this paper, we introduce a novel Reuse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Seul-Ki Yeom , Tae-Ho Kim

The electroencephalography (EEG)-based motor imagery (MI) classification is a critical and challenging task in brain-computer interface (BCI) technology, which plays a significant role in assisting patients with functional impairments to…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Wei Peng , Kang Liu , Jiaxi Shi , Jianchen Hu

The encoder-decoder network is widely used to learn deep feature representations from pixel-wise annotations in biomedical image analysis. Under this structure, the performance profoundly relies on the effectiveness of feature extraction…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Weinan Song , Yuan Liang , Jiawei Yang , Kun Wang , Lei He

High-efficiency deep learning (DL) models are necessary not only to facilitate their use in devices with limited resources but also to improve resources required for training. Convolutional neural networks (ConvNets) typically exert severe…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Christos Kyrkou

Steady-State Visual Evoked Potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram…

When it comes to the classification of brain signals in real-life applications, the training and the prediction data are often described by different distributions. Furthermore, diverse data sets, e.g., recorded from various subjects or…

Detecting breast lesion in videos is crucial for computer-aided diagnosis. Existing video-based breast lesion detection approaches typically perform temporal feature aggregation of deep backbone features based on the self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chao Qin , Jiale Cao , Huazhu Fu , Rao Muhammad Anwer , Fahad Shahbaz Khan

Semantic segmentation has witnessed remarkable advancements with the adaptation of the Transformer architecture. Parallel to the strides made by the Transformer, CNN-based U-Net has seen significant progress, especially in high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Seul-Ki Yeom , Julian von Klitzing

Currently, convolutional neural networks (CNN) (e.g., U-Net) have become the de facto standard and attained immense success in medical image segmentation. However, as a downside, CNN based methods are a double-edged sword as they fail to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Reza Azad , Moein Heidari , Yuli Wu , Dorit Merhof

Objective: Brain networks have gained increasing recognition as potential biomarkers in mental health studies, but there are limited approaches that can leverage complex brain networks for accurate classification. Our goal is to develop a…

Methodology · Statistics 2022-05-25 Jin Ming , Suprateek Kundu

In this paper, we propose a model for the Environment Sound Classification Task (ESC) that consists of multiple feature channels given as input to a Deep Convolutional Neural Network (CNN) with Attention mechanism. The novelty of the paper…

Sound · Computer Science 2020-12-09 Jivitesh Sharma , Ole-Christoffer Granmo , Morten Goodwin

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

Machine Learning · Computer Science 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

Recently, deep learning has been successfully applied to the single-image super-resolution (SISR) with remarkable performance. However, most existing methods focus on building a more complex network with a large number of layers, which can…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Wenbin Zou , Tian Ye , Weixin Zheng , Yunchen Zhang , Liang Chen , Yi Wu

Automated segmentation of structural defects from visual inspection imagery remains challenging due to the diversity of damage types, extreme class imbalance, and the need for precise boundary delineation. This paper presents DeltaSeg, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enrique Hernandez Noguera , Md Meftahul Ferdaus , Elias Ioup , Mahdi Abdelguerfi