English
Related papers

Related papers: Revitalizing CNN Attentions via Transformers in Se…

200 papers

From the viewpoint of physical-layer authentication, spoofing attacks can be foiled by checking channel state information (CSI). Existing CSI-based authentication algorithms mostly require a deep knowledge of the channel to deliver decent…

Machine Learning · Computer Science 2018-07-26 Qian Wang , Hang Li , Zhi Chen , Dou Zhao , Shuang Ye , Jiansheng Cai

This paper presents a novel approach to representation learning in recommender systems by integrating generative self-supervised learning with graph transformer architecture. We highlight the importance of high-quality data augmentation…

Information Retrieval · Computer Science 2023-06-06 Chaoliu Li , Lianghao Xia , Xubin Ren , Yaowen Ye , Yong Xu , Chao Huang

Weakly supervised object localization is a challenging task which aims to localize objects with coarse annotations such as image categories. Existing deep network approaches are mainly based on class activation map, which focuses on…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hui Su , Yue Ye , Zhiwei Chen , Mingli Song , Lechao Cheng

Recent promising effort for spectral reconstruction (SR) focuses on learning a complicated mapping through using a deeper and wider convolutional neural networks (CNNs). Nevertheless, most CNN-based SR algorithms neglect to explore the…

Image and Video Processing · Electrical Eng. & Systems 2020-05-20 Jiaojiao Li , Chaoxiong Wu , Rui Song , Yunsong Li , Fei Liu

Generative graph self-supervised learning (SSL) aims to learn node representations by reconstructing the input graph data. However, most existing methods focus on unsupervised learning tasks only and very few work has shown its superiority…

Machine Learning · Computer Science 2023-02-08 Xiang Li , Tiandi Ye , Caihua Shan , Dongsheng Li , Ming Gao

The development and adoption of Vision Transformers and other deep-learning architectures for image classification tasks has been rapid. However, the "black box" nature of neural networks is a barrier to adoption in applications where…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Mariano V. Ntrougkas , Nikolaos Gkalelis , Vasileios Mezaris

Convolutional Neural Networks (CNNs) have exhibited great performance in discriminative feature learning for complex visual tasks. Besides discrimination power, interpretability is another important yet under-explored property for CNNs. One…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Wengang Guo , Jiayi Yang , Huilin Yin , Qijun Chen , Wei Ye

Current space-based missions, such as the Transiting Exoplanet Survey Satellite (TESS), provide a large database of light curves that must be analysed efficiently and systematically. In recent years, deep learning (DL) methods, particularly…

Earth and Planetary Astrophysics · Physics 2025-04-15 Helem Salinas , Karim Pichara , Rafael Brahm , Francisco Pérez-Galarce , Domingo Mery

We present Attention Zoom, a modular and model-agnostic spatial attention mechanism designed to improve feature extraction in convolutional neural networks (CNNs). Unlike traditional attention approaches that require architecture-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Daniel DeAlcala , Aythami Morales , Julian Fierrez , Ruben Tolosana

Modulation recognition is a challenging task while performing spectrum sensing in a cognitive radio setup. Recently, the use of deep convolutional neural networks (CNNs) has shown to achieve state-of-the-art accuracy for modulation…

Signal Processing · Electrical Eng. & Systems 2018-03-06 Kumar Yashashwi , Amit Sethi , Prasanna Chaporkar

Graph Representation Learning (GRL) is an influential methodology, enabling a more profound understanding of graph-structured data and aiding graph clustering, a critical task across various domains. The recent incursion of attention…

Machine Learning · Computer Science 2023-08-15 Shuo Han , Jiacheng Liu , Jiayun Wu , Yinan Chen , Li Tao

This paper proposes a novel attention model for semantic segmentation, which aggregates multi-scale and context features to refine prediction. Specifically, the skeleton convolutional neural network framework takes in multiple different…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Shiqi Yang , Gang Peng

In this paper, we propose an efficient and accurate streaming speech recognition model based on the FastConformer architecture. We adapted the FastConformer architecture for streaming applications through: (1) constraining both the…

Computation and Language · Computer Science 2024-05-06 Vahid Noroozi , Somshubra Majumdar , Ankur Kumar , Jagadeesh Balam , Boris Ginsburg

We present a novel architectural enhancement of Channel Boosting in a deep convolutional neural network (CNN). This idea of Channel Boosting exploits both the channel dimension of CNN (learning from multiple input channels) and Transfer…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Asifullah Khan , Anabia Sohail , Amna Ali

This work proposes an unsupervised fusion framework based on deep convolutional transform learning. The great learning ability of convolutional filters for data analysis is well acknowledged. The success of convolutive features owes to…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Sentiment Analysis has seen much progress in the past two decades. For the past few years, neural network approaches, primarily RNNs and CNNs, have been the most successful for this task. Recently, a new category of neural networks,…

Computation and Language · Computer Science 2018-12-20 Artaches Ambartsoumian , Fred Popowich

There has been a recent surge in transformer-based architectures for learning on graphs, mainly motivated by attention as an effective learning mechanism and the desire to supersede handcrafted operators characteristic of message passing…

Machine Learning · Computer Science 2025-06-10 David Buterez , Jon Paul Janet , Dino Oglic , Pietro Lio

Recently, Transformer architecture has been introduced into image restoration to replace convolution neural network (CNN) with surprising results. Considering the high computational complexity of Transformer with global attention, some…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zheng Chen , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

Convolutional Neural Networks (CNNs) have achieved impressive results across many super-resolution (SR) and image restoration tasks. While many such networks can upscale low-resolution (LR) images using just the raw pixel-level information,…

Image and Video Processing · Electrical Eng. & Systems 2021-10-29 Matthew Aquilina , Christian Galea , John Abela , Kenneth P. Camilleri , Reuben A. Farrugia

The Convolutional Neural Networks (CNNs) have emerged as a very powerful data dependent hierarchical feature extraction method. It is widely used in several computer vision problems. The CNNs learn the important visual features from…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jayendra Kantipudi , Shiv Ram Dubey , Soumendu Chakraborty