English
Related papers

Related papers: EAANet: Efficient Attention Augmented Convolutiona…

200 papers

Recent research has made significant progress in designing fusion modules for audio-visual speech separation. However, they predominantly focus on multi-modal fusion at a single temporal scale of auditory and visual features without…

Sound · Computer Science 2024-02-05 Kai Li , Runxuan Yang , Fuchun Sun , Xiaolin Hu

In this paper, we address the scene segmentation task by capturing rich contextual dependencies based on the selfattention mechanism. Unlike previous works that capture contexts by multi-scale features fusion, we propose a Dual Attention…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jun Fu , Jing Liu , Haijie Tian , Yong Li , Yongjun Bao , Zhiwei Fang , Hanqing Lu

Emotion recognition in user-generated videos plays an important role in human-centered computing. Existing methods mainly employ traditional two-stage shallow pipeline, i.e. extracting visual and/or audio features and training classifiers.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sicheng Zhao , Yunsheng Ma , Yang Gu , Jufeng Yang , Tengfei Xing , Pengfei Xu , Runbo Hu , Hua Chai , Kurt Keutzer

The attention mechanism has gained significant recognition in the field of computer vision due to its ability to effectively enhance the performance of deep neural networks. However, existing methods often struggle to effectively utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Wei Xu , Yi Wan

The recent integration of attention mechanisms into segmentation networks improves their representational capabilities through a great emphasis on more informative features. However, these attention mechanisms ignore an implicit sub-task of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Zilong Zhong , Zhong Qiu Lin , Rene Bidart , Xiaodan Hu , Ibrahim Ben Daya , Zhifeng Li , Wei-Shi Zheng , Jonathan Li , Alexander Wong

With the goal of recovering high-quality image content from its degraded version, image restoration enjoys numerous applications, such as in surveillance, computational photography, medical imaging, and remote sensing. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

Image and Video Processing · Electrical Eng. & Systems 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang

We propose a novel architecture for object classification, called Self-Attention Capsule Networks (SACN). SACN is the first model that incorporates the Self-Attention mechanism as an integral layer within the Capsule Network (CapsNet).…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Assaf Hoogi , Brian Wilcox , Yachee Gupta , Daniel L. Rubin

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Improving the efficiency of state-of-the-art methods in semantic segmentation requires overcoming the increasing computational cost as well as issues such as fusing semantic information from global and local contexts. Based on the recent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Serdar Erisen

In the field of multimedia, single image deraining is a basic pre-processing work, which can greatly improve the visual effect of subsequent high-level tasks in rainy conditions. In this paper, we propose an effective algorithm, called…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Cong Wang , Yutong Wu , Zhixun Su , Junyang Chen

As wireless communication systems evolve, automatic modulation recognition (AMR) plays a key role in improving spectrum efficiency, especially in cognitive radio systems. Traditional AMR methods face challenges in complex, noisy…

Signal Processing · Electrical Eng. & Systems 2025-10-22 Wangye Jiang , Haoming Yang , Xinyu Lu , Mingyuan Wang , Huimei Sun , Jingya Zhang

Attention mechanisms have been boosting the performance of deep learning models on a wide range of applications, ranging from speech understanding to program induction. However, despite experiments from psychology which suggest that…

Machine Learning · Computer Science 2019-11-15 Lukas Hahne , Timo Lüddecke , Florentin Wörgötter , David Kappel

Since the breakthrough performance of AlexNet in 2012, convolutional neural networks (convnets) have grown into extremely powerful vision models. Deep learning researchers have used convnets to perform vision tasks with accuracy that was…

Machine Learning · Computer Science 2024-05-22 Andrew Lavin

Auditory attention detection (AAD) aims to detect the target speaker in a multi-talker environment from brain signals, such as electroencephalography (EEG), which has made great progress. However, most AAD methods solely utilize attention…

Human-Computer Interaction · Computer Science 2025-05-22 Lu Li , Cunhang Fan , Hongyu Zhang , Jingjing Zhang , Xiaoke Yang , Jian Zhou , Zhao Lv

Convolutional Neural Networks (CNNs) have achieved tremendous success in a number of learning tasks including image classification. Recent advanced models in CNNs, such as ResNets, mainly focus on the skip connection to avoid gradient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Xinglin Pan , Jing Xu , Yu Pan , liangjian Wen , WenXiang Lin , Kun Bai , Zenglin Xu

Vision Transformers (ViTs) have revolutionized computer vision by leveraging self-attention to model long-range dependencies. However, ViTs face challenges such as high computational costs due to the quadratic scaling of self-attention and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhoujie Qian

Extracting multi-scale information is key to semantic segmentation. However, the classic convolutional neural networks (CNNs) encounter difficulties in achieving multi-scale information extraction: expanding convolutional kernel incurs the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Mo Zhang , Jie Zhao , Xiang Li , Li Zhang , Quanzheng Li

Optical and hybrid convolutional neural networks (CNNs) recently have become of increasing interest to achieve low-latency, low-power image classification and computer vision tasks. However, implementing optical nonlinearity is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Anna Wirth-Singh , Jinlin Xiang , Minho Choi , Johannes E. Fröch , Luocheng Huang , Shane Colburn , Eli Shlizerman , Arka Majumdar

Automatic image segmentation technology is critical to the visual analysis. The autoencoder architecture has satisfying performance in various image segmentation tasks. However, autoencoders based on convolutional neural networks (CNN) seem…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Shiqiang Ma , Xuejian Li , Jijun Tang , Fei Guo