English
Related papers

Related papers: Intentional Attention Mask Transformation for Robu…

200 papers

Deep learning-based speech enhancement methods have significantly improved speech quality and intelligibility. Convolutional neural networks (CNNs) have been proven to be essential components of many high-performance models. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-11 Dahan Wang , Xiaobin Rong , Shiruo Sun , Yuxiang Hu , Changbao Zhu , Jing Lu

Top-performing landmark estimation algorithms are based on exploiting the excellent ability of large convolutional neural networks (CNNs) to represent local appearance. However, it is well known that they can only learn weak spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Andrés Prados-Torreblanca , José M. Buenaposada , Luis Baumela

The attention mechanisms have been employed in Convolutional Neural Network (CNN) to enhance the feature representation. However, existing attention mechanisms only concentrate on refining the features inside each sample and neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Qishang Cheng , Hongliang Li , Qingbo Wu , King Ngi Ngan

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Attention is typically used to select informative sub-phrases that are used for prediction. This paper investigates the novel use of attention as a form of feature augmentation, i.e, casted attention. We propose Multi-Cast Attention…

Computation and Language · Computer Science 2018-06-05 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee

Deep neural network is an effective choice to automatically recognize human actions utilizing data from various wearable sensors. These networks automate the process of feature extraction relying completely on data. However, various noises…

Signal Processing · Electrical Eng. & Systems 2021-01-05 Tanvir Mahmud , A. Q. M. Sazzad Sayyed , Shaikh Anowarul Fattah , Sun-Yuan Kung

Convolutional neural networks (CNNs) are the cutting edge model for supervised machine learning in computer vision. In recent years CNNs have outperformed traditional approaches in many computer vision tasks such as object detection, image…

Neural and Evolutionary Computing · Computer Science 2016-03-01 Nitzan Guberman

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e.g., classification and segmentation. Unlike prior works, which were trained to optimize the weights of a pre-selected set of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Liqiang Lin , Pengdi Huang , Chi-Wing Fu , Kai Xu , Hao Zhang , Hui Huang

Context can strongly affect object representations, sometimes leading to undesired biases, particularly when objects appear in out-of-distribution backgrounds at inference. At the same time, many object-centric tasks require to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Ananthu Aniraj , Cassio F. Dantas , Dino Ienco , Diego Marcos

The splendid success of convolutional neural networks (CNNs) in computer vision is largely attributable to the availability of massive annotated datasets, such as ImageNet and Places. However, in medical imaging, it is challenging to create…

Machine Learning · Computer Science 2021-04-13 Zongwei Zhou , Jae Y. Shin , Suryakanth R. Gurudu , Michael B. Gotway , Jianming Liang

Audio scene classification, the problem of predicting class labels of audio scenes, has drawn lots of attention during the last several years. However, it remains challenging and falls short of accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Kele Xu , Dawei Feng , Haibo Mi , Boqing Zhu , Dezhi Wang , Lilun Zhang , Hengxing Cai , Shuwen Liu

Motivated by the fact that characteristics of different sound classes are highly diverse in different temporal scales and hierarchical levels, a novel deep convolutional neural network (CNN) architecture is proposed for the environmental…

Sound · Computer Science 2018-06-15 Boqing Zhu , Kele Xu , Dezhi Wang , Lilun Zhang , Bo Li , Yuxing Peng

Most of the recent successful methods in accurate object detection build on the convolutional neural networks (CNN). However, due to the lack of scale normalization in CNN-based detection methods, the activated channels in the feature space…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Yonghyun Kim , Bong-Nam Kang , Daijin Kim

Robustness of neural networks has recently been highlighted by the adversarial examples, i.e., inputs added with well-designed perturbations which are imperceptible to humans but can cause the network to give incorrect outputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Tiange Luo , Tianle Cai , Mengxiao Zhang , Siyu Chen , Liwei Wang

Finding a template in a search image is an important task underlying many computer vision applications. Recent approaches perform template matching in a deep feature-space, produced by a convolutional neural network (CNN), which is found to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Bo Gao , M. W. Spratling

Convolutional neural networks (CNNs) have become the most successful approach in many vision-related domains. However, they are limited to domains where data is abundant. Recent works have looked at multi-task learning (MTL) to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Ludovic Trottier , Philippe Giguère , Brahim Chaib-draa

Feature selection has drawn much attention over the last decades in machine learning because it can reduce data dimensionality while maintaining the original physical meaning of features, which enables better interpretability than feature…

Machine Learning · Computer Science 2022-09-27 Yiwen Liao , Jochen Rivoir , Raphaël Latty , Bin Yang

The recent success of Vision Transformers is shaking the long dominance of Convolutional Neural Networks (CNNs) in image recognition for a decade. Specifically, in terms of robustness on out-of-distribution samples, recent research finds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zeyu Wang , Yutong Bai , Yuyin Zhou , Cihang Xie