English
Related papers

Related papers: Masked Conditional Neural Networks for Audio Class…

200 papers

In this paper we present a Deep Neural Network architecture for the task of acoustic scene classification which harnesses information from increasing temporal resolutions of Mel-Spectrogram segments. This architecture is composed of…

Sound · Computer Science 2018-11-13 Alexander Schindler , Thomas Lidy , Andreas Rauber

Audio scene classification, the problem of predicting class labels of audio scenes, has drawn lots of attention during the last several years. However, it remains challenging and falls short of accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Kele Xu , Dawei Feng , Haibo Mi , Boqing Zhu , Dezhi Wang , Lilun Zhang , Hengxing Cai , Shuwen Liu

Mask processing in the time-frequency (T-F) domain through the neural network has been one of the mainstreams for single-channel speech enhancement. However, it is hard for most models to handle the situation when harmonics are partially…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-17 Tianrui Wang , Weibin Zhu , Yingying Gao , Junlan Feng , Shilei Zhang

The ability to accurately detect and classify objects at varying pixel sizes in cluttered scenes is crucial to many Navy applications. However, detection performance of existing state-of the-art approaches such as convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 JT Turner , Kalyan Moy Gupta , David Aha

Automatic identification of animal species by their vocalization is an important and challenging task. Although many kinds of audio monitoring system have been proposed in the literature, they suffer from several disadvantages such as…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-25 Weitao Xu , Xiang Zhang , Lina Yao , Wanli Xue , Bo Wei

Existing learning models often utilise CT-scan images to predict lung diseases. These models are posed by high uncertainties that affect lung segmentation and visual feature learning. We introduce MARL, a novel Multimodal Attentional…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ali Hamdi , Amr Aboeleneen , Khaled Shaban

The analysis of the structure of musical pieces is a task that remains a challenge for Artificial Intelligence, especially in the field of Deep Learning. It requires prior identification of structural boundaries of the music pieces. This…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-02 Carlos Hernandez-Olivan , Jose R. Beltran , David Diaz-Guerra

This paper proposes a Region-based Convolutional Recurrent Neural Network (R-CRNN) for audio event detection (AED). The proposed network is inspired by Faster-RCNN, a well known region-based convolutional network framework for visual object…

Sound · Computer Science 2018-08-22 Chieh-Chi Kao , Weiran Wang , Ming Sun , Chao Wang

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of spatial information and neural network based masking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Shubo Lv , Yihui Fu , Yukai Jv , Lei Xie , Weixin Zhu , Wei Rao , Yannan Wang

The performance of an Acoustic Scene Classification (ASC) system is highly depending on the latent temporal dynamics of the audio signal. In this paper, we proposed a multiple layers temporal pooling method using CNN feature sequence as…

Sound · Computer Science 2019-04-04 Liwen Zhang , Jiqing Han

Estimating time-frequency domain masks for speech enhancement using deep learning approaches has recently become a popular field of research. In this paper, we propose a mask-based speech enhancement framework by using concatenated…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-29 Ziyi Xu , Maximilian Strake , Tim Fingscheidt

Designing resource-efficient Deep Neural Networks (DNNs) is critical to deploy deep learning solutions over edge platforms due to diverse performance, power, and memory budgets. Unfortunately, it is often the case a well-trained ML model…

Machine Learning · Computer Science 2020-06-09 Sheng-Chun Kao , Arun Ramamurthy , Reed Williams , Tushar Krishna

Convolutional recurrent neural networks (CRNNs) have achieved state-of-the-art performance for sound event detection (SED). In this paper, we propose to use a dilated CRNN, namely a CRNN with a dilated convolutional kernel, as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-21 Yanxiong Li , Mingle Liu , Konstantinos Drossos , Tuomas Virtanen

Deep convolutional neural networks (DCNNs) are powerful models that yield impressive results at object classification. However, recent work has shown that they do not generalize well to partially occluded objects and to mask attacks. In…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Adam Kortylewski , Qing Liu , Huiyu Wang , Zhishuai Zhang , Alan Yuille

This paper presents a novel training method, Conditional Masked Language Modeling (CMLM), to effectively learn sentence representations on large scale unlabeled corpora. CMLM integrates sentence representation learning into MLM training by…

Computation and Language · Computer Science 2021-09-13 Ziyi Yang , Yinfei Yang , Daniel Cer , Jax Law , Eric Darve

A new musical instrument classification method using convolutional neural networks (CNNs) is presented in this paper. Unlike the traditional methods, we investigated a scheme for classifying musical instruments using the learned features…

Sound · Computer Science 2015-12-24 Taejin Park , Taejin Lee

In addition to being extremely non-linear, modern problems require millions if not billions of parameters to solve or at least to get a good approximation of the solution, and neural networks are known to assimilate that complexity by…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-14 Habib Ben Abdallah , Christopher J. Henry , Sheela Ramanna

Time delay neural network (TDNN) has been proven to be efficient for speaker verification. One of its successful variants, ECAPA-TDNN, achieved state-of-the-art performance at the cost of much higher computational complexity and slower…

Sound · Computer Science 2023-06-19 Hui Wang , Siqi Zheng , Yafeng Chen , Luyao Cheng , Qian Chen

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn