English
Related papers

Related papers: Acoustic feature learning using cross-domain artic…

200 papers

Audio impairment recognition is based on finding noise in audio files and categorising the impairment type. Recently, significant performance improvement has been obtained thanks to the usage of advanced deep learning models. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Alessandro Ragano , Emmanouil Benetos , Andrew Hines

High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually…

Computation and Language · Computer Science 2017-08-21 Jinyu Li , Michael L. Seltzer , Xi Wang , Rui Zhao , Yifan Gong

Unsupervised representation learning for speech audios attained impressive performances for speech recognition tasks, particularly when annotated speech is limited. However, the unsupervised paradigm needs to be carefully designed and…

Sound · Computer Science 2022-11-01 Chendong Zhao , Jianzong Wang , Xiaoyang Qu , Haoqian Wang , Jing Xiao

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

Computation and Language · Computer Science 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

Transfer learning aims to reduce the amount of data required to excel at a new task by re-using the knowledge acquired from learning other related tasks. This paper proposes a novel transfer learning scenario, which distills robust phonetic…

Computation and Language · Computer Science 2019-07-11 Wei-Ning Hsu , David Harwath , James Glass

When only limited target domain data is available, domain adaptation could be used to promote performance of deep neural network (DNN) acoustic model by leveraging well-trained source model and target domain data. However, suffering from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 Han Zhu , Jiangjiang Zhao , Yuling Ren , Li Wang , Pengyuan Zhang

When comparing speech sounds across languages, scholars often make use of feature representations of individual sounds in order to determine fine-grained sound similarities. Although binary feature systems for large numbers of speech sounds…

Computation and Language · Computer Science 2024-05-08 Arne Rubehn , Jessica Nieder , Robert Forkel , Johann-Mattis List

Anomalous Sound Detection (ASD) is often formulated as a machine attribute classification task, a strategy necessitated by the common scenario where only normal data is available for training. However, the exhaustive collection of machine…

Sound · Computer Science 2025-09-22 Xin Fang , Guirui Zhong , Qing Wang , Fan Chu , Lei Wang , Mengui Qian , Mingqi Cai , Jiangzhao Wu , Jianqing Gao , Jun Du

This study introduces a novel training paradigm, audio difference learning, for improving audio captioning. The fundamental concept of the proposed learning method is to create a feature representation space that preserves the relationship…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Tatsuya Komatsu , Yusuke Fujita , Kazuya Takeda , Tomoki Toda

Speech enhancement techniques based on deep learning have brought significant improvement on speech quality and intelligibility. Nevertheless, a large gain in speech quality measured by objective metrics, such as perceptual evaluation of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-06 Bo Wu , Meng Yu , Lianwu Chen , Yong Xu , Chao Weng , Dan Su , Dong Yu

With the advent of modern AI architectures, a shift has happened towards end-to-end architectures. This pivot has led to neural architectures being trained without domain-specific biases/knowledge, optimized according to the task. We in…

Sound · Computer Science 2025-05-08 Prateek Verma

Both visual and auditory information are valuable to determine the salient regions in videos. Deep convolution neural networks (CNN) showcase strong capacity in coping with the audio-visual saliency prediction task. Due to various factors…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Yingzi Fan , Longfei Han , Yue Zhang , Lechao Cheng , Chen Xia , Di Hu

Hypernasality is a common characteristic symptom across many motor-speech disorders. For voiced sounds, hypernasality introduces an additional resonance in the lower frequencies and, for unvoiced sounds, there is reduced articulatory…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-14 Michael Saxon , Ayush Tripathi , Yishan Jiao , Julie Liss , Visar Berisha

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when…

Machine Learning · Computer Science 2022-05-09 Sanghyun Yoo , Inchul Song , Yoshua Bengio

Frequently misclassified pairs of classes that share many common acoustic properties exist in acoustic scene classification (ASC). To distinguish such pairs of classes, trivial details scattered throughout the data could be vital clues.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-10 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Ha-jin Yu

In this paper, we present a novel deep fusion architecture for audio classification tasks. The multi-channel model presented is formed using deep convolution layers where different acoustic features are passed through each channel. To…

Sound · Computer Science 2018-11-05 Gaurav Bhatt , Akshita Gupta , Aditya Arora , Balasubramanian Raman

Acoustic-to-articulatory inversion (AAI) is to obtain the movement of articulators from speech signals. Until now, achieving a speaker-independent AAI remains a challenge given the limited data. Besides, most current works only use audio…

Sound · Computer Science 2022-04-05 Jianrong Wang , Jinyu Liu , Longxuan Zhao , Shanyu Wang , Ruiguo Yu , Li Liu

The performance of child speech recognition is generally less satisfactory compared to adult speech due to limited amount of training data. Significant performance degradation is expected when applying an automatic speech recognition (ASR)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Wei Liu , Jingyu Li , Tan Lee

In classification tasks, the classification accuracy diminishes when the data is gathered in different domains. To address this problem, in this paper, we investigate several adversarial models for domain adaptation (DA) and their effect on…

Sound · Computer Science 2023-09-08 Stanisław Kacprzak , Konrad Kowalczyk

Most speech recognition tasks pertain to mapping words across two modalities: acoustic and orthographic. In this work, we suggest learning encoders that map variable-length, acoustic or phonetic, sequences that represent words into…

Machine Learning · Computer Science 2019-08-02 Mohamed El-Geish