English
Related papers

Related papers: Frame-level SpecAugment for Deep Convolutional Neu…

200 papers

Conventional speech enhancement technique such as beamforming has known benefits for far-field speech recognition. Our own work in frequency-domain multi-channel acoustic modeling has shown additional improvements by training a spatial…

Sound · Computer Science 2020-02-10 Taejin Park , Kenichi Kumatani , Minhua Wu , Shiva Sundaram

We introduce Network Augmentation (NetAug), a new training method for improving the performance of tiny neural networks. Existing regularization techniques (e.g., data augmentation, dropout) have shown much success on large neural networks…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Han Cai , Chuang Gan , Ji Lin , Song Han

Deep learning-based speech enhancement methods have significantly improved speech quality and intelligibility. Convolutional neural networks (CNNs) have been proven to be essential components of many high-performance models. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-11 Dahan Wang , Xiaobin Rong , Shiruo Sun , Yuxiang Hu , Changbao Zhu , Jing Lu

Data augmentation is a widely adopted technique utilized to improve the robustness of automatic speech recognition (ASR). Employing a fixed data augmentation strategy for all training data is a common practice. However, it is important to…

Sound · Computer Science 2024-12-03 Hongxuan Lu , Biao Li

We propose an on-the-fly data augmentation method for automatic speech recognition (ASR) that uses alignment information to generate effective training samples. Our method, called Aligned Data Augmentation (ADA) for ASR, replaces…

Computation and Language · Computer Science 2023-06-13 Tsz Kin Lam , Mayumi Ohta , Shigehiko Schamoni , Stefan Riezler

Adapting pre-trained text Large Language Models (LLMs) into Speech Language Models (Speech LMs) via continual pretraining on speech data is promising, but often degrades the original text capabilities. We propose Multimodal Depth Upscaling,…

Computation and Language · Computer Science 2026-04-02 Kazuki Yano , Jun Suzuki , Shinji Watanabe

Recurrent neural networks (RNNs) have shown significant improvements in recent years for speech enhancement. However, the model complexity and inference time cost of RNNs are much higher than deep feed-forward neural networks (DNNs).…

Sound · Computer Science 2020-11-12 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen , Leichao Song

The application of deep learning to build accurate predictive models from functional neuroimaging data is often hindered by limited dataset sizes. Though data augmentation can help mitigate such training obstacles, most data augmentation…

Machine Learning · Computer Science 2019-10-21 Kevin P. Nguyen , Cherise Chin Fatt , Alex Treacher , Cooper Mellema , Madhukar H. Trivedi , Albert Montillo

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li

Data augmentation (DA) has become a de facto solution to expand training data size for deep learning. With the proliferation of deep models for time series analysis, various time series DA techniques are proposed in the literature, e.g.,…

Machine Learning · Computer Science 2023-02-21 Muxi Chen , Zhijian Xu , Ailing Zeng , Qiang Xu

Recently, phase processing is attracting increasinginterest in speech enhancement community. Some researchersintegrate phase estimations module into speech enhancementmodels by using complex-valued short-time Fourier transform(STFT)…

Sound · Computer Science 2019-01-03 Xingjian Du , Mengyao Zhu , Xuan Shi , Xinpeng Zhang , Wen Zhang , Jingdong Chen

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Sebastian Braun , Ivan Tashev

Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies…

Quantitative Methods · Quantitative Biology 2020-06-03 Ruqian Hao , Khashayar Namdar , Lin Liu , Masoom A. Haider , Farzad Khalvati

Data augmentation is essential to achieve state-of-the-art performance in many deep learning applications. However, the most effective augmentation techniques become computationally prohibitive for even medium-sized datasets. To address…

Machine Learning · Computer Science 2023-07-21 Tian Yu Liu , Baharan Mirzasoleiman

Data augmentation is vital to the generalization ability and robustness of deep neural networks (DNNs) models. Existing augmentation methods for speaker verification manipulate the raw signal, which are time-consuming and the augmented…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-19 Yuanyuan Wang , Yang Zhang , Zhiyong Wu , Zhihan Yang , Tao Wei , Kun Zou , Helen Meng

This paper describes the extension and optimization of our previous work on very deep convolutional neural networks (CNNs) for effective recognition of noisy speech in the Aurora 4 task. The appropriate number of convolutional layers, the…

Computation and Language · Computer Science 2016-10-04 Yanmin Qian , Philip C Woodland

We propose autoencoding speaker conversion for training data augmentation in automatic speech translation. This technique directly transforms an audio sequence, resulting in audio synthesized to resemble another speaker's voice. Our method…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-28 Arya D. McCarthy , Liezl Puzon , Juan Pino

Sequential recommender systems have recently achieved significant performance improvements with the exploitation of deep learning (DL) based methods. However, although various DL-based methods have been introduced, most of them only focus…

Information Retrieval · Computer Science 2022-03-29 Joo-yeong Song , Bongwon Suh

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe

This paper proposes a deep neural network (DNN)-based multi-channel speech enhancement system in which a DNN is trained to maximize the quality of the enhanced time-domain signal. DNN-based multi-channel speech enhancement is often…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Yoshiki Masuyama , Masahito Togami , Tatsuya Komatsu