English
Related papers

Related papers: Efficient Low-Latency Speech Enhancement with Mobi…

200 papers

Data-driven models accurately perform early battery prognosis to prevent equipment failure and further safety hazards. Most existing machine learning (ML) models work in offline mode which must consider their retraining post-deployment…

Machine Learning · Computer Science 2025-09-22 Jonathan Adam Rico , Nagarajan Raghavan , Senthilnath Jayavelu

Neural architecture search (NAS) has attracted much attention and has been explored for automatic speech recognition (ASR). In this work, we focus on streaming ASR scenarios and propose the latency-controlled NAS for acoustic modeling.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Liqiang He , Shulin Feng , Dan Su , Dong Yu

Speech Enhancement techniques have become core technologies in mobile devices and voice software. Still, modern deep learning solutions often require high amount of computational resources what makes their usage on low-resource devices…

Sound · Computer Science 2025-07-24 Ekaterina Dmitrieva , Maksim Kaledin

Deep learning based end-to-end multi-channel speech enhancement methods have achieved impressive performance by leveraging sub-band, cross-band, and spatial information. However, these methods often demand substantial computational…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-18 Yaokai Zhang , Hanchen Pei , Wanqi Wang , Gongping Huang

In real acoustic environment, speech enhancement is an arduous task to improve the quality and intelligibility of speech interfered by background noise and reverberation. Over the past years, deep learning has shown great potential on…

Sound · Computer Science 2021-05-07 Kanghao Zhang , Shulin He , Hao Li , Xueliang Zhang

Audio-visual speech enhancement (AV-SE) methods utilize auxiliary visual cues to enhance speakers' voices. Therefore, technically they should be able to outperform the audio-only speech enhancement (SE) methods. However, there are few works…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Zirun Zhu , Hemin Yang , Min Tang , Ziyi Yang , Sefik Emre Eskimez , Huaming Wang

Existing deep learning based speech enhancement mainly employ a data-driven approach, which leverage large amounts of data with a variety of noise types to achieve noise removal from noisy signal. However, the high dependence on the data…

Sound · Computer Science 2024-01-24 Huaying Xue , Xiulian Peng , Yan Lu

Neural speech synthesis models can synthesize high quality speech but typically require a high computational complexity to do so. In previous work, we introduced LPCNet, which uses linear prediction to significantly reduce the complexity of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-24 Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy

Over the past few years, speech enhancement methods based on deep learning have greatly surpassed traditional methods based on spectral subtraction and spectral estimation. Many of these new techniques operate directly in the the short-time…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Jean-Marc Valin , Umut Isik , Neerad Phansalkar , Ritwik Giri , Karim Helwani , Arvindh Krishnaswamy

We present Multiscale Audio Spectrogram Transformer (MAST) for audio classification, which brings the concept of multiscale feature hierarchies to the Audio Spectrogram Transformer (AST). Given an input audio spectrogram, we first patchify…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Sreyan Ghosh , Ashish Seth , S. Umesh , Dinesh Manocha

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

The quality of speech codecs deteriorates at low bitrates due to high quantization noise. A post-filter is generally employed to enhance the quality of the coded speech. In this paper, a data-driven post-filter relying on masking in the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-13 Srikanth Korse , Kishan Gupta , Guillaume Fuchs

As a cost-effective and robust technology, automotive radar has seen steady improvement during the last years, making it an appealing complement to commonly used sensors like camera and LiDAR in autonomous driving. Radio frequency data with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuzhi Wu , Jun Liu , Guangfeng Jiang , Weijian Liu , Danilo Orlando

Having a sequence-to-sequence model which can operate in an online fashion is important for streaming applications such as Voice Search. Neural transducer is a streaming sequence-to-sequence model, but has shown a significant degradation in…

Computation and Language · Computer Science 2017-12-06 Tara N. Sainath , Chung-Cheng Chiu , Rohit Prabhavalkar , Anjuli Kannan , Yonghui Wu , Patrick Nguyen , Zhifeng Chen

This paper introduces a speech enhancement solution tailored for true wireless stereo (TWS) earbuds on-device usage. The solution was specifically designed to support conversations in noisy environments, with active noise cancellation (ANC)…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Hanbin Bae , Pavel Andreev , Azat Saginbaev , Nicholas Babaev , Won-Jun Lee , Hosang Sung , Hoon-Young Cho

The deep learning-based speech enhancement (SE) methods always take the clean speech's waveform or time-frequency spectrum feature as the learning target, and train the deep neural network (DNN) by reducing the error loss between the DNN's…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-02 Yuewei Zhang , Huanbin Zou , Jie Zhu

Today's Automatic Speech Recognition systems only rely on acoustic signals and often don't perform well under noisy conditions. Performing multi-modal speech recognition - processing acoustic speech signals and lip-reading video…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Matthijs Van keirsbilck , Bert Moons , Marian Verhelst

This paper presents a novel neural vocoder named APNet which reconstructs speech waveforms from acoustic features by predicting amplitude and phase spectra directly. The APNet vocoder is composed of an amplitude spectrum predictor (ASP) and…

Sound · Computer Science 2023-05-16 Yang Ai , Zhen-Hua Ling

We present a work on low-complexity acoustic scene classification (ASC) with multiple devices, namely the subtask A of Task 1 of the DCASE2021 challenge. This subtask focuses on classifying audio samples of multiple devices with a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Yanxiong Li , Wenchang Cao , Wei Xie , Qisheng Huang , Wenfeng Pang , Qianhua He

Telecom networks are rapidly growing in scale and complexity, making effective management, operation, and optimization increasingly challenging. Although Artificial Intelligence (AI) has been applied to many telecom tasks, existing models…

Artificial Intelligence · Computer Science 2025-11-04 Chenhua Shi , Bhavika Jalli , Gregor Macdonald , John Zou , Wanlu Lei , Mridul Jain , Joji Philip