English
Related papers

Related papers: CITISEN: A Deep Learning-Based Speech Signal-Proce…

200 papers

We present a state-of-the-art speech recognition system developed using end-to-end deep learning. Our architecture is significantly simpler than traditional speech systems, which rely on laboriously engineered processing pipelines; these…

We propose a new deep network for audio event recognition, called AENet. In contrast to speech, sounds coming from audio events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an…

Multimedia · Computer Science 2017-01-05 Naoya Takahashi , Michael Gygli , Luc Van Gool

Speech pre-processing techniques such as denoising, de-reverberation, and separation, are commonly employed as front-ends for various downstream speech processing tasks. However, these methods can sometimes be inadequate, resulting in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Sirui Li , Shuai Wang , Zhijun Liu , Zhongjie Jiang , Yannan Wang , Haizhou Li

Real-time speech enhancement (SE) is essential to online speech communication. Causal SE models use only the previous context while predicting future information, such as phoneme continuation, may help performing causal SE. The phonetic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Emiru Tsunoo , Yuki Saito , Wataru Nakata , Hiroshi Saruwatari

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and…

Computation and Language · Computer Science 2024-08-13 Wonjun Lee , San Kim , Gary Geunbae Lee

Deep learning-based speech enhancement has seen huge improvements and recently also expanded to full band audio (48 kHz). However, many approaches have a rather high computational complexity and require big temporal buffers for real time…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-12 Hendrik Schröter , Alberto N. Escalante-B. , Tobias Rosenkranz , Andreas Maier

This study introduces a reformed Sinc-convolution (Sincconv) framework tailored for the encoder component of deep networks for speech enhancement (SE). The reformed Sincconv, based on parametrized sinc functions as band-pass filters, offers…

Sound · Computer Science 2024-03-05 Kuan-Hsun Ho , Jeih-weih Hung , Berlin Chen

In this paper, we propose a model for the Environment Sound Classification Task (ESC) that consists of multiple feature channels given as input to a Deep Convolutional Neural Network (CNN) with Attention mechanism. The novelty of the paper…

Sound · Computer Science 2020-12-09 Jivitesh Sharma , Ole-Christoffer Granmo , Morten Goodwin

Speech, Music and Noise classification/segmentation is an important preprocessing step for audio processing/indexing. To this end, we propose a novel 1D Convolutional Neural Network (CNN) - SwishNet. It is a fast and lightweight…

Machine Learning · Computer Science 2018-12-04 Md. Shamim Hussain , Mohammad Ariful Haque

Casual conversations involving multiple speakers and noises from surrounding devices are common in everyday environments, which degrades the performances of automatic speech recognition systems. These challenging characteristics of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-24 Nelson Yalta , Shinji Watanabe , Takaaki Hori , Kazuhiro Nakadai , Tetsuya Ogata

The process of identifying human emotion and affective states from speech is known as speech emotion recognition (SER). This is based on the observation that tone and pitch in the voice frequently convey underlying emotion. Speech…

Sound · Computer Science 2024-06-18 Nishargo Nigar

With the advent of the 6G era, the concept of semantic communication has attracted increasing attention. Compared with conventional communication systems, semantic communication systems are not only affected by physical noise existing in…

Signal Processing · Electrical Eng. & Systems 2022-06-07 Xiang Peng , Zhijin Qin , Danlan Huang , Xiaoming Tao , Jianhua Lu , Guangyi Liu , Chengkang Pan

We propose Mobile Audio Streaming Networks (MASnet) for efficient low-latency speech enhancement, which is particularly suitable for mobile devices and other applications where computational capacity is a limitation. MASnet processes…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Michał Romaniuk , Piotr Masztalski , Karol Piaskowski , Mateusz Matuszewski

Reduction of unwanted environmental noises is an important feature of today's hearing aids (HA), which is why noise reduction is nowadays included in almost every commercially available device. The majority of these algorithms, however, is…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-26 Marc Aubreville , Kai Ehrensperger , Tobias Rosenkranz , Benjamin Graf , Henning Puder , Andreas Maier

We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Deploying a well-optimized pre-trained speaker recognition model in a new domain often leads to a significant decline in performance. While fine-tuning is a commonly employed solution, it demands ample adaptation data and suffers from…

Sound · Computer Science 2024-06-13 Tianhao Wang , Lantian Li , Dong Wang

Deep learning-based speech enhancement (SE) models have achieved impressive performance in the past decade. Numerous advanced architectures have been designed to deliver state-of-the-art performance; however, their scalability potential…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Wangyou Zhang , Kohei Saijo , Jee-weon Jung , Chenda Li , Shinji Watanabe , Yanmin Qian

Speech enhancement and source localization has been active research for several decades with a wide range of real-world applications. Recently, the Deep Complex Convolution Recurrent network (DCCRN) has yielded impressive enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Yuan Chen , Yicheng Hsu , Mingsian R. Bai

Recent work on encoder-decoder models for sequence-to-sequence mapping has shown that integrating both temporal and spatial attention mechanisms into neural networks increases the performance of the system substantially. In this work, we…

Machine Learning · Computer Science 2017-08-04 Stefan Braun , Daniel Neil , Enea Ceolini , Jithendar Anumula , Shih-Chii Liu

A typical neural speech enhancement (SE) approach mainly handles speech and noise mixtures, which is not optimal for singing voice enhancement scenarios. Music source separation (MSS) models treat vocals and various accompaniment components…

Sound · Computer Science 2023-10-09 Weiming Xu , Zhouxuan Chen , Zhili Tan , Shubo Lv , Runduo Han , Wenjiang Zhou , Weifeng Zhao , Lei Xie