English
Related papers

Related papers: NBC2: Multichannel Speech Separation with Revised …

200 papers

Short-time Fourier transform (STFT) is used as the front end of many popular successful monaural speech separation methods, such as deep clustering (DPCL), permutation invariant training (PIT) and their various variants. Since the frequency…

Sound · Computer Science 2019-02-05 Ziqiang Shi , Huibin Lin , Liu Liu , Rujie Liu , Jiqing Han

In this paper, we propose to train convolutional neural networks (CNNs) with both binarized weights and activations, leading to quantized models specifically} for mobile devices with limited power capacity and computation resources.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Lingqiao Liu , Ian Reid

Deep dilated temporal convolutional networks (TCN) have been proved to be very effective in sequence modeling. In this paper we propose several improvements of TCN for end-to-end approach to monaural speech separation, which consists of 1)…

Sound · Computer Science 2023-06-27 Liwen Zhang , Ziqiang Shi , Jiqing Han , Anyan Shi , Ding Ma

3D Convolutional Neural Networks (CNNs) have been widely adopted for airway segmentation. The performance of 3D CNNs is greatly influenced by the dataset while the public airway datasets are mainly clean CT scans with coarse annotation,…

Image and Video Processing · Electrical Eng. & Systems 2021-09-08 Minghui Zhang , Xin Yu , Hanxiao Zhang , Hao Zheng , Weihao Yu , Hong Pan , Xiangran Cai , Yun Gu

Far-field speech recognition is a challenging task that conventionally uses signal processing beamforming to attack noise and interference problem. But the performance has been found usually limited due to heavy reliance on environmental…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-08 Dongdi Zhao , Jianbo Ma , Lu Lu , Jinke Li , Xuan Ji , Lei Zhu , Fuming Fang , Ming Liu , Feijun Jiang

Initially developed for natural language processing (NLP), Transformer model is now widely used for speech processing tasks such as speaker recognition, due to its powerful sequence modeling capabilities. However, conventional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-28 Rui Wang , Junyi Ao , Long Zhou , Shujie Liu , Zhihua Wei , Tom Ko , Qing Li , Yu Zhang

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Learning speaker-specific features is vital in many applications like speaker recognition, diarization and speech recognition. This paper provides a novel approach, we term Neural Predictive Coding (NPC), to learn speaker-specific…

Sound · Computer Science 2019-07-18 Arindam Jati , Panayiotis Georgiou

We present a novel source separation model to decompose asingle-channel speech signal into two speech segments belonging to two different speakers. The proposed model is a neural network based on residual blocks, and uses learnt speaker…

Sound · Computer Science 2019-06-25 Shuo Liu , Gil Keren , Björn Schuller

We present an upper bound for the Single Channel Speech Separation task, which is based on an assumption regarding the nature of short segments of speech. Using the bound, we are able to show that while the recent methods have made…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Shahar Lutati , Eliya Nachmani , Lior Wolf

Human brain performs remarkably well in segregating a particular speaker from interfering ones in a multi-speaker scenario. It has been recently shown that we can quantitatively evaluate the segregation capability by modelling the…

Sound · Computer Science 2021-07-12 Ivine Kuruvila , Jan Muncke , Eghart Fischer , Ulrich Hoppe

In this paper, we propose an end-to-end post-filter method with deep attention fusion features for monaural speaker-independent speech separation. At first, a time-frequency domain speech separation method is applied as the pre-separation…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 Cunhang Fan , Jianhua Tao , Bin Liu , Jiangyan Yi , Zhengqi Wen , Xuefei Liu

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

This work presents a novel framework based on feed-forward neural network for text-independent speaker classification and verification, two related systems of speaker recognition. With optimized features and model training, it achieves 100%…

Sound · Computer Science 2017-03-20 Zhenhao Ge , Ananth N. Iyer , Srinath Cheluvaraja , Ram Sundaram , Aravind Ganapathiraju

The goal of this work is to develop a meeting transcription system that can recognize speech even when utterances of different speakers are overlapped. While speech overlaps have been regarded as a major obstacle in accurately transcribing…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-10 Takuya Yoshioka , Hakan Erdogan , Zhuo Chen , Xiong Xiao , Fil Alleva

Multichannel convolutive blind speech source separation refers to the problem of separating different speech sources from the observed multichannel mixtures without much a priori information about the mixing system. Multichannel nonnegative…

Sound · Computer Science 2024-01-04 Jianyu Wang , Shanzheng Guan

Recent research has made significant progress in designing fusion modules for audio-visual speech separation. However, they predominantly focus on multi-modal fusion at a single temporal scale of auditory and visual features without…

Sound · Computer Science 2024-02-05 Kai Li , Runxuan Yang , Fuchun Sun , Xiaolin Hu

Speech phase prediction, which is a significant research focus in the field of signal processing, aims to recover speech phase spectra from amplitude-related features. However, existing speech phase prediction methods are constrained to…

Sound · Computer Science 2023-08-21 Yang Ai , Ye-Xin Lu , Zhen-Hua Ling

Speech translation (ST) automatically converts utterances in a source language into text in another language. Splitting continuous speech into shorter segments, known as speech segmentation, plays an important role in ST. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-19 Ryo Fukuda , Katsuhito Sudoh , Satoshi Nakamura

Short text clustering is a challenging problem due to its sparseness of text representation. Here we propose a flexible Self-Taught Convolutional neural network framework for Short Text Clustering (dubbed STC^2), which can flexibly and…

Information Retrieval · Computer Science 2017-01-03 Jiaming Xu , Bo Xu , Peng Wang , Suncong Zheng , Guanhua Tian , Jun Zhao , Bo Xu