English
Related papers

Related papers: CasNet: Investigating Channel Robustness for Speec…

200 papers

Robust speech processing in multi-talker environments requires effective speech separation. Recent deep learning systems have made significant progress toward solving this problem, yet it remains challenging particularly in real-time, short…

Sound · Computer Science 2018-04-19 Yi Luo , Nima Mesgarani

Various neural network architectures have been proposed in recent years for the task of multi-channel speech separation. Among them, the filter-and-sum network (FaSNet) performs end-to-end time-domain filter-and-sum beamforming and has…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-18 Yi Luo , Nima Mesgarani

Classroom environments are particularly challenging for children with hearing impairments, where background noise, multiple talkers, and reverberation degrade speech perception. These difficulties are greater for children than adults, yet…

In recent years, speech processing algorithms have seen tremendous progress primarily due to the deep learning renaissance. This is especially true for speech separation where the time-domain audio separation network (TasNet) has led to…

Sound · Computer Science 2021-03-30 Morten Kolbæk , Zheng-Hua Tan , Søren Holdt Jensen , Jesper Jensen

Deep learning speech separation algorithms have achieved great success in improving the quality and intelligibility of separated speech from mixed audio. Most previous methods focused on generating a single-channel output for each of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Cong Han , Yi Luo , Nima Mesgarani

Speech separation has been studied widely for single-channel close-talk microphone recordings over the past few years; developed solutions are mostly in frequency-domain. Recently, a raw audio waveform separation network (TasNet) is…

Sound · Computer Science 2019-07-25 Fahimeh Bahmaninezhad , Jian Wu , Rongzhi Gu , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu

Single-channel, speaker-independent speech separation methods have recently seen great progress. However, the accuracy, latency, and computational cost of such methods remain insufficient. The majority of the previous methods have…

Sound · Computer Science 2019-05-16 Yi Luo , Nima Mesgarani

In this paper, we address the problem of separating individual speech signals from videos using audio-visual neural processing. Most conventional approaches utilize frame-wise matching criteria to extract shared information between…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Jiyoung Lee , Soo-Whan Chung , Sunok Kim , Hong-Goo Kang , Kwanghoon Sohn

Beamforming has been extensively investigated for multi-channel audio processing tasks. Recently, learning-based beamforming methods, sometimes called \textit{neural beamformers}, have achieved significant improvements in both signal…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Yi Luo , Enea Ceolini , Cong Han , Shih-Chii Liu , Nima Mesgarani

We introduce CrossNet, a complex spectral mapping approach to speaker separation and enhancement in reverberant and noisy conditions. The proposed architecture comprises an encoder layer, a global multi-head self-attention module, a…

Sound · Computer Science 2024-03-07 Vahid Ahmadi Kalkhorani , DeLiang Wang

Time-domain audio separation network (TasNet) has achieved remarkable performance in blind source separation (BSS). Classic multi-channel speech processing framework employs signal estimation and beamforming. For example, Beam-TasNet links…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-13 Hangting Chen , Yang Yi , Dang Feng , Pengyuan Zhang

Extracting the speech of a target speaker from mixed audios, based on a reference speech from the target speaker, is a challenging yet powerful technology in speech processing. Recent studies of speaker-independent speech separation, such…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Zining Zhang , Bingsheng He , Zhenjie Zhang

Because the performance of speech separation is excellent for speech in which two speakers completely overlap, research attention has been shifted to dealing with more realistic scenarios. However, domain mismatch between training/test…

Sound · Computer Science 2022-06-22 Fan-Lin Wang , Hung-Shin Lee , Yu Tsao , Hsin-Min Wang

The deep learning based time-domain models, e.g. Conv-TasNet, have shown great potential in both single-channel and multi-channel speech enhancement. However, many experiments on the time-domain speech enhancement model are done in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Wangyou Zhang , Jing Shi , Chenda Li , Shinji Watanabe , Yanmin Qian

In conversational speech separation and recognition tasks, close-talk microphones are typically attached to each speaker during training data collection to capture near-field, close-talk mixture signals, in addition to using far-field…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-20 Zhong-Qiu Wang , Samuele Cornell

In recent years time domain speech separation has excelled over frequency domain separation in single channel scenarios and noise-free environments. In this paper we dissect the gains of the time-domain audio separation network (TasNet)…

We address the problem of acoustic source separation in a deep learning framework we call "deep clustering." Rather than directly estimating signals or masking functions, we train a deep network to produce spectrogram embeddings that are…

Neural and Evolutionary Computing · Computer Science 2015-08-19 John R. Hershey , Zhuo Chen , Jonathan Le Roux , Shinji Watanabe

Speech enhancement in multichannel settings has been realized by utilizing the spatial information embedded in multiple microphone signals. Moreover, deep neural networks (DNNs) have been recently advanced in this field; however, studies on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-28 Dongheon Lee , Seongrae Kim , Jung-Woo Choi

Deep learning methods have brought substantial advancements in speech separation (SS). Nevertheless, it remains challenging to deploy deep-learning-based models on edge devices. Thus, identifying an effective way to compress these large…

Sound · Computer Science 2019-12-10 Chao-I Tuan , Yuan-Kuei Wu , Hung-yi Lee , Yu Tsao

Single channel target speaker separation (TSS) aims at extracting a speaker's voice from a mixture of multiple talkers given an enrollment utterance of that speaker. A typical deep learning TSS framework consists of an upstream model that…

Sound · Computer Science 2022-10-27 Xiaoyu Liu , Xu Li , Joan Serrà
‹ Prev 1 2 3 10 Next ›