中文
相关论文

相关论文: Multichannel Loss Function for Supervised Speech S…

200 篇论文

Far-field speech processing is an important and challenging problem. In this paper, we propose \textit{deep ad-hoc beamforming}, a deep-learning-based multichannel speech enhancement framework based on ad-hoc microphone arrays, to address…

声音 · 计算机科学 2021-02-10 Xiao-Lei Zhang

Deep learning (DL) techniques have been intensively studied for the optimization of multi-user multiple-input single-output (MU-MISO) downlink systems owing to the capability of handling nonconvex formulations. However, the fixed…

信号处理 · 电气工程与系统科学 2022-07-13 Junbeom Kim , Hoon Lee , Seung-Eun Hong , Seok-Hwan Park

Various neural network architectures have been proposed in recent years for the task of multi-channel speech separation. Among them, the filter-and-sum network (FaSNet) performs end-to-end time-domain filter-and-sum beamforming and has…

音频与语音处理 · 电气工程与系统科学 2020-11-18 Yi Luo , Nima Mesgarani

The advent of deep learning has led to the prevalence of deep neural network architectures for monaural music source separation, with end-to-end approaches that operate directly on the waveform level increasingly receiving research…

音频与语音处理 · 电气工程与系统科学 2021-03-09 Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang

This paper describes speech enhancement for realtime automatic speech recognition (ASR) in real environments. A standard approach to this task is to use neural beamforming that can work efficiently in an online manner. It estimates the…

Employing deep neural networks (DNNs) to directly learn filters for multi-channel speech enhancement has potentially two key advantages over a traditional approach combining a linear spatial filter with an independent tempo-spectral…

音频与语音处理 · 电气工程与系统科学 2022-06-23 Kristina Tesch , Nils-Hendrik Mohrmann , Timo Gerkmann

Speech separation models are used for isolating individual speakers in many speech processing applications. Deep learning models have been shown to lead to state-of-the-art (SOTA) results on a number of speech separation benchmarks. One…

声音 · 计算机科学 2023-03-13 William Ravenscroft , Stefan Goetze , Thomas Hain

Current deep neural network (DNN) based speech separation faces a fundamental challenge -- while the models need to be trained on short segments due to computational constraints, real-world applications typically require processing…

音频与语音处理 · 电气工程与系统科学 2025-07-04 Yuzhu Wang , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

Automatic speech recognition in multi-channel reverberant conditions is a challenging task. The conventional way of suppressing the reverberation artifacts involves a beamforming based enhancement of the multi-channel speech signal, which…

音频与语音处理 · 电气工程与系统科学 2020-01-28 Anurenjan Purushothaman , Anirudh Sreeram , Sriram Ganapathy

Automatic speech recognition (ASR) in multichannel, multi-speaker scenarios remains challenging due to ambient noise, reverberation and overlapping speakers. In this paper, we propose a beamforming approach that processes specific angular…

声音 · 计算机科学 2025-09-15 Can Cui , Paul Magron , Mostafa Sadeghi , Emmanuel Vincent

Several studies have been conducted to automatically recognize activities of construction equipment using their generated sound patterns. Most of these studies are focused on single-machine scenarios under controlled environments. However,…

信号处理 · 电气工程与系统科学 2020-04-28 Behnam Sherafat , Abbas Rashidi , Siyuan Song

In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the…

音频与语音处理 · 电气工程与系统科学 2020-03-10 Weipeng He , Lu Lu , Biqiao Zhang , Jay Mahadeokar , Kaustubh Kalgaonkar , Christian Fuegen

We introduce a time-domain framework for efficient multichannel speech enhancement, emphasizing low latency and computational efficiency. This framework incorporates two compact deep neural networks (DNNs) surrounding a multichannel neural…

声音 · 计算机科学 2024-01-17 Tsun-An Hsieh , Jacob Donley , Daniel Wong , Buye Xu , Ashutosh Pandey

Sound processing in the human auditory system is complex and highly non-linear, whereas hearing aids (HAs) still rely on simplified descriptions of auditory processing or hearing loss to restore hearing. Even though standard HA…

音频与语音处理 · 电气工程与系统科学 2023-06-21 Fotios Drakopoulos , Sarah Verhulst

We propose multi-microphone complex spectral mapping, a simple way of applying deep learning for time-varying non-linear beamforming, for speaker separation in reverberant conditions. We aim at both speaker separation and dereverberation.…

声音 · 计算机科学 2021-05-25 Zhong-Qiu Wang , Peidong Wang , DeLiang Wang

To date, mainstream target speech separation (TSS) approaches are formulated to estimate the complex ratio mask (cRM) of the target speech in time-frequency domain under supervised deep learning framework. However, the existing deep models…

声音 · 计算机科学 2021-09-08 Rongzhi Gu , Shi-Xiong Zhang , Yuexian Zou , Dong Yu

The objective of deep learning methods based on encoder-decoder architectures for music source separation is to approximate either ideal time-frequency masks or spectral representations of the target music source(s). The spectral…

We propose a spatial loss for unsupervised multi-channel source separation. The proposed loss exploits the duality of direction of arrival (DOA) and beamforming: the steering and beamforming vectors should be aligned for the target source,…

音频与语音处理 · 电气工程与系统科学 2022-04-04 Kohei Saijo , Robin Scheibler

In recent years, waveform-mapping-based speech enhancement (SE) methods have garnered significant attention. These methods generally use a deep learning model to directly process and reconstruct speech waveforms. Because both the input and…

声音 · 计算机科学 2020-02-25 Chang-Le Liu , Sze-Wei Fu , You-Jin Li , Jen-Wei Huang , Hsin-Min Wang , Yu Tsao