中文
相关论文

相关论文: ForkNet: Simultaneous Time and Time-Frequency Doma…

200 篇论文

This paper proposes MP-SENet, a novel Speech Enhancement Network which directly denoises Magnitude and Phase spectra in parallel. The proposed MP-SENet adopts a codec architecture in which the encoder and decoder are bridged by…

音频与语音处理 · 电气工程与系统科学 2024-01-15 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

Neural network applications generally benefit from larger-sized models, but for current speech enhancement models, larger scale networks often suffer from decreased robustness to the variety of real-world use cases beyond what is…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Umut Isik , Ritwik Giri , Neerad Phansalkar , Jean-Marc Valin , Karim Helwani , Arvindh Krishnaswamy

Self-supervised learning has demonstrated impressive performance in speech tasks, yet there remains ample opportunity for advancement in the realm of speech enhancement research. In addressing speech tasks, confining the attention mechanism…

音频与语音处理 · 电气工程与系统科学 2024-08-14 Tao Zheng , Liejun Wang , Yinfeng Yu

By implicitly recognizing a user based on his/her speech input, speaker identification enables many downstream applications, such as personalized system behavior and expedited shopping checkouts. Based on whether the speech content is…

机器学习 · 计算机科学 2021-06-21 Ruirui Li , Chelsea J. -T. Ju , Zeya Chen , Hongda Mao , Oguz Elibol , Andreas Stolcke

Continual pre-training has been urgent for adapting a pre-trained model to a multitude of domains and tasks in the fast-evolving world. In practice, a continually pre-trained model is expected to demonstrate not only greater capacity when…

计算与语言 · 计算机科学 2023-10-23 Gangwei Jiang , Caigao Jiang , Siqiao Xue , James Y. Zhang , Jun Zhou , Defu Lian , Ying Wei

The most recent deep neural network (DNN) models exhibit impressive denoising performance in the time-frequency (T-F) magnitude domain. However, the phase is also a critical component of the speech signal that is easily overlooked. In this…

音频与语音处理 · 电气工程与系统科学 2021-06-10 Lu Zhang , Mingjiang Wang , Zehua Zhang , Xuyi Zhuang

Neural time-series analysis has traditionally focused on modeling data in the time domain, often with some approaches incorporating equivalent Fourier domain representations as auxiliary spectral features. In this work, we shift the main…

机器学习 · 计算机科学 2024-10-08 Minjung Kim , Yusuke Hioka , Michael Witbrock

Building a single universal speech enhancement (SE) system that can handle arbitrary input is a demanded but underexplored research topic. Towards this ultimate goal, one direction is to build a single model that handles diverse audio…

音频与语音处理 · 电气工程与系统科学 2024-02-19 Wangyou Zhang , Jee-weon Jung , Shinji Watanabe , Yanmin Qian

Representations from pre-trained speech foundation models (SFMs) have shown impressive performance in many downstream tasks. However, the potential benefits of incorporating pre-trained SFM representations into speaker voice similarity…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Chun Yin , Tai-Shih Chi , Yu Tsao , Hsin-Min Wang

Spectral analysis provides one of the most effective paradigms for information-preserving dimensionality reduction, as simple descriptions of naturally occurring signals are often obtained via few terms of periodic basis functions. In this…

机器学习 · 计算机科学 2022-11-29 Michael Poli , Stefano Massaroli , Federico Berto , Jinykoo Park , Tri Dao , Christopher Ré , Stefano Ermon

Time-domain single-channel speech enhancement (SE) still remains challenging to extract the target speaker without any prior information on multi-talker conditions. It has been shown via auditory attention decoding that the brain activity…

音频与语音处理 · 电气工程与系统科学 2023-05-18 Jie Zhang , Qing-Tian Xu , Qiu-Shi Zhu , Zhen-Hua Ling

In this paper, a time delay neural network (TDNN) based acoustic model is proposed to implement a fast-converged acoustic modeling for Korean speech recognition. The TDNN has an advantage in fast-convergence where the amount of training…

计算与语言 · 计算机科学 2018-07-17 Hosung Park , Donghyun Lee , Minkyu Lim , Yoseb Kang , Juneseok Oh , Ji-Hwan Kim

Speech systems developed for a particular choice of acoustic domain and sampling frequency do not translate easily to others. The usual practice is to learn domain adaptation and bandwidth extension models independently. Contrary to this,…

音频与语音处理 · 电气工程与系统科学 2022-04-01 Saurabh Kataria , Jesús Villalba , Laureano Moro-Velázquez , Najim Dehak

In the telephony scenarios, the fake speech detection (FSD) task to combat speech spoofing attacks is challenging. Data augmentation (DA) methods are considered effective means to address the FSD task in telephony scenarios, typically…

声音 · 计算机科学 2024-06-17 Cunhang Fan , Shunbo Dong , Jun Xue , Yujie Chen , Jiangyan Yi , Zhao Lv

This study addresses the task of performing robust and reliable time-delay estimation in signals in noisy and reverberating environments. In contrast to the popular signal processing based methods, this paper proposes to transform the input…

音频与语音处理 · 电气工程与系统科学 2025-09-03 Akshay Raina , Vipul Arora

The decoupling-style concept begins to ignite in the speech enhancement area, which decouples the original complex spectrum estimation task into multiple easier sub-tasks i.e., magnitude-only recovery and the residual complex spectrum…

声音 · 计算机科学 2022-08-02 Guochen Yu , Andong Li , Hui Wang , Yutian Wang , Yuxuan Ke , Chengshi Zheng

Recently, frequency transformation (FT) has been increasingly incorporated into deep learning models to significantly enhance state-of-the-art accuracy and efficiency in time series analysis. The advantages of FT, such as high efficiency…

机器学习 · 计算机科学 2025-06-16 Kun Yi , Qi Zhang , Wei Fan , Longbing Cao , Shoujin Wang , Guodong Long , Liang Hu , Hui He , Qingsong Wen , Hui Xiong

Foundation models, particularly Large Language Models (LLMs), have revolutionized text and video processing, yet time series data presents distinct challenges for such approaches due to domain-specific features such as missing values,…

机器学习 · 计算机科学 2025-02-12 Defu Cao , Wen Ye , Yizhou Zhang , Yan Liu

Score-based generative models (SGMs) have recently shown impressive results for difficult generative tasks such as the unconditional and conditional generation of natural images and audio signals. In this work, we extend these models to the…

音频与语音处理 · 电气工程与系统科学 2022-07-08 Simon Welker , Julius Richter , Timo Gerkmann

The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based time domain source…

音频与语音处理 · 电气工程与系统科学 2020-04-14 Thilo von Neumann , Keisuke Kinoshita , Lukas Drude , Christoph Boeddeker , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach