中文
相关论文

相关论文: CMGAN: Conformer-based Metric GAN for Speech Enhan…

200 篇论文

In recent decades, neural network based methods have significantly improved the performace of speech enhancement. Most of them estimate time-frequency (T-F) representation of target speech directly or indirectly, then resynthesize waveform…

声音 · 计算机科学 2020-02-06 Jingdong Li , Hui Zhang , Xueliang Zhang , Changliang Li

Influenced by the field of Computer Vision, Generative Adversarial Networks (GANs) are often adopted for the audio domain using fixed-size two-dimensional spectrogram representations as the "image data". However, in the (musical) audio…

声音 · 计算机科学 2021-08-02 Javier Nistal , Cyran Aouameur , Stefan Lattner , Gaël Richard

Lack of large, well-annotated emotional speech corpora continues to limit the performance and robustness of speech emotion recognition (SER), particularly as models grow more complex and the demand for multimodal systems increases. While…

声音 · 计算机科学 2026-02-13 Chung-Soo Ahn , Rajib Rana , Sunil Sivadas , Carlos Busso , Jagath C. Rajapakse

Advanced Generative Adversarial Networks (GANs) are remarkable in generating intelligible audio from a random latent vector. In this paper, we examine the task of recovering the latent vector of both synthesized and real audio. Previous…

声音 · 计算机科学 2020-10-19 Andrew Keyes , Nicky Bayat , Vahid Reza Khazaie , Yalda Mohsenzadeh

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

声音 · 计算机科学 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

Recent advances in neural network -based text-to-speech have reached human level naturalness in synthetic speech. The present sequence-to-sequence models can directly map text to mel-spectrogram acoustic features, which are convenient for…

音频与语音处理 · 电气工程与系统科学 2019-06-27 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

We propose Universal MelGAN, a vocoder that synthesizes high-fidelity speech in multiple domains. To preserve sound quality when the MelGAN-based structure is trained with a dataset of hundreds of speakers, we added multi-resolution…

音频与语音处理 · 电气工程与系统科学 2021-03-05 Won Jang , Dan Lim , Jaesam Yoon

In this paper we address the instability issue of generative adversarial network (GAN) by proposing a new similarity metric in unitary space of Schur decomposition for 2D representations of audio and speech signals. We show that encoding…

Recently Convolution-augmented Transformer (Conformer) has shown promising results in Automatic Speech Recognition (ASR), outperforming the previous best published Transformer Transducer. In this work, we believe that the output information…

计算与语言 · 计算机科学 2022-12-02 Xiaoming Ren , Huifeng Zhu , Liuwei Wei , Minghui Wu , Jie Hao

This paper proposes voicing-aware conditional discriminators for Parallel WaveGAN-based waveform synthesis systems. In this framework, we adopt a projection-based conditioning method that can significantly improve the discriminator's…

音频与语音处理 · 电气工程与系统科学 2021-04-27 Ryuichi Yamamoto , Eunwoo Song , Min-Jae Hwang , Jae-Min Kim

In this paper, we address the challenge of speech enhancement in real-world recordings, which often contain various forms of distortion, such as background noise, reverberation, and microphone artifacts. We revisit the use of Generative…

Steady-state visual evoked potentials (SSVEPs) based brain-computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency…

神经元与认知 · 定量生物学 2023-10-03 Yudong Pan , Ning Li , Yangsong Zhang , Peng Xu , Dezhong Yao

In this paper we demonstrate spoken speech enhancement using electroencephalography (EEG) signals using a generative adversarial network (GAN) based model, gated recurrent unit (GRU) regression based model, temporal convolutional network…

音频与语音处理 · 电气工程与系统科学 2020-04-21 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan , Ahmed H Tewfik

Phase information has a significant impact on speech perceptual quality and intelligibility. However, existing speech enhancement methods encounter limitations in explicit phase estimation due to the non-structural nature and wrapping…

音频与语音处理 · 电气工程与系统科学 2024-04-02 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

Finding synthetic artifacts of spoofing data will help the anti-spoofing countermeasures (CMs) system discriminate between spoofed and real speech. The Conformer combines the best of convolutional neural network and the Transformer,…

声音 · 计算机科学 2023-10-31 Yikang Wang , Hiromitsu Nishizaki , Ming Li

Conditional Generative Adversarial Networks (cGANs) have been used in many image processing tasks. However, they still have serious problems maintaining the balance between conditioning the output on the input and creating the output with…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Mohammadreza Naderi , Zahra Nabizadeh , Nader Karimi , Shahram Shirani , Shadrokh Samavi

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

机器学习 · 计算机科学 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

Despite major advancements in Automatic Speech Recognition (ASR), the state-of-the-art ASR systems struggle to deal with impaired speech even with high-resource languages. In Arabic, this challenge gets amplified, with added complexities in…

声音 · 计算机科学 2023-06-08 Massa Baali , Ibrahim Almakky , Shady Shehata , Fakhri Karray

We describe a modulation-domain loss function for deep-learning-based speech enhancement systems. Learnable spectro-temporal receptive fields (STRFs) were adapted to optimize for a speaker identification task. The learned STRFs were then…

音频与语音处理 · 电气工程与系统科学 2021-02-16 Tyler Vuong , Yangyang Xia , Richard M. Stern

In this paper we demonstrate that it is possible to generate more meaningful electroencephalography (EEG) features from raw EEG features using generative adversarial networks (GAN) to improve the performance of EEG based continuous speech…

音频与语音处理 · 电气工程与系统科学 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik