English
Related papers

Related papers: An empirical study of Conv-TasNet

200 papers

Unsupervised representation learning of speech has been of keen interest in recent years, which is for example evident in the wide interest of the ZeroSpeech challenges. This work presents a new method for learning frame level…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Mingjie Chen , Thomas Hain

Time-domain audio separation network (TasNet) has achieved remarkable performance in blind source separation (BSS). Classic multi-channel speech processing framework employs signal estimation and beamforming. For example, Beam-TasNet links…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-13 Hangting Chen , Yang Yi , Dang Feng , Pengyuan Zhang

Neural network-based vocoders have recently demonstrated the powerful ability to synthesize high-quality speech. These models usually generate samples by conditioning on spectral features, such as Mel-spectrogram and fundamental frequency,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-13 Yunchao He , Yujun Wang

Convolutional Networks (ConvNets) have recently improved image recognition performance thanks to end-to-end learning of deep feed-forward models from raw pixels. Deep learning is a marked departure from the previous state of the art, the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-24 Albert Gordo , Adrien Gaidon , Florent Perronnin

In this paper, we propose TitaNet, a novel neural network architecture for extracting speaker representations. We employ 1D depth-wise separable convolutions with Squeeze-and-Excitation (SE) layers with global context followed by channel…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Nithin Rao Koluguri , Taejin Park , Boris Ginsburg

LPCNet is an efficient vocoder that combines linear prediction and deep neural network modules to keep the computational complexity low. In this work, we present two techniques to further reduce it's complexity, aiming for a low-cost LPCNet…

With the rapid development of speech conversion and speech synthesis algorithms, automatic speaker verification (ASV) systems are vulnerable to spoofing attacks. In recent years, researchers had proposed a number of anti-spoofing methods…

Sound · Computer Science 2022-12-23 Qiaowei Ma , Jinghui Zhong , Yitao Yang , Weiheng Liu , Ying Gao , Wing W. Y. Ng

Despite the recent success of speech separation models, they fail to separate sources properly while facing different sets of people or noisy environments. To tackle this problem, we proposed to apply meta-learning to the speech separation…

Sound · Computer Science 2021-05-04 Yuan-Kuei Wu , Kuan-Po Huang , Yu Tsao , Hung-yi Lee

Recently, several types of end-to-end speech recognition methods named transformer-transducer were introduced. According to those kinds of methods, transcription networks are generally modeled by transformer-based neural networks, while…

Machine Learning · Computer Science 2020-11-03 Jae-Jin Jeon , Eesung Kim

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec 2.0 deep speech…

Recent attempts at source tracing for codec-based deepfake speech (CodecFake), generated by neural audio codec-based speech generation (CoSG) models, have exhibited suboptimal performance. However, how to train source tracing models using…

Sound · Computer Science 2025-08-19 Xuanjun Chen , I-Ming Lin , Lin Zhang , Haibin Wu , Hung-yi Lee , Jyh-Shing Roger Jang

Inspired by the ConvNets with structured hidden representations, we propose a Tensor-based Neural Network, TCNN. Different from ConvNets, TCNNs are composed of structured neurons rather than scalar neurons, and the basic operation is neuron…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Zhenhua Chen , David Crandall

Recording channel mismatch between training and testing conditions has been shown to be a serious problem for speech separation. This situation greatly reduces the separation performance, and cannot meet the requirement of daily use. In…

Sound · Computer Science 2022-10-28 Fan-Lin Wang , Yao-Fei Cheng , Hung-Shin Lee , Yu Tsao , Hsin-Min Wang

The Automatic Speaker Verification systems have potential in biometrics applications for logical control access and authentication. A lot of things happen to be at stake if the ASV system is compromised. The preliminary work presents a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Rohit Arora

Auscultation for neonates is a simple and non-invasive method of providing diagnosis for cardiovascular and respiratory disease. Such diagnosis often requires high-quality heart and lung sounds to be captured during auscultation. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-27 Yang Yi Poh , Ethan Grooby , Kenneth Tan , Lindsay Zhou , Arrabella King , Ashwin Ramanathan , Atul Malhotra , Mehrtash Harandi , Faezeh Marzbanrad

We propose SpeakerNet - a new neural architecture for speaker recognition and speaker verification tasks. It is composed of residual blocks with 1D depth-wise separable convolutions, batch-normalization, and ReLU layers. This architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Nithin Rao Koluguri , Jason Li , Vitaly Lavrukhin , Boris Ginsburg

We consider the task of unsupervised extraction of meaningful latent representations of speech by applying autoencoding neural networks to speech waveforms. The goal is to learn a representation able to capture high level semantic content…

Machine Learning · Computer Science 2019-09-12 Jan Chorowski , Ron J. Weiss , Samy Bengio , Aäron van den Oord

The Recurrent Neural Network-Transducer (RNN-T) is widely adopted in end-to-end (E2E) automatic speech recognition (ASR) tasks but depends heavily on large-scale, high-quality annotated data, which are often costly and difficult to obtain.…

Computation and Language · Computer Science 2025-11-07 Dongji Gao , Chenda Liao , Changliang Liu , Matthew Wiesner , Leibny Paola Garcia , Daniel Povey , Sanjeev Khudanpur , Jian Wu

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim

We present the first neural network model to achieve real-time and streaming target sound extraction. To accomplish this, we propose Waveformer, an encoder-decoder architecture with a stack of dilated causal convolution layers as the…