English
Related papers

Related papers: A Multi-Resolution Front-End for End-to-End Speech…

200 papers

This study addresses unsupervised subword modeling, i.e., learning acoustic feature representations that can distinguish between subword units of a language. We propose a two-stage learning framework that combines self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Siyuan Feng , Odette Scharenborg

Recently, deep neural network (DNN) based time-frequency (T-F) mask estimation has shown remarkable effectiveness for speech enhancement. Typically, a single T-F mask is first estimated based on DNN and then used to mask the spectrogram of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-29 Liangchen Zhou , Wenbin Jiang , Jingyan Xu , Fei Wen , Peilin Liu

Feature selection has been widely used to alleviate compute requirements during training, elucidate model interpretability, and improve model generalizability. We propose SLM -- Sparse Learnable Masks -- a canonical approach for end-to-end…

Machine Learning · Computer Science 2023-04-07 Yihe Dong , Sercan O. Arik

Now-a-days, speech-based biometric systems such as automatic speaker verification (ASV) are highly prone to spoofing attacks by an imposture. With recent development in various voice conversion (VC) and speech synthesis (SS) algorithms,…

Sound · Computer Science 2016-11-18 Dipjyoti Paul , Monisankha Pal , Goutam Saha

Automatic speaker verification systems are vulnerable to a variety of access threats, prompting research into the formulation of effective spoofing detection systems to act as a gate to filter out such spoofing attacks. This study…

Sound · Computer Science 2022-11-21 Zhenyu Wang , John H. L. Hansen

Downsampling is widely adopted to achieve a good trade-off between accuracy and latency for visual recognition. Unfortunately, the commonly used pooling layers are not learned, and thus cannot preserve important information. As another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ho Man Kwan , Shenghui Song

When evaluating the performance of automatic speech recognition models, usually word error rate within a certain dataset is used. Special care must be taken in understanding the dataset in order to report realistic performance numbers. We…

Computation and Language · Computer Science 2021-05-21 Aashish Agarwal , Torsten Zesch

The Automatic Speaker Verification systems have potential in biometrics applications for logical control access and authentication. A lot of things happen to be at stake if the ASV system is compromised. The preliminary work presents a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Rohit Arora

In this paper, we propose an end-to-end post-filter method with deep attention fusion features for monaural speaker-independent speech separation. At first, a time-frequency domain speech separation method is applied as the pre-separation…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 Cunhang Fan , Jianhua Tao , Bin Liu , Jiangyan Yi , Zhengqi Wen , Xuefei Liu

Background and Aim: Over-fitting issue has been the reason behind deep learning technology not being successfully implemented in oral cancer images classification. The aims of this research were reducing overfitting for accurately producing…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Prakrit Joshi , Omar Hisham Alsadoon , Abeer Alsadoon , Nada AlSallami , Tarik A. Rashid , P. W. C. Prasad , Sami Haddad

The reliability of using fully convolutional networks (FCNs) has been successfully demonstrated by recent studies in many speech applications. One of the most popular variants of these FCNs is the `U-Net', which is an encoder-decoder…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-10 Vinay Kothapally , Wei Xia , Shahram Ghorbani , John H. L. Hansen , Wei Xue , Jing Huang

Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing state-of-the-art (SOTA)…

Sound · Computer Science 2024-03-22 Samuel Pegg , Kai Li , Xiaolin Hu

Synthetic voice and splicing audio clips have been generated to spoof Internet users and artificial intelligence (AI) technologies such as voice authentication. Existing research work treats spoofing countermeasures as a binary…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-30 Lei Wang , Benedict Yeoh , Jun Wah Ng

Several studies have proposed deep-learning-based models to predict the mean opinion score (MOS) of synthesized speech, showing the possibility of replacing human raters. However, inter- and intra-rater variability in MOSs makes it hard to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-03 Yeunju Choi , Youngmoon Jung , Hoirin Kim

Some recent studies have demonstrated the feasibility of single-stage neural text-to-speech, which does not need to generate mel-spectrograms but generates the raw waveforms directly from the text. Single-stage text-to-speech often faces…

Sound · Computer Science 2022-07-14 Zhengxi Liu , Qiao Tian , Chenxu Hu , Xudong Liu , Menglin Wu , Yuping Wang , Hang Zhao , Yuxuan Wang

Fine-tuning speech representation models can enhance performance on specific tasks but often compromises their cross-task generalization ability. This degradation is often caused by excessive changes in the representations, making it…

Computation and Language · Computer Science 2026-04-28 Tzu-Quan Lin , Wei-Ping Huang , Hao Tang , Hung-yi Lee

Face super-resolution aims to reconstruct a high-resolution face image from a low-resolution face image. Previous methods typically employ an encoder-decoder structure to extract facial structural features, where the direct downsampling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Wenjie Li , Heng Guo , Xuannan Liu , Kongming Liang , Jiani Hu , Zhanyu Ma , Jun Guo

A new line of research for feature selection based on neural networks has recently emerged. Despite its superiority to classical methods, it requires many training iterations to converge and detect informative features. The computational…

Machine Learning · Computer Science 2022-11-29 Ghada Sokar , Zahra Atashgahi , Mykola Pechenizkiy , Decebal Constantin Mocanu

Recently, self-supervised pre-training has gained success in automatic speech recognition (ASR). However, considering the difference between speech accents in real scenarios, how to identify accents and use accent features to improve ASR is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-16 Keqi Deng , Songjun Cao , Long Ma

Data acquired from multi-channel sensors is a highly valuable asset to interpret the environment for a variety of remote sensing applications. However, low spatial resolution is a critical limitation for previous sensors and the constituent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Savas Ozkan , Berk Kaya , Gozde Bozdagi Akar