English
Related papers

Related papers: End-to-End Mispronunciation Detection and Diagnosi…

200 papers

Machine learning methods, such as deep learning, show promising results in the medical domain. However, the lack of interpretability of these algorithms may hinder their applicability to medical decision support systems. This paper studies…

Signal Processing · Electrical Eng. & Systems 2021-07-23 Juan Manuel Mayor-Torres , Mirco Ravanelli , Sara E. Medina-DeVilliers , Matthew D. Lerner , Giuseppe Riccardi

Speech deepfake detection (SDD) systems perform well on standard benchmarks datasets but often fail to generalize to expressive and emotional spoofing attacks. Many methods rely on spoof-heavy training data, learning dataset-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Aurosweta Mahapatra , Ismail Rasim Ulgen , Kong Aik Lee , Nicholas Andrews , Berrak Sisman

Disfluency detection is usually an intermediate step between an automatic speech recognition (ASR) system and a downstream task. By contrast, this paper aims to investigate the task of end-to-end speech recognition and disfluency removal.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-30 Paria Jamshid Lou , Mark Johnson

Recent works using artificial neural networks based on distributed word representation greatly boost performance on various natural language processing tasks, especially the answer selection problem. Nevertheless, most of the previous works…

Computation and Language · Computer Science 2018-03-19 Lingxun Meng , Yan Li

The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based time domain source…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-14 Thilo von Neumann , Keisuke Kinoshita , Lukas Drude , Christoph Boeddeker , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

Prior efforts in building computer-assisted pronunciation training (CAPT) systems often treat automatic pronunciation assessment (APA) and mispronunciation detection and diagnosis (MDD) as separate fronts: the former aims to provide…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-24 Fu-An Chao , Berlin Chen

Sound event detection systems typically consist of two stages: extracting hand-crafted features from the raw audio waveform, and learning a mapping between these features and the target sound events using a classifier. Recently, the focus…

Sound · Computer Science 2018-05-11 Emre Çakır , Tuomas Virtanen

Raw waveform acoustic modelling has recently gained interest due to neural networks' ability to learn feature extraction, and the potential for finding better representations for a given scenario than hand-crafted features. SincNet has been…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-01 Joachim Fainberg , Ondřej Klejch , Erfan Loweimi , Peter Bell , Steve Renals

Speaker Change Detection (SCD) is to identify boundaries among speakers in a conversation. Motivated by the success of fine-tuning wav2vec 2.0 models for the SCD task, a further investigation of self-supervised learning (SSL) features for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yue Li , Xinsheng Wang , Li Zhang , Lei Xie

The research community has long studied computer-assisted pronunciation training (CAPT) methods in non-native speech. Researchers focused on studying various model architectures, such as Bayesian networks and deep learning methods, as well…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-05 Daniel Korzekwa , Jaime Lorenzo-Trueba , Thomas Drugman , Bozena Kostek

Pattern recognition from audio signals is an active research topic encompassing audio tagging, acoustic scene classification, music classification, and other areas. Spectrogram and mel-frequency cepstral coefficients (MFCC) are among the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-18 Md. Istiaq Ansari , Taufiq Hasan

A promising approach for multi-microphone speech separation involves two deep neural networks (DNN), where the predicted target speech from the first DNN is used to compute signal statistics for time-invariant minimum variance…

Sound · Computer Science 2021-10-04 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Casual conversations involving multiple speakers and noises from surrounding devices are common in everyday environments, which degrades the performances of automatic speech recognition systems. These challenging characteristics of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-24 Nelson Yalta , Shinji Watanabe , Takaaki Hori , Kazuhiro Nakadai , Tetsuya Ogata

Inspired by the progress of the End-to-End approach [1], this paper systematically studies the effects of Number of Filters of convolutional layers on the model prediction accuracy of CNN+RNN (Convolutional Neural Networks adding to…

Machine Learning · Computer Science 2021-02-05 James Mou , Jun Li

Speech activity detection (SAD) plays an important role in current speech processing systems, including automatic speech recognition (ASR). SAD is particularly difficult in environments with acoustic noise. A practical solution is to…

Computation and Language · Computer Science 2023-05-15 Fei Tao , Carlos Busso

Lipreading is the task of decoding text from the movement of a speaker's mouth. Traditional approaches separated the problem into two stages: designing or learning visual features, and prediction. More recent deep lipreading approaches are…

Machine Learning · Computer Science 2016-12-19 Yannis M. Assael , Brendan Shillingford , Shimon Whiteson , Nando de Freitas

Speech is one of the most common forms of communication in humans. Speech commands are essential parts of multimodal controlling of prosthetic hands. In the past decades, researchers used automatic speech recognition systems for controlling…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-30 Mohsen Jafarzadeh , Yonas Tadesse

Due to the simple design pipeline, end-to-end (E2E) neural models for speech enhancement (SE) have attracted great interest. In order to improve the performance of the E2E model, the locality and temporal sequential properties of speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Tsun-An Hsieh , Hsin-Min Wang , Xugang Lu , Yu Tsao

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

End-to-end speech recognition generally uses hand-engineered acoustic features as input and excludes the feature extraction module from its joint optimization. To extract learnable and adaptive features and mitigate information loss, we…

Sound · Computer Science 2021-06-09 Max W. Y. Lam , Jun Wang , Chao Weng , Dan Su , Dong Yu