English
Related papers

Related papers: Acoustic Model Adaptation from Raw Waveforms with …

200 papers

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

Sound · Computer Science 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

Automatic speaker verification (ASV) systems are often affected by spoofing attacks. Recent transformer-based models have improved anti-spoofing performance by learning strong feature representations. However, these models usually need high…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-14 Yang Xiao , Ting Dang , Rohan Kumar Das

Parameter-efficient fine-tuning (PEFT) for personalizing automatic speech recognition (ASR) has recently shown promise for adapting general population models to atypical speech. However, these approaches assume a priori knowledge of the…

Machine Learning · Computer Science 2024-07-04 Max Müller-Eberstein , Dianna Yee , Karren Yang , Gautam Varma Mantena , Colin Lea

Mispronunciation detection and diagnosis (MDD) is designed to identify pronunciation errors and provide instructive feedback to guide non-native language learners, which is a core component in computer-assisted pronunciation training (CAPT)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-02 Bi-Cheng Yan , Berlin Chen

Typical convolutional neural networks (CNNs) have several millions of parameters and require a large amount of annotated data to train them. In medical applications where training data is hard to come by, these sophisticated machine…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Rahul Venkataramani , Sheshadri Thiruvenkadam , Prasad Sudhakar , Hariharan Ravishankar , Vivek Vaidya

Unsupervised representation learning of speech has been of keen interest in recent years, which is for example evident in the wide interest of the ZeroSpeech challenges. This work presents a new method for learning frame level…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Mingjie Chen , Thomas Hain

Modeling long-term dependencies for audio signals is a particularly challenging problem, as even small-time scales yield on the order of a hundred thousand samples. With the recent advent of Transformers, neural architectures became good at…

Sound · Computer Science 2024-12-24 Prateek Verma

While numerous forecasters have been proposed using different network architectures, the Transformer-based models have state-of-the-art performance in time series forecasting. However, forecasters based on Transformers are still suffering…

Machine Learning · Computer Science 2024-11-06 Kun Yi , Jingru Fei , Qi Zhang , Hui He , Shufeng Hao , Defu Lian , Wei Fan

State-of-the-art speech recognition systems rely on fixed, hand-crafted features such as mel-filterbanks to preprocess the waveform before the training pipeline. In this paper, we study end-to-end systems trained directly from the raw…

Computation and Language · Computer Science 2018-06-22 Neil Zeghidour , Nicolas Usunier , Gabriel Synnaeve , Ronan Collobert , Emmanuel Dupoux

Wave-guide-based physical systems provide a promising route toward energy-efficient analog computing beyond traditional electronics. Within this landscape, acoustic neural networks represent a promising approach for achieving low-power…

Sound · Computer Science 2025-11-27 Ivan Kalthoff , Marcel Rey , Raphael Wittkowski

Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary phase, requiring…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-18 Jee-weon Jung , Hee-Soo Heo , Ju-ho Kim , Hye-jin Shim , Ha-Jin Yu

Adaptive filtering algorithms are pervasive throughout signal processing and have had a material impact on a wide variety of domains including audio processing, telecommunications, biomedical sensing, astrophysics and cosmology, seismology,…

Sound · Computer Science 2022-11-23 Jonah Casebeer , Nicholas J. Bryan , Paris Smaragdis

Detecting emotions directly from a speech signal plays an important role in effective human-computer interactions. Existing speech emotion recognition models require massive computational and storage resources, making them hard to implement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Arya Aftab , Alireza Morsali , Shahrokh Ghaemmaghami , Benoit Champagne

Audio classification can distinguish different kinds of sounds, which is helpful for intelligent applications in daily life. However, it remains a challenging task since the sound events in an audio clip is probably multiple, even…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-22 Jiaxu Chen , Jing Hao , Kai Chen , Di Xie , Shicai Yang , Shiliang Pu

In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a…

Sound · Computer Science 2022-08-29 Shrutina Agarwal , Sriram Ganapathy , Naoya Takahashi

Over the past two decades, CNN architectures have produced compelling models of sound perception and cognition, learning hierarchical organizations of features. Analogous to successes in computer vision, audio feature classification can be…

Sound · Computer Science 2025-05-13 Prateek Verma , Jonathan Berger

Deep learning has brought significant breakthroughs in sequential recommendation (SR) for capturing dynamic user interests. A series of recent research revealed that models with more parameters usually achieve optimal performance for SR…

Information Retrieval · Computer Science 2023-02-07 Zhiding Liu , Mingyue Cheng , Zhi Li , Qi Liu , Enhong Chen

This study introduces a reformed Sinc-convolution (Sincconv) framework tailored for the encoder component of deep networks for speech enhancement (SE). The reformed Sincconv, based on parametrized sinc functions as band-pass filters, offers…

Sound · Computer Science 2024-03-05 Kuan-Hsun Ho , Jeih-weih Hung , Berlin Chen

Complex-valued processing has brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram, while complex masks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-02 Hendrik Schröter , Alberto N. Escalante-B. , Tobias Rosenkranz , Andreas Maier

Recent advances in speech synthesis suggest that limitations such as the lossy nature of the amplitude spectrum with minimum phase approximation and the over-smoothing effect in acoustic modeling can be overcome by using advanced machine…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-10 Xin Wang , Jaime Lorenzo-Trueba , Shinji Takaki , Lauri Juvela , Junichi Yamagishi