English
Related papers

Related papers: A Deep Learning Loss Function based on Auditory Po…

200 papers

Discrete speech tokens offer significant advantages for storage and language model integration, but their application in speech emotion recognition (SER) is limited by paralinguistic information loss during quantization. This paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Esther Sun , Abinay Reddy Naini , Carlos Busso

Speech emotion recognition is an important aspect of human-computer interaction. Prior work proposes various end-to-end models to improve the classification performance. However, most of them rely on the cross-entropy loss together with…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

Depression is a global health concern with a critical need for increased patient screening. Speech technology offers advantages for remote screening but must perform robustly across patients. We have described two deep learning models…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Y. Lu , A. Harati , T. Rutowski , R. Oliveira , P. Chlebek , E. Shriberg

We propose self-teaching networks to improve the generalization capacity of deep neural networks. The idea is to generate soft supervision labels using the output layer for training the lower layers of the network. During the network…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-11 Liang Lu , Eric Sun , Yifan Gong

In this work, we propose to study the performance of a model trained with a sentence embedding regression loss component for the Automated Audio Captioning task. This task aims to build systems that can describe audio content with a single…

Sound · Computer Science 2023-05-03 Etienne Labbé , Julien Pinquier , Thomas Pellegrini

Analysis of respiratory sounds increases its importance every day. Many different methods are available in the analysis, and new techniques are continuing to be developed to further improve these methods. Features are extracted from audio…

Sound · Computer Science 2021-01-22 Osman Balli , Yakup Kutlu

We investigate the topics of sensitivity and robustness in feedforward and convolutional neural networks. Combining energy landscape techniques developed in computational chemistry with tools drawn from formal methods, we produce empirical…

Machine Learning · Statistics 2018-12-06 Timothy E. Wang , Yiming Gu , Dhagash Mehta , Xiaojun Zhao , Edgar A. Bernal

In existing Audio-Visual Speech Enhancement (AVSE) methods, objectives such as Scale-Invariant Signal-to-Noise Ratio (SI-SNR) and Mean Squared Error (MSE) are widely used; however, they often correlate poorly with perceptual quality and…

Sound · Computer Science 2026-03-18 Chih-Ning Chen , Jen-Cheng Hou , Hsin-Min Wang , Shao-Yi Chien , Yu Tsao , Fan-Gang Zeng

Although recent works have brought some insights into the performance improvement of techniques used in state-of-the-art deep-learning models, more work is needed to understand their generalization properties. We shed light on this matter…

Machine Learning · Computer Science 2020-07-31 Mahsa Forouzesh , Farnood Salehi , Patrick Thiran

The transcriptions used to train an Automatic Speech Recognition (ASR) system may contain errors. Usually, either a quality control stage discards transcriptions with too many errors, or the noisy transcriptions are used as is. We introduce…

Computation and Language · Computer Science 2019-10-17 Adrien Dufraux , Emmanuel Vincent , Awni Hannun , Armelle Brun , Matthijs Douze

While deep learning systems have gained significant ground in speech enhancement research, these systems have yet to make use of the full potential of deep learning systems to provide high-level feedback. In particular, phonetic feedback is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-05 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

While deep neural networks have shown powerful performance in many audio applications, their large computation and memory demand has been a challenge for real-time processing. In this paper, we study the impact of scaling the precision of…

Audio and Speech Processing · Electrical Eng. & Systems 2017-12-06 Jong Hwan Ko , Josh Fromm , Matthai Philipose , Ivan Tashev , Shuayb Zarar

Classification of audio samples is an important part of many auditory systems. Deep learning models based on the Convolutional and the Recurrent layers are state-of-the-art in many such tasks. In this paper, we approach audio classification…

Sound · Computer Science 2019-02-15 Royal Jain

Current deep learning (DL) based approaches to speech intelligibility enhancement in noisy environments are often trained to minimise the feature distance between noise-free speech and enhanced speech signals. Despite improving the speech…

The choice of a loss function is a critical part of machine learning. This paper evaluated two different loss functions commonly used in regression-task dimensional speech emotion recognition, an error-based and a correlation-based loss…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

The speaker extraction algorithm extracts the target speech from a mixture speech containing interference speech and background noise. The extraction process sometimes over-suppresses the extracted target speech, which not only creates…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Zexu Pan , Meng Ge , Haizhou Li

Humans can often quickly and efficiently solve complex new learning tasks given only a small set of examples. In contrast, modern artificially intelligent systems often require thousands or millions of observations in order to solve even…

Machine Learning · Computer Science 2025-05-08 Christian Raymond

Recently, emotional speech synthesis has achieved remarkable performance. The emotion strength of synthesized speech can be controlled flexibly using a strength descriptor, which is obtained by an emotion attribute ranking function.…

Sound · Computer Science 2021-10-11 Rui Liu , Berrak Sisman , Haizhou Li

Acoustic echo degrades the user experience in voice communication systems thus needs to be suppressed completely. We propose a real-time residual acoustic echo suppression (RAES) method using an efficient convolutional neural network. The…

Sound · Computer Science 2020-11-09 Xinquan Zhou , Yanhong Leng

This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples.…

Sound · Computer Science 2021-09-21 Madhav Mahesh Kashyap , Anuj Tambwekar , Krishnamoorthy Manohara , S Natarajan