English
Related papers

Related papers: A consolidated view of loss functions for supervis…

200 papers

Machine learning techniques are an active area of research for speech enhancement for hearing aids, with one particular focus on improving the intelligibility of a noisy speech signal. Recent work has shown that feature encodings from…

Sound · Computer Science 2024-07-19 Robert Sutherland , George Close , Thomas Hain , Stefan Goetze , Jon Barker

Humans can often quickly and efficiently solve complex new learning tasks given only a small set of examples. In contrast, modern artificially intelligent systems often require thousands or millions of observations in order to solve even…

Machine Learning · Computer Science 2025-05-08 Christian Raymond

Binaural reproduction aims to deliver immersive spatial audio with high perceptual realism over headphones. Loss functions play a central role in optimizing and evaluating algorithms that generate binaural signals. However, traditional…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-03 Boaz Rafaely , Stefan Weinzierl , Or Berebi , Fabian Brinkmann

Conventional methods for speech enhancement rely on handcrafted loss functions (e.g., time or frequency domain losses) or deep feature losses (e.g., using WavLM or wav2vec), which often fail to capture subtle signal properties essential for…

Sound · Computer Science 2025-05-28 Saisamarth Rajesh Phaye , Milos Cernak , Andrew Harper

Deep learning approaches have shown promising performance for compressed sensing-based Magnetic Resonance Imaging. While deep neural networks trained with mean squared error (MSE) loss functions can achieve high peak signal to noise ratio,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Maximilian Seitzer , Guang Yang , Jo Schlemper , Ozan Oktay , Tobias Würfl , Vincent Christlein , Tom Wong , Raad Mohiaddin , David Firmin , Jennifer Keegan , Daniel Rueckert , Andreas Maier

Speech enhancement has recently achieved great success with various deep learning methods. However, most conventional speech enhancement systems are trained with supervised methods that impose two significant challenges. First, a majority…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Viet Anh Trinh , Sebastian Braun

Data augmentation is conventionally used to inject robustness in Speaker Verification systems. Several recently organized challenges focus on handling novel acoustic environments. Deep learning based speech enhancement is a modern solution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-29 Saurabh Kataria , Phani Sankar Nidadavolu , Jesús Villalba , Najim Dehak

Single-channel speech enhancement with deep neural networks (DNNs) has shown promising performance and is thus intensively being studied. In this paper, instead of applying the mean squared error (MSE) as the loss function during DNN…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-20 Ziyue Zhao , Samy Elshamy , Tim Fingscheidt

Deep neural networks (DNNs) are powerful learning machines that have enabled breakthroughs in several domains. In this work, we introduce a new retrospective loss to improve the training of deep neural network models by utilizing the prior…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Surgan Jandial , Ayush Chopra , Mausoom Sarkar , Piyush Gupta , Balaji Krishnamurthy , Vineeth Balasubramanian

Recent years have seen considerable progress in the continual training of deep neural networks, predominantly thanks to approaches that add replay or regularization terms to the loss function to approximate the joint loss over all tasks so…

Machine Learning · Computer Science 2024-11-01 Timm Hess , Tinne Tuytelaars , Gido M. van de Ven

Utilizing a human-perception-related objective function to train a speech enhancement model has become a popular topic recently. The main reason is that the conventional mean squared error (MSE) loss cannot represent auditory perception…

Sound · Computer Science 2020-02-19 Szu-Wei Fu , Chien-Feng Liao , Yu Tsao

Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Zhuohuang Zhang , Chengyun Deng , Yi Shen , Donald S. Williamson , Yongtao Sha , Yi Zhang , Hui Song , Xiangang Li

Deep Metric Learning (DML) learns a non-linear semantic embedding from input data that brings similar pairs together while keeping dissimilar data away from each other. To this end, many different methods are proposed in the last decade…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Davood Zabihzadeh , Zahraa Alitbi , Seyed Jalaleddin Mousavirad

Deep acoustic models typically receive features in the first layer of the network, and process increasingly abstract representations in the subsequent layers. Here, we propose to feed the input features at multiple depths in the acoustic…

Computation and Language · Computer Science 2020-02-14 Andros Tjandra , Chunxi Liu , Frank Zhang , Xiaohui Zhang , Yongqiang Wang , Gabriel Synnaeve , Satoshi Nakamura , Geoffrey Zweig

Estimating time-frequency domain masks for single-channel speech enhancement using deep learning methods has recently become a popular research field with promising results. In this paper, we propose a novel components loss (CL) for the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-15 Ziyi Xu , Samy Elshamy , Ziyue Zhao , Tim Fingscheidt

In this paper, we develop upon the topic of loss function learning, an emergent meta-learning paradigm that aims to learn loss functions that significantly improve the performance of the models trained under them. Specifically, we propose a…

Neural and Evolutionary Computing · Computer Science 2024-03-05 Christian Raymond , Qi Chen , Bing Xue , Mengjie Zhang

Large Language Models (LLMs) have demonstrated impressive performance across various tasks. However, current training approaches combine standard cross-entropy loss with extensive data, human feedback, or ad hoc methods to enhance…

Computation and Language · Computer Science 2024-12-16 Daniele Rege Cambrin , Giuseppe Gallipoli , Irene Benedetto , Luca Cagliero , Paolo Garza

Phase aberration is one of the primary sources of image quality degradation in ultrasound, which is induced by spatial variations in sound speed across the heterogeneous medium. This effect disrupts transmitted waves and prevents coherent…

Image and Video Processing · Electrical Eng. & Systems 2023-05-18 Mostafa Sharifzadeh , Habib Benali , Hassan Rivaz

Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of…

Sound · Computer Science 2021-12-14 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

In this work, we propose a novel consistency-preserving loss function for recovering the phase information in the context of phase reconstruction (PR) and speech enhancement (SE). Different from conventional techniques that directly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Pin-Jui Ku , Chun-Wei Ho , Hao Yen , Sabato Marco Siniscalchi , Chin-Hui Lee