中文
相关论文

相关论文: A consolidated view of loss functions for supervis…

200 篇论文

In this paper, we develop upon the emerging topic of loss function learning, which aims to learn loss functions that significantly improve the performance of the models trained under them. Specifically, we propose a new meta-learning…

机器学习 · 计算机科学 2024-07-02 Christian Raymond , Qi Chen , Bing Xue , Mengjie Zhang

This paper proposes a deep neural network (DNN)-based multi-channel speech enhancement system in which a DNN is trained to maximize the quality of the enhanced time-domain signal. DNN-based multi-channel speech enhancement is often…

音频与语音处理 · 电气工程与系统科学 2020-02-17 Yoshiki Masuyama , Masahito Togami , Tatsuya Komatsu

A promising way to deploy Artificial Intelligence (AI)-based services on mobile devices is to run a part of the AI model (a deep neural network) on the mobile itself, and the rest in the cloud. This is sometimes referred to as collaborative…

多媒体 · 计算机科学 2019-05-17 Saeed Ranjbar Alvar , Ivan V. Bajić

In this paper, a speech enhancement method based on noise compensation performed on short time magnitude as well phase spectra is presented. Unlike the conventional geometric approach (GA) to spectral subtraction (SS), here the noise…

音频与语音处理 · 电气工程与系统科学 2018-03-09 Md Tauhidul Islam , Udoy Saha , K. T. Shahid , Ahmed Bin Hussain , Celia Shahnaz

Deep neural networks (DNNs), particularly those using Rectified Linear Unit (ReLU) activation functions, have achieved remarkable success across diverse machine learning tasks, including image recognition, audio processing, and language…

机器学习 · 计算机科学 2026-03-26 Emi Zeger , Mert Pilanci

We present a novel boundary-aware loss term for semantic segmentation using an inverse-transformation network, which efficiently learns the degree of parametric transformations between estimated and target boundaries. This plug-in loss term…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Shubhankar Borse , Ying Wang , Yizhe Zhang , Fatih Porikli

Large, pre-trained representation models trained using self-supervised learning have gained popularity in various fields of machine learning because they are able to extract high-quality salient features from input data. As such, they have…

音频与语音处理 · 电气工程与系统科学 2023-06-16 Hejung Yang , Hong-Goo Kang

Although supervised learning based on a deep neural network has recently achieved substantial improvement on speech enhancement, the existing schemes have either of two critical issues: spectrum or metric mismatches. The spectrum mismatch…

声音 · 计算机科学 2020-05-12 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

We show that learning can be improved by using loss functions that evolve cyclically during training to emphasize one class at a time. In underparameterized networks, such dynamical loss functions can lead to successful training for…

机器学习 · 计算机科学 2021-06-24 Miguel Ruiz-Garcia , Ge Zhang , Samuel S. Schoenholz , Andrea J. Liu

Deep neural networks are currently among the most commonly used classifiers. Despite easily achieving very good performance, one of the best selling points of these models is their modular design - one can conveniently adapt their…

机器学习 · 计算机科学 2017-02-21 Katarzyna Janocha , Wojciech Marian Czarnecki

The loss function is crucial to machine learning, especially in supervised learning frameworks. It is a fundamental component that controls the behavior and general efficacy of learning algorithms. However, despite their widespread use,…

机器学习 · 计算机科学 2026-02-09 Soumi Mahato , Lineesh M. C

Deep Neural Networks (DNN) have been successful in en- hancing noisy speech signals. Enhancement is achieved by learning a nonlinear mapping function from the features of the corrupted speech signal to that of the reference clean speech…

机器学习 · 计算机科学 2016-06-16 Zhenzhou Wu , Sunil Sivadas , Yong Kiam Tan , Ma Bin , Rick Siow Mong Goh

This paper presents an analysis regarding an influence of the Distance Metric Learning (DML) loss functions on the supervised fine-tuning of the language models for classification tasks. We experimented with known datasets from SentEval…

计算与语言 · 计算机科学 2022-11-29 Witold Sosnowski , Karolina Seweryn , Anna Wróblewska , Piotr Gawrysiak

In applications that use emotion recognition via speech, frame-loss can be a severe issue given manifold applications, where the audio stream loses some data frames, for a variety of reasons like low bandwidth. In this contribution, we…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Mostafa M. Mohamed , Björn W. Schuller

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

声音 · 计算机科学 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

Metalearning of deep neural network (DNN) architectures and hyperparameters has become an increasingly important area of research. Loss functions are a type of metaknowledge that is crucial to effective training of DNNs, however, their…

机器学习 · 计算机科学 2020-10-05 Santiago Gonzalez , Risto Miikkulainen

In recent years, deep neural networks have shown remarkable progress in dense disparity estimation from dynamic scenes in monocular structured light systems. However, their performance significantly drops when applied in unseen…

计算机视觉与模式识别 · 计算机科学 2023-10-16 Rukun Qiao , Hiroshi Kawasaki , Hongbin Zha

Image and video restoration has achieved a remarkable leap with the advent of deep learning. The success of deep learning paradigm lies in three key components: data, model, and loss. Currently, many efforts have been devoted to the first…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Man Zhou , Naishan Zheng , Jie Huang , Chunle Guo , Chongyi Li

The importance of domain knowledge in enhancing model performance and making reliable predictions in the real-world is critical. This has led to an increased focus on specific model properties for interpretability. We focus on incorporating…

机器学习 · 计算机科学 2019-12-04 Akhil Gupta , Naman Shukla , Lavanya Marla , Arinbjörn Kolbeinsson , Kartik Yellepeddi

Supervised machine learning often operates on the data-driven paradigm, wherein internal model parameters are autonomously optimized to converge predicted outputs with the ground truth, devoid of explicitly programming rules or a priori…

机器学习 · 计算机科学 2024-12-12 Daniel Geissler , Bo Zhou , Mengxi Liu , Paul Lukowicz