English
Related papers

Related papers: Evaluation of Error and Correlation-Based Loss Fun…

200 papers

Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or…

Sound · Computer Science 2022-11-01 Roshan Sharma , Hira Dhamyal , Bhiksha Raj , Rita Singh

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

This paper analyzes a popular loss function used in machine learning called the log-cosh loss function. A number of papers have been published using this loss function but, to date, no statistical analysis has been presented in the…

Machine Learning · Statistics 2024-03-19 Resve A. Saleh , A. K. Md. Ehsanes Saleh

Traditional loss functions, including cross-entropy, contrastive, triplet, and su pervised contrastive losses, used for fine-tuning pre-trained language models such as BERT, operate only within local neighborhoods and fail to account for…

Computation and Language · Computer Science 2026-05-05 Aditya Sharma , Vinti Agarwal , Rajesh Kumar

We consider training decision trees using noisily labeled data, focusing on loss functions that can lead to robust learning algorithms. Our contributions are threefold. First, we offer novel theoretical insights on the robustness of many…

Machine Learning · Computer Science 2024-01-24 Jonathan Wilton , Nan Ye

A variety of different performance metrics are commonly used in the machine learning literature for the evaluation of classification systems. Some of the most common ones for measuring quality of hard decisions are standard and balanced…

Machine Learning · Computer Science 2023-09-22 Luciana Ferrer

Numerous deep learning applications benefit from multi-task learning with multiple regression and classification objectives. In this paper we make the observation that the performance of such systems is strongly dependent on the relative…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Alex Kendall , Yarin Gal , Roberto Cipolla

It has been a hot research topic to enable machines to understand human emotions in multimodal contexts under dialogue scenarios, which is tasked with multimodal emotion analysis in conversation (MM-ERC). MM-ERC has received consistent…

Computation and Language · Computer Science 2023-08-15 Bobo Li , Hao Fei , Lizi Liao , Yu Zhao , Chong Teng , Tat-Seng Chua , Donghong Ji , Fei Li

Contrastive learning is a powerful technique to learn representations that are semantically distinctive and geometrically invariant. While most of the earlier approaches have demonstrated its effectiveness on single-modality learning tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anurag Jain , Yashaswi Verma

In the last years, deep learning has dramatically improved the performances in a variety of medical image analysis applications. Among different types of deep learning models, convolutional neural networks have been among the most…

Image and Video Processing · Electrical Eng. & Systems 2021-04-23 Minh H. Vu , Gabriella Norman , Tufve Nyholm , Tommy Löfstedt

Time series forecasting holds significant value in various domains such as economics, traffic, energy, and AIOps, as accurate predictions facilitate informed decision-making. However, the existing Mean Squared Error (MSE) loss function…

Machine Learning · Computer Science 2025-10-29 Xiangfei Qiu , Xingjian Wu , Hanyin Cheng , Xvyuan Liu , Chenjuan Guo , Jilin Hu , Bin Yang

Compressed sensing (CS) is a signal processing framework for efficiently reconstructing a signal from a small number of measurements, obtained by linear projections of the signal. In this paper we present an end-to-end deep learning…

Image and Video Processing · Electrical Eng. & Systems 2019-06-26 Yochai Zur , Amir Adler

While machine learning (ML) architectures have evolved rapidly to account for complex data, loss functions like cross-entropy remain mostly structure-agnostic in many real-world applications. However, the `class-symmetric' nature of these…

Machine Learning · Computer Science 2026-05-28 Yasser Taha , Grégoire Montavon , Nils Körber

The S{\o}rensen--Dice Coefficient has recently seen rising popularity as a loss function (also known as Dice loss) due to its robustness in tasks where the number of negative samples significantly exceeds that of positive samples, such as…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Karn N. Watcharasupat , Thi Ngoc Tho Nguyen , Ngoc Khanh Nguyen , Zhen Jian Lee , Douglas L. Jones , Woon Seng Gan

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

We propose a novel Dynamic Restrained Uncertainty Weighting Loss to experimentally handle the problem of balancing the contributions of multiple tasks on the ICML ExVo 2022 Challenge. The multitask aims to recognize expressed emotions and…

The intersection of technology and mental health has spurred innovative approaches to assessing emotional well-being, particularly through computational techniques applied to audio data analysis. This study explores the application of…

Sound · Computer Science 2024-12-17 Idoko Agbo , Dr Hoda El-Sayed , M. D Kamruzzan Sarker

Data imbalance exists ubiquitously in real-world visual regressions, e.g., age estimation and pose estimation, hurting the model's generalizability and fairness. Thus, imbalanced regression gains increasing research attention recently.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jiawei Ren , Mingyuan Zhang , Cunjun Yu , Ziwei Liu

Catastrophic forgetting is a critical challenge in training deep neural networks. Although continual learning has been investigated as a countermeasure to the problem, it often suffers from the requirements of additional network components…

Machine Learning · Computer Science 2019-10-23 Dongmin Park , Seokil Hong , Bohyung Han , Kyoung Mu Lee

Spatiotemporal graph neural networks have achieved state-of-the-art performance in traffic forecasting. However, they often struggle to forecast congestion accurately due to the limitations of traditional loss functions. While accurate…

Machine Learning · Computer Science 2023-08-30 Yangxinyu Xie , Tanwi Mallick