English
Related papers

Related papers: OWAdapt: An adaptive loss function for deep learni…

200 papers

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

Machine Learning · Computer Science 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

The weighted OWA (WOWA) is a function that aggregates a set of values with weights assigned based on the rank and relative importance of each value. The weighted OWA of uncertain objective functions can generalize many of the criteria that…

Optimization and Control · Mathematics 2021-04-16 Jaeyoong Lim , Sungsoo Park

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an…

Machine Learning · Computer Science 2022-09-07 Chen-Chen Zong , Zheng-Tao Cao , Hong-Tao Guo , Yun Du , Ming-Kun Xie , Shao-Yuan Li , Sheng-Jun Huang

In the last years, deep learning has dramatically improved the performances in a variety of medical image analysis applications. Among different types of deep learning models, convolutional neural networks have been among the most…

Image and Video Processing · Electrical Eng. & Systems 2021-04-23 Minh H. Vu , Gabriella Norman , Tufve Nyholm , Tommy Löfstedt

During the training of networks for distance metric learning, minimizers of the typical loss functions can be considered as "feasible points" satisfying a set of constraints imposed by the training data. To this end, we reformulate distance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Oğul Can , Yeti Ziya Gürbüz , A. Aydın Alatan

Object grasping is a crucial technology enabling robots to perceive and interact with the environment sufficiently. However, in practical applications, researchers are faced with missing or noisy ground truth while training the…

Robotics · Computer Science 2024-09-10 Yangfan Deng , Mengyao Zhang , Yong Zhao

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

Machine Learning · Computer Science 2021-11-11 Abhishek Kumar , Ehsan Amid

Automatic segmentation methods are an important advancement in medical image analysis. Machine learning techniques, and deep neural networks in particular, are the state-of-the-art for most medical image segmentation tasks. Issues with…

Image and Video Processing · Electrical Eng. & Systems 2021-11-25 Michael Yeung , Evis Sala , Carola-Bibiane Schönlieb , Leonardo Rundo

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Sebastien Deschamps , Hichem Sahbi

The construction of loss functions presents a major challenge in data-driven modeling involving weak-form operators in PDEs and gradient flows, particularly due to the need to select test functions appropriately. We address this challenge…

Machine Learning · Statistics 2025-12-16 Yuan Gao , Quanjun Lang , Fei Lu

Dynamical loss functions are derived from standard loss functions used in supervised classification tasks, but are modified so that the contribution from each class periodically increases and decreases. These oscillations globally alter the…

Machine Learning · Computer Science 2025-11-06 Eduardo Lavin Pallero , Miguel Ruiz-Garcia

Accurate load forecasting is critical for reliable and efficient planning and operation of electric power grids. In this paper, we propose a unifying deep learning framework for load forecasting, which includes time-varying feature…

Machine Learning · Computer Science 2023-05-10 Jing Xiong , Yu Zhang

In deep neural network, the cross-entropy loss function is commonly used for classification. Minimizing cross-entropy is equivalent to maximizing likelihood under assumptions of uniform feature and class distributions. It belongs to…

Machine Learning · Computer Science 2018-05-01 Donglai Zhu , Hengshuai Yao , Bei Jiang , Peng Yu

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these…

Machine Learning · Computer Science 2024-11-05 Edwige Cyffers , Muni Sreenivas Pydi , Jamal Atif , Olivier Cappé

The objective of active level set estimation for a black-box function is to precisely identify regions where the function values exceed or fall below a specified threshold by iteratively performing function evaluations to gather more…

Machine Learning · Computer Science 2024-10-10 Giang Ngo , Dang Nguyen , Sunil Gupta

The importance of domain knowledge in enhancing model performance and making reliable predictions in the real-world is critical. This has led to an increased focus on specific model properties for interpretability. We focus on incorporating…

Machine Learning · Computer Science 2019-12-04 Akhil Gupta , Naman Shukla , Lavanya Marla , Arinbjörn Kolbeinsson , Kartik Yellepeddi

Learning unnormalized statistical models (e.g., energy-based models) is computationally challenging due to the complexity of handling the partition function. To eschew this complexity, noise-contrastive estimation~(NCE) has been proposed by…

Machine Learning · Computer Science 2023-06-14 Wei Jiang , Jiayu Qin , Lingyu Wu , Changyou Chen , Tianbao Yang , Lijun Zhang

We present a new loss function that addresses the out-of-distribution (OOD) calibration problem. While many objective functions have been proposed to effectively calibrate models in-distribution, our findings show that they do not always…

Machine Learning · Computer Science 2024-03-12 Dexter Neo , Stefan Winkler , Tsuhan Chen

Covariance matrix reconstruction has been the most widely used guiding objective in gridless direction-of-arrival (DoA) estimation for sparse linear arrays. Many semidefinite programming (SDP)-based methods fall under this category.…

Signal Processing · Electrical Eng. & Systems 2025-03-18 Kuan-Lin Chen , Bhaskar D. Rao

Modern deep neural networks can easily overfit to biased training data containing corrupted labels or class imbalance. Sample re-weighting methods are popularly used to alleviate this data bias issue. Most current methods, however, require…

Machine Learning · Computer Science 2023-05-02 Jun Shu , Xiang Yuan , Deyu Meng , Zongben Xu