English
Related papers

Related papers: Generalised Dice overlap as a deep learning loss f…

200 papers

Although supervised deep-learning has achieved promising performance in medical image segmentation, many methods cannot generalize well on unseen data, limiting their real-world applicability. To address this problem, we propose a deep…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Shangqi Gao , Hangqi Zhou , Yibo Gao , Xiahai Zhuang

The Dice score and Jaccard index are commonly used metrics for the evaluation of segmentation tasks in medical imaging. Convolutional neural networks trained for image segmentation tasks are usually optimized for (weighted) cross-entropy.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jeroen Bertels , Tom Eelbode , Maxim Berman , Dirk Vandermeulen , Frederik Maes , Raf Bisschops , Matthew Blaschko

Improving the classification of multi-class imbalanced data is more difficult than its two-class counterpart. In this paper, we use deep neural networks to train new representations of tabular multi-class data. Unlike the typically…

Machine Learning · Computer Science 2023-12-19 Damian Horna , Lango Mateusz , Jerzy Stefanowski

The loss function is a key component in deep learning models. A commonly used loss function for classification is the cross entropy loss, which is a simple yet effective application of information theory for classification problems. Based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Zeyu Song , Dongliang Chang , Zhanyu Ma , Xiaoxu Li , Zheng-Hua Tan

Imbalanced data distributions are prevalent in real-world scenarios, posing significant challenges in both imbalanced classification and imbalanced regression tasks. They often cause deep learning models to overfit in areas of high sample…

Machine Learning · Computer Science 2025-03-31 Guangkun Nie , Gongzheng Tang , Shenda Hong

Real-world data often exhibit imbalanced distributions, where certain target values have significantly fewer observations. Existing techniques for dealing with imbalanced data focus on targets with categorical indices, i.e., different…

Machine Learning · Computer Science 2021-05-14 Yuzhe Yang , Kaiwen Zha , Ying-Cong Chen , Hao Wang , Dina Katabi

Class imbalance is a pervasive issue among classification models including deep learning, whose capacity to extract task-specific features is affected in imbalanced settings. However, the challenges of handling imbalance among a large…

Machine Learning · Computer Science 2018-10-31 Shin Ando

A promising direction in deep learning research consists in learning representations and simultaneously discovering cluster structure in unlabeled data by optimizing a discriminative loss function. As opposed to supervised deep learning,…

We introduce two-scale loss functions for use in various gradient descent algorithms applied to classification problems via deep neural networks. This new method is generic in the sense that it can be applied to a wide range of machine…

Numerical Analysis · Mathematics 2021-09-03 Leonid Berlyand , Robert Creese , Pierre-Emmanuel Jabin

Loss functions are at the heart of deep learning, shaping how models learn and perform across diverse tasks. They are used to quantify the difference between predicted outputs and ground truth labels, guiding the optimization process to…

Machine Learning · Computer Science 2025-09-11 Omar Elharrouss , Yasir Mahmood , Yassine Bechqito , Mohamed Adel Serhani , Elarbi Badidi , Jamal Riffi , Hamid Tairi

The rapid development of deep learning has made a great progress in image segmentation, one of the fundamental tasks of computer vision. However, the current segmentation algorithms mostly rely on the availability of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Wei Shen , Zelin Peng , Xuehui Wang , Huayu Wang , Jiazhong Cen , Dongsheng Jiang , Lingxi Xie , Xiaokang Yang , Qi Tian

Since the rise of deep learning, many computer vision tasks have seen significant advancements. However, the downside of deep learning is that it is very data-hungry. Especially for segmentation problems, training a deep neural net requires…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Robby Neven , Davy Neven , Bert De Brabandere , Marc Proesmans , Toon Goedemé

Partially-supervised learning can be challenging for segmentation due to the lack of supervision for unlabeled structures, and the methods directly applying fully-supervised learning could lead to incompatibility, meaning ground truth is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ke Zhang , Xiahai Zhuang

In a given classification task, the accuracy of the learner is often hampered by finiteness of the training set, high-dimensionality of the feature space and severe overlap between classes. In the context of interpretable learners, with…

Machine Learning · Computer Science 2025-04-03 Marco Canducci , Lida Abdi , Alessandro Prete , Roland J. Veen , Michael Biehl , Wiebke Arlt , Peter Tino

In response to the growing importance of geospatial data, its analysis including semantic segmentation becomes an increasingly popular task in computer vision today. Convolutional neural networks are powerful visual models that yield…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Alexey Bokhovkin , Evgeny Burnaev

Image segmentation is a fundamental topic in image processing and has been studied for many decades. Deep learning-based supervised segmentation models have achieved state-of-the-art performance but most of them are limited by using…

Image and Video Processing · Electrical Eng. & Systems 2020-11-03 Xu Chen , Xiangde Luo , Yitian Zhao , Shaoting Zhang , Guotai Wang , Yalin Zheng

In this work, we propose a simple yet effective method to tackle the problem of imbalanced multi-class semantic segmentation in deep learning systems. One of the key properties for a good training set is the balancing among the classes.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Emanuele Caruso , Francesco Pelosin , Alessandro Simoni , Marco Boschetti

Class imbalance poses a challenge for developing unbiased, accurate predictive models. In particular, in image segmentation neural networks may overfit to the foreground samples from small structures, which are often heavily…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Zeju Li , Konstantinos Kamnitsas , Ben Glocker

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

Machine Learning · Computer Science 2021-07-15 Xingtai Gui , Jiyang Zhang

Data-driven fault detection has been regarded as a 3D image segmentation task. The models trained from synthetic data are difficult to generalize in some surveys. Recently, training 3D fault segmentation using sparse manual 2D slices is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Yimin Dou , Kewen Li , Jianbing Zhu , Timing Li , Shaoquan Tan , Zongchao Huang