中文
相关论文

相关论文: Calibrating Segmentation Networks with Margin-base…

200 篇论文

Label embedding is a framework for multiclass classification problems where each label is represented by a distinct vector of some fixed dimension, and training involves matching model output to the vector representing the correct label.…

机器学习 · 计算机科学 2025-09-01 Jianxin Zhang , Clayton Scott

Active learning (AL) has emerged as a crucial strategy for reducing the prohibitive costs associated with medical image segmentation. However, standard uncertainty-based AL methods typically focus on maximizing performance metrics, ignoring…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Ghazal Danaee , Mélanie Gaillochet , Christian Desrosiers , Herve Lombaert , Sylvain Bouix

Long-tail learning is the problem of learning under skewed label distributions, which pose a challenge for standard learners. Several recent approaches for the problem have proposed enforcing a suitable margin in logit space. Such…

机器学习 · 计算机科学 2022-04-29 Wittawat Jitkrittum , Aditya Krishna Menon , Ankit Singh Rawat , Sanjiv Kumar

The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and the uniform distribution over labels. Smoothing the labels…

机器学习 · 计算机科学 2020-06-12 Rafael Müller , Simon Kornblith , Geoffrey Hinton

Label smoothing (LS) adopts smoothed targets in classification tasks. For example, in binary classification, instead of the one-hot target $(1,0)^\top$ used in conventional logistic regression (LR), LR with LS (LSLR) uses the smoothed…

机器学习 · 统计学 2023-05-16 Ryoya Yamasaki , Toshiyuki Tanaka

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

We present a latent variable model for classification that provides a novel probabilistic interpretation of neural network softmax classifiers. We derive a variational objective to train the model, analogous to the evidence lower bound…

机器学习 · 计算机科学 2024-01-10 Shehzaad Dhuliawala , Mrinmaya Sachan , Carl Allen

In this paper, we study the implicit regularization of the gradient descent algorithm in homogeneous neural networks, including fully-connected and convolutional neural networks with ReLU or LeakyReLU activations. In particular, we study…

机器学习 · 计算机科学 2021-01-01 Kaifeng Lyu , Jian Li

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

机器学习 · 统计学 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Machine learning-based decision support systems are increasingly deployed in clinical settings, where probabilistic scoring functions are used to inform and prioritize patient management decisions. However, widely used scoring rules, such…

机器学习 · 计算机科学 2025-07-01 Gerardo A. Flores , Alyssa H. Smith , Julia A. Fukuyama , Ashia C. Wilson

Predictive models that accurately emulate complex scientific processes can achieve exponential speed-ups over numerical simulators or experiments, and at the same time provide surrogates for improving the subsequent analysis. Consequently,…

Deep neural networks for medical image segmentation often produce overconfident results misaligned with empirical observations. Such miscalibration, challenges their clinical translation. We propose to use marginal L1 average calibration…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Theodore Barfoot , Luis Garcia-Peraza-Herrera , Ben Glocker , Tom Vercauteren

Supervised learning algorithms based on Convolutional Neural Networks have become the benchmark for medical image segmentation tasks, but their effectiveness heavily relies on a large amount of labeled data. However, annotating medical…

图像与视频处理 · 电气工程与系统科学 2023-11-20 Tao Wang , Yuanbin Chen , Xinlin Zhang , Yuanbo Zhou , Junlin Lan , Bizhe Bai , Tao Tan , Min Du , Qinquan Gao , Tong Tong

Despite the remarkable performance of deep learning methods on various tasks, most cutting-edge models rely heavily on large-scale annotated training examples, which are often unavailable for clinical and health care tasks. The labeling…

计算机视觉与模式识别 · 计算机科学 2021-03-02 Jialin Peng , Ye Wang

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

计算机视觉与模式识别 · 计算机科学 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Overconfidence has been shown to impair generalization and calibration of a neural network. Previous studies remedy this issue by adding a regularization term to a loss function, preventing a model from making a peaked distribution. Label…

机器学习 · 计算机科学 2022-10-26 Dongkyu Lee , Ka Chun Cheung , Nevin L. Zhang

In the presence of noisy labels, designing robust loss functions is critical for securing the generalization performance of deep neural networks. Cross Entropy (CE) loss has been shown to be not robust to noisy labels due to its…

机器学习 · 计算机科学 2023-06-14 Hongxin Wei , Huiping Zhuang , Renchunzi Xie , Lei Feng , Gang Niu , Bo An , Yixuan Li

In semantic segmentation tasks, input images can often have more than one plausible interpretation, thus allowing for multiple valid labels. To capture such ambiguities, recent work has explored the use of probabilistic networks that can…

计算机视觉与模式识别 · 计算机科学 2021-08-05 Elias Kassapis , Georgi Dikov , Deepak K. Gupta , Cedric Nugteren

As research interests in medical image analysis become increasingly fine-grained, the cost for extensive annotation also rises. One feasible way to reduce the cost is to annotate with coarse-grained superclass labels while using limited…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Linrui Dai , Wenhui Lei , Xiaofan Zhang

Empirical studies suggest that machine learning models trained with empirical risk minimization (ERM) often rely on attributes that may be spuriously correlated with the class labels. Such models typically lead to poor performance during…

机器学习 · 计算机科学 2023-03-02 Sheng Liu , Xu Zhang , Nitesh Sekhar , Yue Wu , Prateek Singhal , Carlos Fernandez-Granda