English
Related papers

Related papers: The effect of variable labels on deep learning mod…

200 papers

The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Osman Aka , Ken Burke , Alex Bäuerle , Christina Greer , Margaret Mitchell

Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from…

Machine Learning · Computer Science 2025-06-10 Sujay Nagaraj , Yang Liu , Flavio P. Calmon , Berk Ustun

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He

Labeling data for modern machine learning is expensive and time-consuming. Latent variable models can be used to infer labels from weaker, easier-to-acquire sources operating on unlabeled data. Such models can also be trained using labeled…

Machine Learning · Computer Science 2021-03-05 Mayee F. Chen , Benjamin Cohen-Wang , Stephen Mussmann , Frederic Sala , Christopher Ré

Learning representations of data, and in particular learning features for a subsequent prediction task, has been a fruitful area of research delivering impressive empirical results in recent years. However, relatively little is understood…

Machine Learning · Computer Science 2016-11-11 Daniel McNamara , Cheng Soon Ong , Robert C. Williamson

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Data augmentation (DA) encodes invariance and provides implicit regularization critical to a model's performance in image classification tasks. However, while DA improves average accuracy, recent studies have shown that its impact can be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Polina Kirichenko , Mark Ibrahim , Randall Balestriero , Diane Bouchacourt , Ramakrishna Vedantam , Hamed Firooz , Andrew Gordon Wilson

In this paper, we introduce the Label-Aware Ranked loss, a novel metric loss function. Compared to the state-of-the-art Deep Metric Learning losses, this function takes advantage of the ranked ordering of the labels in regression problems.…

Signal Processing · Electrical Eng. & Systems 2022-10-26 Lorenzo Servadei , Huawei Sun , Julius Ott , Michael Stephan , Souvik Hazra , Thomas Stadelmayer , Daniela Sanchez Lopera , Robert Wille , Avik Santra

Cosine similarity is often used to measure the similarity of vectors. These vectors might be the representations of neural network models. However, it is not guaranteed that cosine similarity of model representations will tell us anything…

Machine Learning · Computer Science 2026-04-01 Beatrix M. G. Nielsen

In classification problems, models must predict a class label based on the input data features. However, class labels are organized hierarchically in many datasets. While a classification task is often defined at a specific level of this…

Machine Learning · Computer Science 2025-09-08 Davide Pirovano , Federico Milanesio , Michele Caselle , Piero Fariselli , Matteo Osella

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

Rich meta-epidemiological data sets have been collected to explore associations between intervention effect estimates and study-level characteristics. Welton et al. proposed models for the analysis of meta-epidemiological data, but these…

Applications · Statistics 2017-11-28 Kirsty Rhodes , David Mawdsley , Rebecca Turner , Hayley Jones , Jelena Savovic , Julian Higgins

Breast density, which is the ratio between fibroglandular tissue (FGT) and total breast volume, can be assessed qualitatively by radiologists and quantitatively by computer algorithms. These algorithms often rely on segmentation of breast…

Image and Video Processing · Electrical Eng. & Systems 2020-12-09 Bas H. M. van der Velden , Max A. A. Ragusi , Markus H. A. Janse , Claudette E. Loo , Kenneth G. A. Gilhuijs

Training deep neural networks requires many training samples, but in practice training labels are expensive to obtain and may be of varying quality, as some may be from trusted expert labelers while others might be from heuristics or other…

Machine Learning · Computer Science 2018-05-24 Mostafa Dehghani , Arash Mehrjou , Stephan Gouws , Jaap Kamps , Bernhard Schölkopf

In medical image classification tasks, it is common to find that the number of normal samples far exceeds the number of abnormal samples. In such class-imbalanced situations, reliable training of deep neural networks continues to be a major…

Machine Learning · Computer Science 2022-04-06 Sivaramakrishnan Rajaraman , Prasanth Ganesan , Sameer Antani

Evidence suggests that networks trained on large datasets generalize well not solely because of the numerous training examples, but also class diversity which encourages learning of enriched features. This raises the question of whether…

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

Galaxy morphologies and their relation with physical properties have been a relevant subject of study in the past. Most galaxy morphology catalogs have been labelled by human annotators or by machine learning models trained on human…

Astrophysics of Galaxies · Physics 2023-08-23 Esteban Medina-Rosales , Guillermo Cabrera-Vives , Christopher J. Miller

Image classification models tend to make decisions based on peripheral attributes of data items that have strong correlation with a target variable (i.e., dataset bias). These biased models suffer from the poor generalization capability…

Machine Learning · Computer Science 2021-10-26 Jungsoo Lee , Eungyeup Kim , Juyoung Lee , Jihyeon Lee , Jaegul Choo

Real-world data often exhibits long-tailed distributions with heavy class imbalance, posing great challenges for deep recognition models. We identify a persisting dilemma on the value of labels in the context of imbalanced learning: on the…

Machine Learning · Computer Science 2020-09-29 Yuzhe Yang , Zhi Xu