English
Related papers

Related papers: Efficient Bias Mitigation Without Privileged Infor…

200 papers

Existing weak supervision approaches use all the data covered by weak signals to train a classifier. We show both theoretically and empirically that this is not always optimal. Intuitively, there is a tradeoff between the amount of…

Machine Learning · Statistics 2023-03-08 Hunter Lang , Aravindan Vijayaraghavan , David Sontag

As Machine Learning models continue to be relied upon for making automated decisions, the issue of model bias becomes more and more prevalent. In this paper, we approach training a text classifica-tion model and optimize on bias…

Computation and Language · Computer Science 2019-08-19 Apik Ashod Zorian , Chandra Shekar Bikkanur

TabPFN has emerged as a promising in-context learning model for tabular data, capable of directly predicting the labels of test samples given labeled training examples. It has demonstrated competitive performance, particularly on…

Machine Learning · Computer Science 2025-02-05 Si-Yang Liu , Han-Jia Ye

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

Reducing the amount of labels required to train convolutional neural networks without performance degradation is key to effectively reduce human annotation efforts. We propose Reliable Label Bootstrapping (ReLaB), an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Paul Albert , Diego Ortego , Eric Arazo , Noel E. O'Connor , Kevin McGuinness

Deep Neural Networks have significantly impacted many computer vision tasks. However, their effectiveness diminishes when test data distribution (target domain) deviates from the one of training data (source domain). In situations where…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Andrea Maracani , Lorenzo Rosasco , Lorenzo Natale

The paradigm of worst-group loss minimization has shown its promise in avoiding to learn spurious correlations, but requires costly additional supervision on spurious attributes. To resolve this, recent works focus on developing weaker…

Machine Learning · Computer Science 2022-04-06 Junhyun Nam , Jaehyung Kim , Jaeho Lee , Jinwoo Shin

Contrastive learning approaches have achieved great success in learning visual representations with few labels of the target classes. That implies a tantalizing possibility of scaling them up beyond a curated "seed" benchmark, to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Deep learning methods typically depend on the availability of labeled data, which is expensive and time-consuming to obtain. Active learning addresses such effort by prioritizing which samples are best to annotate in order to maximize the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tabular data when there are discrepancies between the feature…

Machine Learning · Computer Science 2023-10-24 Qi-Le Zhou , Han-Jia Ye , Le-Ye Wang , De-Chuan Zhan

In this work, we improve the accuracy of several known algorithms to address the classification of large datasets when few labels are available. Our framework lies in the realm of graph-based semi-supervised learning. With novel…

Machine Learning · Computer Science 2024-07-02 Farid Bozorgnia

Current long-tailed semi-supervised learning methods assume that labeled data exhibit a long-tailed distribution, and unlabeled data adhere to a typical predefined distribution (i.e., long-tailed, uniform, or inverse long-tailed). However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yaxin Hou , Bo Han , Yuheng Jia , Hui Liu , Junhui Hou

Deep neural networks are powerful, massively parameterized machine learning models that have been shown to perform well in supervised learning tasks. However, very large amounts of labeled data are usually needed to train deep neural…

Machine Learning · Computer Science 2020-12-02 Hanchen Xie , Mohamed E. Hussein , Aram Galstyan , Wael Abd-Almageed

Modern neural networks have the capacity to overfit noisy labels frequently found in real-world datasets. Although great progress has been made, existing techniques are limited in providing theoretical guarantees for the performance of the…

Machine Learning · Computer Science 2020-11-17 Baharan Mirzasoleiman , Kaidi Cao , Jure Leskovec

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Instead of using expensive manual annotations, researchers have proposed to train named entity recognition (NER) systems using heuristic labeling rules. However, devising labeling rules is challenging because it often requires a…

Computation and Language · Computer Science 2021-04-14 Xinyan Zhao , Haibo Ding , Zhe Feng

Weakly supervised data are widespread and have attracted much attention. However, since label quality is often difficult to guarantee, sometimes the use of weakly supervised data will lead to unsatisfactory performance, i.e., performance…

Machine Learning · Computer Science 2019-04-23 Lan-Zhe Guo , Yu-Feng Li , Ming Li , Jin-Feng Yi , Bo-Wen Zhou , Zhi-Hua Zhou

We have described a novel approach for training tabular data using the TabTransformer model with self-supervised learning. Traditional machine learning models for tabular data, such as GBDT are being widely used though our paper examines…

Machine Learning · Computer Science 2024-01-30 Tirth Kiranbhai Vyas

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

The deep neural network (DNN) has been proven effective in various domains. However, they often struggle to perform well on certain minority groups during inference, despite showing strong performance on the majority of data groups. This is…

Machine Learning · Computer Science 2023-12-11 Jiaxu Zhao , Lu Yin , Shiwei Liu , Meng Fang , Mykola Pechenizkiy