English
Related papers

Related papers: Training Set Debugging Using Trusted Items

200 papers

In order to train robust deep learning models, large amounts of labelled data is required. However, in the absence of such large repositories of labelled data, unlabeled data can be exploited for the same. Semi-Supervised learning aims to…

Machine Learning · Computer Science 2021-07-20 Soumyadeep Ghosh , Sanjay Kumar , Janu Verma , Awanish Kumar

Real bug fixes found in open source repositories seem to be the perfect source for learning to localize and repair real bugs. However, the absence of large scale bug fix collections has made it difficult to effectively exploit real bug…

Software Engineering · Computer Science 2022-07-04 Cedric Richter , Heike Wehrheim

Enabling robots to learn novel visuomotor skills in a data-efficient manner remains an unsolved problem with myriad challenges. A popular paradigm for tackling this problem is through leveraging large unlabeled datasets that have many…

Robotics · Computer Science 2023-05-16 Maximilian Du , Suraj Nair , Dorsa Sadigh , Chelsea Finn

In the surface defect detection, there are some suspicious regions that cannot be uniquely classified as abnormal or normal. The annotating of suspicious regions is easily affected by factors such as workers' emotional fluctuations and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Tongzhi Niu , Bin Li , Kai Li , Yufeng Lin , Yuwei Li , Weifeng Li , Zhenrong Wang

Training deep neural networks with noisy labels remains a significant challenge, often leading to degraded performance. Existing methods for handling label noise typically rely on either transition matrix, noise detection, or meta-learning…

Machine Learning · Computer Science 2026-03-17 Zhanhui Lin , Yanlin Liu , Sanping Zhou

We study the task of teaching a machine to classify objects using features and labels. We introduce the Error-Driven-Featuring design pattern for teaching using features and labels in which a teacher prefers to introduce features only if…

Artificial Intelligence · Computer Science 2016-11-21 Christopher Meek , Patrice Simard , Xiaojin Zhu

Bug reports are common artefacts in software development. They serve as the main channel for users to communicate to developers information about the issues that they encounter when using released versions of software programs. In the…

Software Engineering · Computer Science 2021-12-21 Arthur D. Sawadogo , Quentin Guimard , Tegawendé F. Bissyandé , Abdoul Kader Kaboré , Jacques Klein , Naouel Moha

Determining whether a configurable software system has a performance bug or it was misconfigured is often challenging. While there are numerous debugging techniques that can support developers in this task, there is limited empirical…

Software Engineering · Computer Science 2022-03-22 Miguel Velez , Pooyan Jamshidi , Norbert Siegmund , Sven Apel , Christian Kästner

We study the effect of imperfect training data labels on the performance of classification methods. In a general setting, where the probability that an observation in the training dataset is mislabelled may depend on both the feature vector…

Statistics Theory · Mathematics 2019-05-07 Timothy I. Cannings , Yingying Fan , Richard J. Samworth

Large language models (LLMs) are trained through multi-stage pipelines over heterogeneous data sources, yet developers lack a principled way to pinpoint the specific data responsible for an observed behavior. This lack of observability…

Computation and Language · Computer Science 2026-03-19 Wenjie Jacky Mo , Qin Liu , Xiaofei Wen , Wenxuan Zhou , Zhe Zhao , Muhao Chen

Meta-learning is a popular framework for learning with limited data in which an algorithm is produced by training over multiple few-shot learning tasks. For classification problems, these tasks are typically constructed by sampling a small…

Machine Learning · Computer Science 2021-10-08 Amrith Setlur , Oscar Li , Virginia Smith

Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quantifying model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Deep Pandey , Qi Yu

A critical problem in deep learning is that systems learn inappropriate biases, resulting in their inability to perform well on minority groups. This has led to the creation of multiple algorithms that endeavor to mitigate bias. However, it…

Machine Learning · Computer Science 2024-04-24 Robik Shrestha , Kushal Kafle , Christopher Kanan

We investigate the problem of machine learning with mislabeled training data. We try to make the effects of mislabeled training better understood through analysis of the basic model and equations that characterize the problem. This includes…

Machine Learning · Computer Science 2019-09-23 Herbert Gish , Jan Silovsky , Man-Ling Sung , Man-Hung Siu , William Hartmann , Zhuolin Jiang

Matching two different sets of items, called heterogeneous set-to-set matching problem, has recently received attention as a promising problem. The difficulties are to extract features to match a correct pair of different sets and also…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Yuki Saito , Takuma Nakamura , Hirotaka Hachiya , Kenji Fukumizu

Many machine learning systems rely on data collected in the wild from untrusted sources, exposing the learning algorithms to data poisoning. Attackers can inject malicious data in the training dataset to subvert the learning process,…

Machine Learning · Statistics 2018-10-04 Andrea Paudice , Luis Muñoz-González , Emil C. Lupu

Clustering is an unsupervised technique of Data Mining. It means grouping similar objects together and separating the dissimilar ones. Each object in the data set is assigned a class label in the clustering process using a distance measure.…

Information Retrieval · Computer Science 2011-10-13 Parul Agarwal , M. Afshar Alam , Ranjit Biswas

Recently, learning with soft labels has been shown to achieve better performance than learning with hard labels in terms of model generalization, calibration, and robustness. However, collecting pointwise labeling confidence for all…

Machine Learning · Computer Science 2023-10-10 Wei Wang , Lei Feng , Yuchen Jiang , Gang Niu , Min-Ling Zhang , Masashi Sugiyama

In classification problems, models must predict a class label based on the input data features. However, class labels are organized hierarchically in many datasets. While a classification task is often defined at a specific level of this…

Machine Learning · Computer Science 2025-09-08 Davide Pirovano , Federico Milanesio , Michele Caselle , Piero Fariselli , Matteo Osella

A growing line of work shows how learned predictions can be used to break through worst-case barriers to improve the running time of an algorithm. However, incorporating predictions into data structures with strong theoretical guarantees…

Data Structures and Algorithms · Computer Science 2023-06-21 Samuel McCauley , Benjamin Moseley , Aidin Niaparast , Shikha Singh