English
Related papers

Related papers: Few Clean Instances Help Denoising Distant Supervi…

200 papers

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Motivated by the goals of dataset pruning and defect identification, a growing body of methods have been developed to score individual examples within a dataset. These methods, which we call "example difficulty scores", are typically used…

Machine Learning · Computer Science 2024-01-04 Devin Kwok , Nikhil Anand , Jonathan Frankle , Gintare Karolina Dziugaite , David Rolnick

Recent studies show that in supervised fine-tuning (SFT) of large language models (LLMs), data quality matters more than quantity. While most data cleaning methods concentrate on filtering entire samples, the quality of individual tokens…

Computation and Language · Computer Science 2026-03-12 Jinlong Pang , Na Di , Zhaowei Zhu , Jiaheng Wei , Hao Cheng , Chen Qian , Yang Liu

kNN is a very effective Instance based learning method, and it is easy to implement. Due to heterogeneous nature of data, noises from different possible sources are also widespread in nature especially in case of large-scale databases. For…

Machine Learning · Computer Science 2020-05-19 Joydip Dhar , Ashaya Shukla , Mukul Kumar , Prashant Gupta

Learning from implicit feedback is one of the most common cases in the application of recommender systems. Generally speaking, interacted examples are considered as positive while negative examples are sampled from uninteracted ones.…

Information Retrieval · Computer Science 2022-03-15 Yu Wang , Xin Xin , Zaiqiao Meng , Xiangnan He , Joemon Jose , Fuli Feng

Weakly supervised learning is a popular approach for training machine learning models in low-resource settings. Instead of requesting high-quality yet costly human annotations, it allows training models with noisy annotations obtained from…

Computation and Language · Computer Science 2023-09-19 Dawei Zhu , Xiaoyu Shen , Marius Mosbach , Andreas Stephan , Dietrich Klakow

Traditional semi-supervised learning uses only labeled instances to train a classifier and then this classifier is utilized to classify unlabeled instances, while sometimes there are only positive instances which are elements of the target…

Machine Learning · Computer Science 2019-03-28 TingTing Li , WeiYa Fan , YunSong Luo

Label noise, commonly found in real-world datasets, has a detrimental impact on a model's generalization. To effectively detect incorrectly labeled instances, previous works have mostly relied on distinguishable training signals, such as…

Machine Learning · Computer Science 2024-05-31 Suyeon Kim , Dongha Lee , SeongKu Kang , Sukang Chae , Sanghwan Jang , Hwanjo Yu

Subset selection algorithms are ubiquitous in AI-driven applications, including, online recruiting portals and image search engines, so it is imperative that these tools are not discriminatory on the basis of protected attributes such as…

Computers and Society · Computer Science 2021-02-23 Anay Mehrotra , L. Elisa Celis

Accurate entity linkers have been produced for domains and languages where annotated data (i.e., texts linked to a knowledge base) is available. However, little progress has been made for the settings where no or very limited amounts of…

Computation and Language · Computer Science 2019-06-05 Phong Le , Ivan Titov

Improperly constructed datasets can result in inaccurate inferences. For instance, models trained on biased datasets perform poorly in terms of generalization (i.e., dataset bias). Recent debiasing techniques have successfully achieved…

Machine Learning · Computer Science 2022-12-05 Sumyeong Ahn , Se-Young Yun

The problem of learning from few labeled examples while using large amounts of unlabeled data has been approached by various semi-supervised methods. Although these methods can achieve superior performance, the models are often not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Sahil Khose , Shruti Jain , V Manushree

The prevalence of noisy-label samples poses a significant challenge in deep learning, inducing overfitting effects. This has, therefore, motivated the emergence of learning with noisy-label (LNL) techniques that focus on separating noisy-…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Arpit Garg , Cuong Nguyen , Rafael Felix , Thanh-Toan Do , Gustavo Carneiro

Real-world image denoising is an extremely important image processing problem, which aims to recover clean images from noisy images captured in natural environments. In recent years, diffusion models have achieved very promising results in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Cheng Yang , Lijing Liang , Zhixun Su

Current vision systems are trained on huge datasets, and these datasets come with costs: curation is expensive, they inherit human biases, and there are concerns over privacy and usage rights. To counter these costs, interest has surged in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Manel Baradad , Jonas Wulff , Tongzhou Wang , Phillip Isola , Antonio Torralba

In recent years, large "in the wild" face datasets have been released in an attempt to facilitate progress in tasks such as face detection, face recognition, and other tasks. Most of these datasets are acquired from webpages with automatic…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Viktor Varkarakis , Peter Corcoran

Distantly supervised named entity recognition (DS-NER) has been proposed to exploit the automatically labeled training data instead of human annotations. The distantly annotated datasets are often noisy and contain a considerable number of…

Computation and Language · Computer Science 2023-05-23 Lu Xu , Lidong Bing , Wei Lu

Real-world datasets commonly have noisy labels, which negatively affects the performance of deep neural networks (DNNs). In order to address this problem, we propose a label noise robust learning algorithm, in which the base classifier is…

Machine Learning · Computer Science 2022-07-13 Görkem Algan , Ilkay Ulusoy

Label noise presents a fundamental challenge in modern machine learning, especially when large-scale datasets are generated via automated processes. An increasingly common and important data paradigm, particularly in domains like medical…

Methodology · Statistics 2026-04-29 Zhu Guojun , Zhang Sanguo , Ren Mingyang

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi