English
Related papers

Related papers: Impact of Data Quality on Deep Neural Network Trai…

200 papers

Data augmentation that introduces diversity into the input data has long been used in training deep learning models. It has demonstrated benefits in improving robustness and generalization, practically aligning well with other…

Machine Learning · Computer Science 2025-08-18 Yang Ba , Michelle V. Mancenido , Rong Pan

The efficacy of machine learning (ML) models depends on both algorithms and data. Training data defines what we want our models to learn, and testing data provides the means by which their empirical progress is measured. Benchmark datasets…

Machine Learning · Computer Science 2021-11-23 Lora Aroyo , Matthew Lease , Praveen Paritosh , Mike Schaekermann

Machine learning software, deep neural networks (DNN) software in particular, discerns valuable information from a large dataset, a set of data. Outcomes of such DNN programs are dependent on the quality of both learning programs and…

Machine Learning · Computer Science 2019-11-27 Shin Nakajima

Developing machine learning models can be seen as a process similar to the one established for traditional software development. A key difference between the two lies in the strong dependency between the quality of a machine learning model…

Machine Learning · Computer Science 2021-02-17 Cedric Renggli , Luka Rimanic , Nezihe Merve Gürel , Bojan Karlaš , Wentao Wu , Ce Zhang

Training neural networks is traditionally done by providing a sequence of random mini-batches sampled uniformly from the entire training data. In this work, we analyze the effect of curriculum learning, which involves the non-uniform…

Machine Learning · Computer Science 2020-12-03 Guy Hacohen , Daphna Weinshall

Traditional data quality control methods are based on users experience or previously established business rules, and this limits performance in addition to being a very time consuming process with lower than desirable accuracy. Utilizing…

Artificial Intelligence · Computer Science 2018-10-17 Wei Dai , Kenji Yoshigoe , William Parsley

The quality of an induced model by a learning algorithm is dependent on the quality of the training data and the hyper-parameters supplied to the learning algorithm. Prior work has shown that improving the quality of the training data…

Machine Learning · Statistics 2014-03-14 Michael R. Smith , Tony Martinez , Christophe Giraud-Carrier

Data augmentation (DA) encodes invariance and provides implicit regularization critical to a model's performance in image classification tasks. However, while DA improves average accuracy, recent studies have shown that its impact can be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Polina Kirichenko , Mark Ibrahim , Randall Balestriero , Diane Bouchacourt , Ramakrishna Vedantam , Hamed Firooz , Andrew Gordon Wilson

Image quality is an important practical challenge that is often overlooked in the design of machine vision systems. Commonly, machine vision systems are trained and tested on high quality image datasets, yet in practical applications the…

Computer Vision and Pattern Recognition · Computer Science 2016-04-25 Samuel Dodge , Lina Karam

Calibration can reduce overconfident predictions of deep neural networks, but can calibration also accelerate training? In this paper, we show that it can when used to prioritize some examples for performing subset selection. We study the…

Machine Learning · Computer Science 2022-11-17 Ganesh Tata , Gautham Krishna Gudur , Gopinath Chennupati , Mohammad Emtiyaz Khan

As deep neural networks are highly expressive, it is important to find solutions with small generalization gap (the difference between the performance on the training data and unseen data). Focusing on the stochastic nature of training, we…

Machine Learning · Computer Science 2023-10-31 Rie Johnson , Tong Zhang

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

For many computer vision problems, the deep neural networks are trained and validated based on the assumption that the input images are pristine (i.e., artifact-free). However, digital images are subject to a wide range of distortions in…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Zhuo Chen , Weisi Lin , Shiqi Wang , Long Xu , Leida Li

In machine learning, research has traditionally focused on model development, with relatively less attention paid to training data. As model architectures have matured and marginal gains from further refinements diminish, data quality has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Pei-Han Chen , Szu-Chi Chung

Criminal networks such as human trafficking rings are threats to the rule of law, democracy and public safety in our global society. Network science provides invaluable tools to identify key players and design interventions for Law…

Physics and Society · Physics 2025-01-09 Wang Ngai Yeung , Riccardo Di Clemente , Renaud Lambiotte

We propose a novel method for training a neural network for image classification to reduce input data dynamically, in order to reduce the costs of training a neural network model. As Deep Learning tasks become more popular, their…

Machine Learning · Computer Science 2025-10-10 Dominic Sanderson , Tatiana Kalgonova

Deep Neural Networks (DNN) represent the state of the art in many tasks. However, due to their overparameterization, their generalization capabilities are in doubt and still a field under study. Consequently, DNN can overfit and assign…

Machine Learning · Computer Science 2021-05-19 Juan Maroñas , Daniel Ramos , Roberto Paredes

Data redundancy is ubiquitous in the inputs and intermediate results of Deep Neural Networks (DNN). It offers many significant opportunities for improving DNN performance and efficiency and has been explored in a large body of work. These…

Machine Learning · Computer Science 2022-08-30 Jou-An Chen , Wei Niu , Bin Ren , Yanzhi Wang , Xipeng Shen

Data quality is a key element for building and optimizing good learning models. Despite many attempts to characterize data quality, there is still a need for rigorous formalization and an efficient measure of the quality from available…

Machine Learning · Computer Science 2023-12-14 Jouseau Roxane , Salva Sébastien , Samir Chafik

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

Machine Learning · Computer Science 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson