English
Related papers

Related papers: A Survey on Data Cleaning Methods for Improved Mac…

200 papers

Large-scale, high-quality data are considered an essential factor for the successful application of many deep learning techniques. Meanwhile, numerous real-world deep learning tasks still have to contend with the lack of sufficient amounts…

Machine Learning · Computer Science 2023-10-26 Ou Wu , Rujing Yao

Data profiling is critical in machine learning for generating descriptive statistics, supporting both deeper understanding and downstream tasks like data valuation and curation. This work addresses profiling specifically in the context of…

Software Engineering · Computer Science 2025-03-21 Pankaj Thorat , Adnan Qidwai , Adrija Dhar , Aishwariya Chakraborty , Anand Eswaran , Hima Patel , Praveen Jayachandran

Good data stewardship requires removal of data at the request of the data's owner. This raises the question if and how a trained machine-learning model, which implicitly stores information about its training data, should be affected by such…

Machine Learning · Computer Science 2023-11-09 Chuan Guo , Tom Goldstein , Awni Hannun , Laurens van der Maaten

Traditional data science education often omits training on research workflows: the process that moves a scientific investigation from raw data to coherent research question to insightful contribution. In this paper, we elaborate basic…

Computers and Society · Computer Science 2021-06-09 Sara Stoudt , Valeri N. Vasquez , Ciera C. Martinez

Intrusion detection is an essential task in the cyber threat environment. Machine learning and deep learning techniques have been applied for intrusion detection. However, most of the existing research focuses on the model work but ignores…

Cryptography and Security · Computer Science 2021-05-24 Haihua Chen , Ngan Tran , Anand Sagar Thumati , Jay Bhuyan , Junhua Ding

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application for unlearning…

Machine Learning · Computer Science 2026-01-16 Martin Pawelczyk , Jimmy Z. Di , Yiwei Lu , Gautam Kamath , Ayush Sekhari , Seth Neel

With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years, in fact, as much as 90% of current data were created in the last couple of years,a trend that will…

Machine Learning · Computer Science 2015-03-19 O. Y. Al-Jarrah , P. D. Yoo , S Muhaidat , G. K. Karagiannidis , K. Taha

When selecting data for training large-scale models, standard practice is to filter for examples that match human notions of data quality. Such filtering yields qualitatively clean datapoints that intuitively should improve model behavior.…

Machine Learning · Computer Science 2024-01-24 Logan Engstrom , Axel Feldmann , Aleksander Madry

This study aims to integrate, clean and analysis through automated data mining techniques. Using data mining (DM) techniques is one of the processes of transferring raw data from current educational system to meaningful information that can…

Computers and Society · Computer Science 2019-09-04 Tajul Rosli Razak , Abdul Hapes Mohammed , Noorfaizalfarid Mohd Noor , Muhamad Arif Hashim

We identify the task of measuring data to quantitatively characterize the composition of machine learning data and datasets. Similar to an object's height, width, and volume, data measurements quantify different attributes of data along…

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

Machine Learning · Computer Science 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel

Today, intelligent systems that offer artificial intelligence capabilities often rely on machine learning. Machine learning describes the capacity of systems to learn from problem-specific training data to automate the process of analytical…

Artificial Intelligence · Computer Science 2021-04-15 Christian Janiesch , Patrick Zschech , Kai Heinrich

It often happens that some sensitive personal information, such as credit card numbers or passwords, are mistakenly incorporated in the training of machine learning models and need to be removed afterwards. The removal of such information…

Machine Learning · Computer Science 2025-04-25 Saber Malekmohammadi , Hong kyu Lee , Li Xiong

Today, data is a fuel for businesses to gain important insights and improve their performance. There is no industry in the world today that does not use data. But who will get this insight? Who processes all the raw data? Everything is done…

Machine Learning · Computer Science 2022-02-16 Milad Vazan

As the number of applications that use machine learning algorithms increases, the need for labeled data useful for training such algorithms intensifies. Getting labels typically involves employing humans to do the annotation, which directly…

Machine Learning · Computer Science 2013-07-16 Alexandros Ntoulas , Omar Alonso , Vasilis Kandylas

The purpose of this study is to investigate the development process for Artificial inelegance (AI) and machine learning (ML) applications in order to provide the best support environment. The main stages of ML are problem understanding,…

Software Engineering · Computer Science 2023-08-16 Taha Khamis , Hamam Mokayed

Optical microscopy is an indispensable tool in life sciences research, but conventional techniques require compromises between imaging parameters like speed, resolution, field-of-view, and phototoxicity. To overcome these limitations,…

Quantitative Methods · Quantitative Biology 2024-04-01 Leonor Morgado , Estibaliz Gómez-de-Mariscal , Hannah S. Heil , Ricardo Henriques

Large training sets have become a cornerstone of machine learning and are the foundation for recent advances in language modeling and multimodal learning. While data curation for pre-training is often still ad-hoc, one common paradigm is to…

Artificial Intelligence · Computer Science 2023-11-07 Alex Fang , Albin Madappally Jose , Amit Jain , Ludwig Schmidt , Alexander Toshev , Vaishaal Shankar

Data heterogeneity plays a pivotal role in determining the performance of machine learning (ML) systems. Traditional algorithms, which are typically designed to optimize average performance, often overlook the intrinsic diversity within…

Machine Learning · Computer Science 2025-06-03 Jiashuo Liu , Peng Cui

Benchmark datasets in computer vision often contain off-topic images, near duplicates, and label errors, leading to inaccurate estimates of model performance. In this paper, we revisit the task of data cleaning and formalize it as either a…