English
Related papers

Related papers: Data Quality Measures and Efficient Evaluation Alg…

200 papers

The use of learning-based techniques to achieve automated software vulnerability detection has been of longstanding interest within the software security domain. These data-driven solutions are enabled by large software vulnerability…

Software Engineering · Computer Science 2023-01-16 Roland Croft , M. Ali Babar , Mehdi Kholoosi

A common assumption exists according to which machine learning models improve their performance when they have more data to learn from. In this study, the authors wished to clarify the dilemma by performing an empirical experiment utilizing…

Machine Learning · Computer Science 2021-12-20 Antti Kariluoto , Arto Pärnänen , Joni Kultanen , Jukka Soininen , Pekka Abrahamsson

In the field of machine learning, model performance is usually assessed by randomly splitting data into training and test sets. Different random splits, however, can yield markedly different performance estimates, so a genuinely good model…

Data cleaning is the initial stage of any machine learning project and is one of the most critical processes in data analysis. It is a critical step in ensuring that the dataset is devoid of incorrect or erroneous data. It can be done…

Databases · Computer Science 2021-09-16 Ga Young Lee , Lubna Alzamil , Bakhtiyar Doskenov , Arash Termehchy

Imitation learning from large multi-task demonstration datasets has emerged as a promising path for building generally-capable robots. As a result, 1000s of hours have been spent on building such large-scale datasets around the globe.…

Data mining, machine learning, and natural language processing are powerful techniques that can be used together to extract information from large texts. Depending on the task or problem at hand, there are many different approaches that can…

Information Retrieval · Computer Science 2017-11-08 Ricardo Baeza-Yates , Zeinab Liaghat

Recent years have seen significant activity on the problem of using data for the purpose of learning properties of quantum systems or of processing classical or quantum data via quantum computing. As in classical learning, quantum learning…

Quantum Physics · Physics 2024-04-17 Leonardo Banchi , Jason Luke Pereira , Sharu Theresa Jose , Osvaldo Simeone

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

The composition of pre-training datasets for large language models (LLMs) remains largely undisclosed, hindering transparency and efforts to optimize data quality, a critical driver of model performance. Current data selection methods, such…

Computation and Language · Computer Science 2025-08-07 Xinlin Zhuang , Jiahui Peng , Ren Ma , Yinfan Wang , Tianyi Bai , Xingjian Wei , Jiantao Qiu , Chi Zhang , Ying Qian , Conghui He

Having a sufficient quantity of quality data is a critical enabler of training effective machine learning models. Being able to effectively determine the adequacy of a dataset prior to training and evaluating a model's performance would be…

Machine Learning · Computer Science 2026-04-28 Arya Hatamian , Lionel Levine , Haniyeh Ehsani Oskouie , Majid Sarrafzadeh

Quantum machine learning (QML) holds promise for accelerating pattern recognition, optimization, and data analysis, but the conditions under which it can truly outperform classical approaches remain unclear. Existing research often…

Quantum Physics · Physics 2025-09-23 Christophe Pere

Machine learning has the potential to assist many communities in using the large datasets that are becoming more and more available. Unfortunately, much of that potential is not being realized because it would require sharing data in a way…

Machine Learning · Computer Science 2018-07-02 James Jordon , Jinsung Yoon , Mihaela van der Schaar

Even though deep neural models have achieved superhuman performance on many popular benchmarks, they have failed to generalize to OOD or adversarial datasets. Conventional approaches aimed at increasing robustness include developing…

Machine Learning · Computer Science 2022-03-15 Swaroop Mishra , Anjana Arunkumar

Intrusion detection is an essential task in the cyber threat environment. Machine learning and deep learning techniques have been applied for intrusion detection. However, most of the existing research focuses on the model work but ignores…

Cryptography and Security · Computer Science 2021-05-24 Haihua Chen , Ngan Tran , Anand Sagar Thumati , Jay Bhuyan , Junhua Ding

Big Data involves both a large number of events but also many variables. This paper will concentrate on the challenge presented by the large number of variables in a Big Dataset. It will start with a brief review of exploratory data…

Applications · Statistics 2019-07-24 S. J. Watts , L. Crow

We describe the use of machine learning algorithms to select high-quality measurements for the Mu2e experiment. This technique is important for experiments with backgrounds that arise due to measurement errors. The algorithms use multiple…

Data Analysis, Statistics and Probability · Physics 2021-09-01 Andrew Edmonds , David Brown , Luciano Vinas , Samantha Pagan

Testing Machine Learning (ML) models and AI-Infused Applications (AIIAs), or systems that contain ML models, is highly challenging. In addition to the challenges of testing classical software, it is acceptable and expected that statistical…

Machine Learning · Computer Science 2022-10-28 George Kour , Marcel Zalmanovici , Orna Raz , Samuel Ackerman , Ateret Anaby-Tavor

Datasets serve as crucial training resources and model performance trackers. However, existing datasets have exposed a plethora of problems, inducing biased models and unreliable evaluation results. In this paper, we propose a…

Computation and Language · Computer Science 2022-12-20 Chengwen Wang , Qingxiu Dong , Xiaochen Wang , Haitao Wang , Zhifang Sui

Recent advances in generating synthetic data that allow to add principled ways of protecting privacy -- such as Differential Privacy -- are a crucial step in sharing statistical information in a privacy preserving way. But while the focus…

Machine Learning · Statistics 2021-10-04 Christian Arnold , Marcel Neunhoeffer

In machine learning, research has traditionally focused on model development, with relatively less attention paid to training data. As model architectures have matured and marginal gains from further refinements diminish, data quality has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Pei-Han Chen , Szu-Chi Chung