English
Related papers

Related papers: From Data Quality to Model Quality: an Exploratory…

200 papers

Background: Data quality is vital in software analytics, particularly for machine learning (ML) applications like software defect prediction (SDP). Despite the widespread use of ML in software engineering, the effect of data quality…

Software Engineering · Computer Science 2024-08-23 Aaditya Bhatia , Dayi Lin , Gopi Krishnan Rajbahadur , Bram Adams , Ahmed E. Hassan

Understanding the effect of a feature vector $x \in \mathbb{R}^d$ on the response value (label) $y \in \mathbb{R}$ is the cornerstone of many statistical learning problems. Ideally, it is desired to understand how a set of collected…

Machine Learning · Computer Science 2023-06-22 Mohammad Mehrabi , Ryan A. Rossi

The quality of an induced model by a learning algorithm is dependent on the quality of the training data and the hyper-parameters supplied to the learning algorithm. Prior work has shown that improving the quality of the training data…

Machine Learning · Statistics 2014-03-14 Michael R. Smith , Tony Martinez , Christophe Giraud-Carrier

The purpose of this project was to collect and analyse data about the comparability and real-life applicability of published results focusing on Microsoft Windows malware, more specifically the impact of dataset size and testing dataset…

Cryptography and Security · Computer Science 2022-06-14 David Illes

Large Language Models (LLMs) are of great interest in vulnerability detection and repair. The effectiveness of these models hinges on the quality of the datasets used for both training and evaluation. Our investigation reveals that a number…

Software Engineering · Computer Science 2025-03-11 Anurag Swarnim Yadav , Joseph N. Wilson

This document gives a set of recommendations to build and manipulate the datasets used to develop and/or validate machine learning models such as deep neural networks. This document is one of the 3 documents defined in [1] to ensure the…

Building trustworthy, effective, and responsible machine learning systems hinges on understanding how differences in training data and modeling decisions interact to impact predictive performance. In this work, we seek to better understand…

Machine Learning · Computer Science 2022-11-14 Esther Rolf , Ben Packer , Alex Beutel , Fernando Diaz

Data Quality (DQ) describes the degree to which data characteristics meet requirements and are fit for use by humans and/or systems. There are several aspects in which DQ can be measured, called DQ dimensions (i.e. accuracy, completeness,…

Databases · Computer Science 2024-07-29 Vasileios Papastergios , Anastasios Gounaris

The adoption of machine learning (ML) and, more specifically, deep learning (DL) applications into all major areas of our lives is underway. The development of trustworthy AI is especially important in medicine due to the large implications…

Machine Learning · Computer Science 2024-02-22 Daniel Schwabe , Katinka Becker , Martin Seyferth , Andreas Klaß , Tobias Schäffter

The performance of visual quality prediction models is commonly assumed to be closely tied to their ability to capture perceptually relevant image aspects. Models are thus either based on sophisticated feature extractors carefully designed…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Sören Becker , Thomas Wiegand , Sebastian Bosse

Web content quality measurement is crucial to various web content processing applications. This paper will explore multi-scale features which may affect the quality of a host, and develop automatic statistical methods to evaluate the Web…

Information Retrieval · Computer Science 2013-04-24 Guang-Gang Geng , Xiao-Bo Jin , Xin-Chang Zhang , De-Xian Zhang

Data warehousing is continuously gaining importance as organizations are realizing the benefits of decision oriented data bases. However, the stumbling block to this rapid development is data quality issues at various stages of data…

Databases · Computer Science 2013-10-09 Vinay Kumar , Reema Thareja

Measuring and evaluating software quality has become a fundamental task. Many models have been proposed to support stakeholders in dealing with software quality. However, in most cases, quality models do not fit perfectly for the target…

Software Engineering · Computer Science 2013-12-05 Michael Kläs , Constanza Lampasona , Jürgen Münch

Recent advancements in pre-trained large foundation models (LFM) have yielded significant breakthroughs across various domains, including natural language processing and computer vision. These models have been particularly impactful in the…

Image and Video Processing · Electrical Eng. & Systems 2024-05-22 Ziqin Lin , Heng Li , Zinan Li , Huazhu Fu , Jiang Liu

Quality is an implicit property of models and modelling languages by their condition of engineering artifacts. However, the quality property is affected by the diversity of conceptions around the model-driven paradigm. In this document is…

Software Engineering · Computer Science 2016-06-08 Fáber D. Giraldo , Sergio España , Óscar Pastor

Nowadays, social networks of ever increasing size are studied by researchers from a range of disciplines. The data underlying these networks is often automatically gathered from API's, websites or existing databases. As a result, the…

Social and Information Networks · Computer Science 2022-01-24 Javier Garcia-Bernardo , Frank W. Takes

Deep Learning sets the state-of-the-art in many challenging tasks showing outstanding performance in a broad range of applications. Despite its success, it still lacks robustness hindering its adoption in medical applications. Modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Agnieszka Tomczack , Nassir Navab , Shadi Albarqouni

As large language models rapidly evolve to support longer context, there is a notable disparity in their capability to generate output at greater lengths. Recent study suggests that the primary cause for this imbalance may arise from the…

Computation and Language · Computer Science 2024-10-16 Yingda Chen , Xingjun Wang , Jintao Huang , Yunlin Mao , Daoze Zhang , Yuze Zhao

We develop techniques to quantify the degree to which a given (training or testing) example is an outlier in the underlying distribution. We evaluate five methods to score examples in a dataset by how well-represented the examples are, for…

Machine Learning · Computer Science 2019-10-30 Nicholas Carlini , Úlfar Erlingsson , Nicolas Papernot

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum