English
Related papers

Related papers: Detecting Quality Problems in Data Models by Clust…

200 papers

In order to introduce an integrated research information system, this will provide scientific institutions with the necessary information on research activities and research results in assured quality. Since data collection, duplication,…

Databases · Computer Science 2019-01-23 Otmane Azeroual , Mohammad Abuosba

Data quality is crucial for the successful training, generalization and performance of machine learning models. We propose to measure the quality of a subset concerning the dataset it represents, using topological data analysis techniques.…

Algebraic Topology · Mathematics 2024-10-01 Álvaro Torras-Casas , Eduardo Paluzo-Hidalgo , Rocio Gonzalez-Diaz

The quality of underlying training data is very crucial for building performant machine learning models with wider generalizabilty. However, current machine learning (ML) tools lack streamlined processes for improving the data quality. So,…

Machine Learning · Computer Science 2021-12-16 Atindriyo Sanyal , Vikram Chatterji , Nidhi Vyas , Ben Epstein , Nikita Demir , Anthony Corletti

High-quality data is key to interpretable and trustworthy data analytics and the basis for meaningful data-driven decisions. In practical scenarios, data quality is typically associated with data preprocessing, profiling, and cleansing for…

Databases · Computer Science 2019-07-19 Lisa Ehrlinger , Elisa Rusz , Wolfram Wöß

The widespread adoption of big data has ushered in a new era of data-driven decision-making, transforming numerous industries and sectors. However, the efficacy of these decisions hinges on the quality of the underlying data. Poor data…

Artificial Intelligence · Computer Science 2024-05-08 Widad Elouataoui

Software Defect Prediction (SDP) models are central to proactive software quality assurance, yet their effectiveness is often constrained by the quality of available datasets. Prior research has typically examined single issues such as…

Software Engineering · Computer Science 2025-12-22 Emmanuel Charleson Dapaah , Jens Grabowski

Nowadays most of the cloud applications process large amount of data to provide the desired results. Data volumes to be processed by cloud applications are growing much faster than computing power. This growth demands new strategies for…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-05 B. Thirumala Rao , N. V. Sridevi , V. Krishna Reddy , L. S. S. Reddy

Nowadays, people strive to improve the accuracy of deep learning models. However, very little work has focused on the quality of data sets. In fact, data quality determines model quality. Therefore, it is important for us to make research…

Machine Learning · Computer Science 2019-07-01 Tianxing He , Shengcheng Yu , Ziyuan Wang , Jieqiong Li , Zhenyu Chen

Data-centric AI is at the center of a fundamental shift in software engineering where machine learning becomes the new software, powered by big data and computing infrastructure. Here software engineering needs to be re-thought where data…

Machine Learning · Computer Science 2022-12-27 Steven Euijong Whang , Yuji Roh , Hwanjun Song , Jae-Gil Lee

Recent research has highlighted the importance of data quality in scaling large language models (LLMs). However, automated data quality control faces unique challenges in collaborative settings where sharing is not allowed directly between…

Computation and Language · Computer Science 2025-07-08 Wanru Zhao , Hongxiang Fan , Shell Xu Hu , Wangchunshu Zhou , Bofan Chen , Nicholas D. Lane

Nowadays, data is becoming the new fuel for economic wealth and creation of novel and profitable business models. Multitude of technologies are contributing to an abundance of information sources which are already the baseline for…

Databases · Computer Science 2024-03-07 Laura Martín , Luis Sánchez , Jorge Lanza , Pablo Sotres

Modern artificial intelligence (AI) applications require large quantities of training and test data. This need creates critical challenges not only concerning the availability of such data, but also regarding its quality. For example,…

Data pipelines are an integral part of various modern data-driven systems. However, despite their importance, they are often unreliable and deliver poor-quality data. A critical step toward improving this situation is a solid understanding…

Software Engineering · Computer Science 2023-09-14 Harald Foidl , Valentina Golendukhina , Rudolf Ramler , Michael Felderer

Reliable empirical models such as those used in software effort estimation or defect prediction are inherently dependent on the data from which they are built. As demands for process and product improvement continue to grow, the quality of…

Software Engineering · Computer Science 2021-06-14 Michael Franklin Bosu , Stephen G. MacDonell

In systems biology, it is common to measure biochemical entities at different levels of the same biological system. One of the central problems for the data fusion of such data sets is the heterogeneity of the data. This thesis discusses…

Genomics · Quantitative Biology 2019-08-27 Yipeng Song

There are many methods proposed for inferring parameters of the Ising model from given data, that is a set of configurations generated according to the model itself. However little attention has been paid until now to the data, e.g. how the…

Statistical Mechanics · Physics 2016-09-01 Aurélien Decelle , Federico Ricci-Tersenghi , Pan Zhang

Most classification methods are based on the assumption that data conforms to a stationary distribution. The machine learning domain currently suffers from a lack of classification techniques that are able to detect the occurrence of a…

Machine Learning · Statistics 2012-01-05 Alzennyr Da Silva , Yves Lechevallier , Fabrice Rossi , Francisco De A. T. De Carvahlo

Even though deep neural models have achieved superhuman performance on many popular benchmarks, they have failed to generalize to OOD or adversarial datasets. Conventional approaches aimed at increasing robustness include developing…

Machine Learning · Computer Science 2022-03-15 Swaroop Mishra , Anjana Arunkumar

Prompt and accurate detection of system anomalies is essential to ensure the reliability of software systems. Unlike manual efforts that exploit all available run-time information, existing approaches usually leverage only a single type of…

Software Engineering · Computer Science 2023-02-16 Baitong Li , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Yongqiang Yang , Michael R. Lyu

Crowdsourcing enables one to leverage on the intelligence and wisdom of potentially large groups of individuals toward solving problems. Common problems approached with crowdsourcing are labeling images, translating or transcribing text,…

Human-Computer Interaction · Computer Science 2018-01-09 Florian Daniel , Pavel Kucherbaev , Cinzia Cappiello , Boualem Benatallah , Mohammad Allahbakhsh