English
Related papers

Related papers: Data Pipeline Quality: Influencing Factors, Root C…

200 papers

While high data quality (DQ) is critical for analytics, compliance, and AI performance, data quality management (DQM) remains a complex, resource-intensive, and often manual process. This study investigates the extent to which existing…

Databases · Computer Science 2025-06-30 Heidi Carolina Tamm , Anastasija Nikiforova

Data integration systems allow users to access data sitting in multiple sources by means of queries over a global schema, related to the sources via mappings. Data sources often contain sensitive information, and thus an analysis is needed…

Logic in Computer Science · Computer Science 2020-12-15 Michael Benedikt , Pierre Bourhis , Louis Jachiet , Michaël Thomazo

Organisations often struggle to identify the causes of change in metrics such as product quality and delivery duration. This task becomes increasingly challenging when the cause lies outside of company borders in multi-echelon supply chains…

Machine Learning · Computer Science 2024-08-19 Stefan Schoepf , Jack Foster , Alexandra Brintrup

Mapping applications onto heterogeneous platforms is a difficult challenge, even for simple application patterns such as pipeline graphs. The problem is even more complex when processors are subject to failure during the execution of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-03-26 Anne Benoit , Veronika Rehn-Sonigo , Yves Robert

Companies struggle to continuously develop and deploy AI models to complex production systems due to AI characteristics while assuring quality. To ease the development process, continuous pipelines for AI have become an active research area…

Software Engineering · Computer Science 2023-01-24 Monika Steidl , Michael Felderer , Rudolf Ramler

Data quality is a key element for building and optimizing good learning models. Despite many attempts to characterize data quality, there is still a need for rigorous formalization and an efficient measure of the quality from available…

Machine Learning · Computer Science 2023-12-14 Jouseau Roxane , Salva Sébastien , Samir Chafik

Previous studies have shown that high-quality code comments assist developers in program comprehension and maintenance tasks. However, the semi-structured nature of comments, unclear conventions for writing good comments, and the lack of…

Software Engineering · Computer Science 2021-07-27 Pooja Rani

Today's software systems like cyber-physical production systems or big data systems have to process large volumes and diverse types of data which heavily influences the quality of these so-called data-intensive systems. However, traditional…

Software Engineering · Computer Science 2019-04-10 Michael Felderer , Barbara Russo , Florian Auer

Data quality is a significant issue for any application that requests for analytics to support decision making. It becomes very important when we focus on Internet of Things (IoT) where numerous devices can interact to exchange and process…

Machine Learning · Computer Science 2020-07-30 Anna Karanika , Panagiotis Oikonomou , Kostas Kolomvatsos , Christos Anagnostopoulos

Software product quality can be defined as the features and characteristics of the product that meet the user needs. The quality of any software can be achieved by following a well defined software process. These software process results…

Software Engineering · Computer Science 2018-02-19 Karuna Prasad , MG Divya , N Mangala

Data volumes and rates of research infrastructures will continue to increase in the upcoming years and impact how we interact with their final data products. Little of the processed data can be directly investigated and most of it will be…

Instrumentation and Methods for Astrophysics · Physics 2024-04-23 Michael A. C. Johnson , Hans-Rainer Klöckner , Albina Muzafarova , Kristen Lackeos , David J. Champion , Marta Dembska , Sirko Schindler , Marcus Paradies

Compiler error messages serve as an initial resource for programmers dealing with compilation errors. However, previous studies indicate that they often lack sufficient targeted information to resolve code issues. Consequently, programmers…

Software Engineering · Computer Science 2023-07-21 Patricia Widjojo , Christoph Treude

As crowdsourcing emerges as an efficient and cost-effective method for obtaining labels for machine learning datasets, it is important to assess the quality of crowd-provided data, so as to improve analysis performance and reduce biases in…

Human-Computer Interaction · Computer Science 2025-06-26 Yang Ba , Michelle V. Mancenido , Erin K. Chiou , Rong Pan

The complexity and diversity of big data and AI workloads make understanding them difficult and challenging. This paper proposes a new approach to modelling and characterizing big data and AI workloads. We consider each big data and AI…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-28 Wanling Gao , Jianfeng Zhan , Lei Wang , Chunjie Luo , Daoyi Zheng , Fei Tang , Biwei Xie , Chen Zheng , Xu Wen , Xiwen He , Hainan Ye , Rui Ren

Water quality is foundational to environmental sustainability, ecosystem resilience, and public health. Deep learning offers transformative potential for large-scale water quality prediction and scientific insights generation. However,…

Machine Learning · Computer Science 2025-10-28 Xiaobo Xia , Xiaofeng Liu , Jiale Liu , Kuai Fang , Lu Lu , Samet Oymak , William S. Currie , Tongliang Liu

Data Quality (DQ) describes the degree to which data characteristics meet requirements and are fit for use by humans and/or systems. There are several aspects in which DQ can be measured, called DQ dimensions (i.e. accuracy, completeness,…

Databases · Computer Science 2024-07-29 Vasileios Papastergios , Anastasios Gounaris

Software developers often look for solutions to their code-level problems using the Stack Overflow Q&A website. To receive help, developers frequently submit questions containing sample code segments and the description of the programming…

Software Engineering · Computer Science 2021-12-28 Saikat Mondal , Mohammad Masudur Rahman , Chanchal K. Roy , Kevin Schneider

Wikidata has been increasingly adopted by many communities for a wide variety of applications, which demand high-quality knowledge to deliver successful results. In this paper, we develop a framework to detect and analyze low-quality…

Artificial Intelligence · Computer Science 2021-11-22 Kartik Shenoy , Filip Ilievski , Daniel Garijo , Daniel Schwabe , Pedro Szekely

Background: Test-driven development (TDD) is a technique that repeats short coding cycles interleaved with testing. The developer first writes a unit test for the desired functionality, followed by the necessary production code, and…

Software Engineering · Computer Science 2016-11-21 Davide Fucci , Hakan Erdogmus , Burak Turhan , Markku Oivo , Natalia Juristo

Software source code often harbours "hotspots": small portions of the code that change far more often than the rest of the project and thus concentrate maintenance activity. We mine the complete version histories of 91 evolving, actively…

Software Engineering · Computer Science 2026-02-16 Saleha Muzammil , Mughees Ur Rehman , Zoe Kotti , Diomidis Spinellis