English
Related papers

Related papers: Data Pipeline Quality: Influencing Factors, Root C…

200 papers

As data is a central component of many modern systems, the cause of a system malfunction may reside in the data, and, specifically, particular properties of the data. For example, a health-monitoring system that is designed under the…

Building high-quality knowledge graphs (KGs) from diverse sources requires combining methods for information extraction, data transformation, ontology mapping, entity matching, and data fusion. Numerous methods and tools exist for each of…

Artificial Intelligence · Computer Science 2025-11-25 Marvin Hofer , Erhard Rahm

The proliferation of SQL for data processing has often occurred without the rigor of traditional software development, leading to siloed efforts, logic replication, and increased risk. This ad-hoc approach hampers data governance and makes…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Dmytro Valiaiev

This report discusses the issues of data quality in biobanks. It presents the state-of-the-art in data quality: the definition of data quality, the dimensions of data quality, and the quality management system for achieving or describing…

Computers and Society · Computer Science 2018-12-27 Suneth Ranasinghe , Horst Pichler , Johann Eder

Data pipelines are widely employed in modern enterprises to power a variety of Machine-Learning (ML) and Business-Intelligence (BI) applications. Crucially, these pipelines are \emph{recurring} (e.g., daily or hourly) in production settings…

Databases · Computer Science 2023-06-06 Dezhan Tu , Yeye He , Weiwei Cui , Song Ge , Haidong Zhang , Han Shi , Dongmei Zhang , Surajit Chaudhuri

Software development projects management is a complex endeavor because it requires dealing with numerous unforeseen events that constantly arise along the way and that go against the expectations that had been established at the beginning.…

Software Engineering · Computer Science 2022-09-27 Fernando Pinciroli

In the current IT world, developers write code while system operators run the code mostly as a black box. The connection between both worlds is typically established with log messages: the developer provides hints to the (unknown) operator,…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Alexander Acker , Jorge Cardoso , Odej Kao

Effective debugging is a crucial aspect of software development, demanding problem-solving skills, expertise, and appropriate tools. Although previous research has studied expert developers' debugging strategies, the specific factors…

Human-Computer Interaction · Computer Science 2025-01-22 Maryam Arab , Jenny T. Liang , Valentina Hong , Thomas D. LaToza

Data comes in many forms. From a shallow perspective, they can be viewed as being either in structured (e.g., as a relation, as key-value pairs) or unstructured (e.g., text, image) formats. So far, machines have been fairly good at…

Computation and Language · Computer Science 2026-03-31 Md Ataur Rahman , Dimitris Sacharidis , Oscar Romero , Sergi Nadal

The data science revolution has led to an increased interest in the practice of data analysis. While much has been written about statistical thinking, a complementary form of thinking that appears in the practice of data analysis is design…

Methodology · Statistics 2023-05-24 Lucy D'Agostino McGowan , Roger D. Peng , Stephanie C. Hicks

This comprehensive survey serves as an indispensable resource for researchers embarking on the journey of fake news detection. By highlighting the pivotal role of dataset quality and diversity, it underscores the significance of these…

Computation and Language · Computer Science 2026-02-05 Soveatin Kuntur , Anna Wróblewska , Marcin Paprzycki , Maria Ganzha

Citations are the cornerstone of knowledge propagation and the primary means of assessing the quality of research, as well as directing investments in science. Science is increasingly becoming "data-intensive", where large volumes of data…

Digital Libraries · Computer Science 2017-09-28 Gianmaria Silvello

Due to its enormous benefits, the research and industry communities have shown an increasing interest in the Microservices Architecture (MSA) style over the last few years. Despite this, there is a limited evidence-based and thorough…

Software Engineering · Computer Science 2021-05-05 Muhammad Waseem , Peng Liang , Mojtaba Shahin , Aakash Ahmad , Ali Rezaei Nasab

Developers frequently reuse Stack Overflow code snippets, yet the quality of these snippets remains unevenly understood, particularly across programming languages and geographic contexts. This study investigates code quality in Stack…

Software Engineering · Computer Science 2026-05-06 Elijah Zolduoarrati , Sherlock A. Licorish , Nigel Stanger

Data-driven materials discovery requires large-scale experimental datasets, yet most of the information remains trapped in unstructured literature. Existing extraction efforts often focus on a limited set of features and have not addressed…

Computation and Language · Computer Science 2025-10-08 Xin Wang , Anshu Raj , Matthew Luebbe , Haiming Wen , Shuozhi Xu , Kun Lu

Internet of Things (IoT) is an emerging technology that has the promising power to change our future. Due to the market pressure, IoT systems may be released without sufficient testing. However, it is no longer acceptable to release IoT…

Computers and Society · Computer Science 2019-01-31 Bestoun S. Ahmed , Miroslav Bures , Karel Frajtak , Tomas Cerny

The reasoning capabilities of Large Language Models (LLMs) play a critical role in many downstream tasks, yet depend strongly on the quality of training data. Despite various proposed data construction methods, their practical utility in…

Computation and Language · Computer Science 2025-10-09 Yike Zhao , Simin Guo , Ziqing Yang , Shifan Han , Dahua Lin , Fei Tan

Context: The rapid adoption of AI-assisted code generation tools, such as large language models (LLMs), is transforming software development practices. While these tools promise significant productivity gains, concerns regarding the…

Software Engineering · Computer Science 2026-03-27 Vehid Geruslu , Zulfiyya Aliyeva , Eray Tüzün

Many software developers rely on open source software for developing their applications and writing their source codes. Measuring an independent project's overall productivity is still an open problem for many technology companies. In this…

Software Engineering · Computer Science 2022-03-30 Sairamvinay Vijayaraghavan , Jinxiao Song , Terry Guan , Seongwoo Choi , Sutej Kulkarni

Despite the overwhelming quantity of health information that is available online today, finding reliable and trustworthy information is still challenging, even when advanced recommender systems are used. To tackle this challenge and improve…

Computers and Society · Computer Science 2019-01-08 Prakruthi Karuna , Hemant Purohit , Vivian Motti