English
Related papers

Related papers: Detecting Quality Problems in Research Data: A Mod…

200 papers

Data is a cornerstone of empirical software engineering (ESE) research and practice. Data underpin numerous process and project management activities, including the estimation of development effort and the prediction of the likely location…

Software Engineering · Computer Science 2020-12-22 Michael F. Bosu , Stephen G. MacDonell

Traditional control and monitoring of water quality in drinking water distribution networks (WDN) rely on mostly model- or toolbox-driven approaches, where the network topology and parameters are assumed to be known. In contrast, system…

Systems and Control · Electrical Eng. & Systems 2023-01-24 Shen Wang , Ankush Chakrabarty , Ahmad F. Taha

Software repositories are rich sources of qualitative artifacts, including source code comments, commit messages, issue descriptions, and documentation. These artifacts offer many interesting insights when analyzed through quantitative…

Software Engineering · Computer Science 2024-06-13 Christoph Treude

Modern artificial intelligence (AI) applications require large quantities of training and test data. This need creates critical challenges not only concerning the availability of such data, but also regarding its quality. For example,…

The popularity of deep learning has led to the curation of a vast number of massive and multifarious datasets. Despite having close-to-human performance on individual tasks, training parameter-hungry models on large datasets poses…

Machine Learning · Computer Science 2023-09-27 Noveen Sachdeva , Julian McAuley

Recent research has highlighted the importance of data quality in scaling large language models (LLMs). However, automated data quality control faces unique challenges in collaborative settings where sharing is not allowed directly between…

Computation and Language · Computer Science 2025-07-08 Wanru Zhao , Hongxiang Fan , Shell Xu Hu , Wangchunshu Zhou , Bofan Chen , Nicholas D. Lane

Document databases are becoming popular, but how to present complex document query to obtain useful information from the document remains an important topic to study. In this paper, we describe the design issues of a pattern-based document…

Databases · Computer Science 2015-04-16 Xuhui Li , Mengchi Liu , Xiaoying Wu , Shanfeng Zhu

The ability to collect and analyze large amounts of data is a growing problem within the scientific community. The growing gap between data and users calls for innovative tools that address the challenges faced by big data volume, velocity…

Databases · Computer Science 2016-08-01 Vijay Gadepally , Jeremy Kepner

Data pipelines are an integral part of various modern data-driven systems. However, despite their importance, they are often unreliable and deliver poor-quality data. A critical step toward improving this situation is a solid understanding…

Software Engineering · Computer Science 2023-09-14 Harald Foidl , Valentina Golendukhina , Rudolf Ramler , Michael Felderer

Within data-driven artificial intelligence (AI) systems for industrial applications, ensuring the reliability of the incoming data streams is an integral part of trustworthy decision-making. An approach to assess data validity is data…

Databases · Computer Science 2024-08-14 Firas Bayram , Bestoun S. Ahmed , Erik Hallin

Data intensive research requires the support of appropriate datasets. However, it is often time-consuming to discover usable datasets matching a specific research topic. We formulate the dataset discovery problem on an attributed…

Information Retrieval · Computer Science 2021-06-08 Basmah Altaf , Shichao Pei , Xiangliang Zhang

The increasing size and availability of web data make data quality a core challenge in many applications. Principles of data quality are recognized as essential to ensure that data fit for their intended use in operations, decision-making,…

Digital Libraries · Computer Science 2013-05-20 Ahmad Assaf , Aline Senart

Lack of diversity in data collection has caused significant failures in machine learning (ML) applications. While ML developers perform post-collection interventions, these are time intensive and rarely comprehensive. Thus, new methods to…

Human-Computer Interaction · Computer Science 2023-08-01 Aspen Hopkins , Fred Hohman , Luca Zappella , Xavier Suau Cuadros , Dominik Moritz

Over the past few years, we have seen fundamental breakthroughs in core problems in machine learning, largely driven by advances in deep neural networks. At the same time, the amount of data collected in a wide array of scientific domains…

Machine Learning · Computer Science 2020-03-27 Maithra Raghu , Eric Schmidt

Data Linkage is an important step that can provide valuable insights for evidence-based decision making, especially for crucial events. Performing sensible queries across heterogeneous databases containing millions of records is a complex…

Databases · Computer Science 2015-10-09 Mohammed Gollapalli

Patent data have long been used for engineering design research because of its large and expanding size, and widely varying massive amount of design information contained in patents. Recent advances in artificial intelligence and data…

Digital Libraries · Computer Science 2022-11-04 Shuo Jiang , Serhad Sarica , Binyang Song , Jie Hu , Jianxi Luo

Product Data Management (PDM) aims to provide 'Systems' contributing in industries by electronically maintaining organizational data, improving data repository system, facilitating with easy access to CAD and providing additional…

Information Retrieval · Computer Science 2010-08-10 Zeeshan Ahmed , Saman Majeed , Thomas Dandekar

The recently increased complexity of Machine Learning (ML) methods, led to the necessity to lighten both the research and industry development processes. ML pipelines have become an essential tool for experts of many domains, data…

Software Engineering · Computer Science 2022-07-18 Giordano d'Aloisio , Antinisca Di Marco , Giovanni Stilo

The growing adoption of Industrial Internet of Things (IIoT) technologies enables automated, real-time collection of manufacturing process data, unlocking new opportunities for data-driven product development. Current data-driven methods…

Machine Learning · Computer Science 2025-12-11 Jiahang Li , Lucas Cazzonelli , Jacqueline Höllig , Markus Doellken , Sven Matthiesen

Actually, software products are increasing in a fast way and are used in almost all activities of human life. Consequently measuring and evaluating the quality of a software product has become a critical task for many companies. Several…

Software Engineering · Computer Science 2014-12-10 Jose P. Miguel , David Mauricio , Glen Rodriguez