English
Related papers

Related papers: Auto-Validate by-History: Auto-Program Data Qualit…

200 papers

Currently, many verification algorithms are available to improve the reliability of software systems. Selecting the appropriate verification algorithm typically demands domain expertise and non-trivial manpower. An automated algorithm…

Software Engineering · Computer Science 2025-05-26 Jie Su , Liansai Deng , Cheng Wen , Rong Wang , Zhi Ma , Nan Zhang , Cong Tian , Zhenhua Duan , Shengchao Qin

Integrating changes into large monolithic software repositories is a critical step in modern software development that substantially impacts the speed of feature delivery, the stability of the codebase, and the overall productivity of…

Software Engineering · Computer Science 2025-08-13 Maximilian Jungwirth , Martin Gruber , Gordon Fraser

This study proposes a framework for the automated hyperparameter optimization of a bearing fault detection pipeline for permanent magnet synchronous motors (PMSMs) without the need of external sensors. A automated machine learning (AutoML)…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Tobias Wagner , Alexander Gepperth , Elmar Engels

Automated machine learning (AutoML) aims for constructing machine learning (ML) pipelines automatically. Many studies have investigated efficient methods for algorithm selection and hyperparameter optimization. However, methods for ML…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Tien-Dung Nguyen , Marco F. Huber

VQ (Vendor Qualification) and IOQ (Installation and Operation Qualification) audits are implemented in warehouses to ensure all equipment being turned over in the fulfillment network meets the quality standards. Audit checks are likely to…

Machine Learning · Computer Science 2022-09-30 Farouq Halawa , Majid Abdul , Raashid Mohammed

Software organizations are increasingly incorporating machine learning (ML) into their product offerings, driving a need for new data management tools. Many of these tools facilitate the initial development of ML applications, but…

Software Engineering · Computer Science 2022-07-19 Shreya Shankar , Aditya Parameswaran

Data quality is fundamental to modern data science workflows, where data continuously flows as unbounded streams feeding critical downstream tasks, from elementary analytics to advanced artificial intelligence models. Existing data quality…

Databases · Computer Science 2025-06-09 Vasileios Papastergios , Anastasios Gounaris

This paper investigates various factors that influence the performance of end-to-end deep learning approaches for historical writer identification (HWI), a task that remains challenging due to the diversity of handwriting styles, document…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hanif Rasyidi , Moshiur Farazi

We study the AutoML problem of automatically configuring machine learning pipelines by jointly selecting algorithms and their appropriate hyper-parameters for all steps in supervised learning pipelines. This black-box (gradient-free)…

In regulated domains such as finance, the integrity and governance of data pipelines are critical - yet existing systems treat data quality control (QC) as an isolated preprocessing step rather than a first-class system component. We…

Computational Finance · Quantitative Finance 2025-12-08 Devender Saini , Bhavika Jain , Nitish Ujjwal , Philip Sommer , Dan Romuald Mbanga , Dhagash Mehta

Poor data quality limits the advantageous power of Machine Learning (ML) and weakens high-performing ML software systems. Nowadays, data are more prone to the risk of poor quality due to their increasing volume and complexity. Therefore,…

Machine Learning · Computer Science 2025-02-20 Manal Rahal , Bestoun S. Ahmed , Gergely Szabados , Torgny Fornstedt , Jorgen Samuelsson

Traditional data quality control methods are based on users experience or previously established business rules, and this limits performance in addition to being a very time consuming process with lower than desirable accuracy. Utilizing…

Artificial Intelligence · Computer Science 2018-10-17 Wei Dai , Kenji Yoshigoe , William Parsley

Current AI-assisted engineering workflows lack a built-in mechanism to maintain task-level verification and regulatory traceability at machine-speed delivery. Agile V addresses this gap by embedding independent verification and audit…

Software Engineering · Computer Science 2026-02-25 Christopher Koch , Joshua Andreas Wellbrock

Background. Due to the widespread adoption of Artificial Intelligence (AI) and Machine Learning (ML) for building software applications, companies are struggling to recruit employees with a deep understanding of such technologies. In this…

Software Engineering · Computer Science 2025-01-24 Fabio Calefato , Luigi Quaranta , Filippo Lanubile , Marcos Kalinowski

In order to achieve state-of-the-art performance, modern machine learning techniques require careful data pre-processing and hyperparameter tuning. Moreover, given the ever increasing number of machine learning models being developed, model…

Machine Learning · Statistics 2018-05-03 Nicolo Fusi , Rishit Sheth , Huseyn Melih Elibol

Machine learning interatomic potentials (MLIPs) have become powerful tools to extend molecular simulations beyond the limits of quantum methods, offering near-quantum accuracy at much lower computational cost. Yet, developing reliable MLIPs…

Materials Science · Physics 2025-12-30 Adam Lahouari , Jutta Rogal , Mark E. Tuckerman

As more and more automatic vehicles, power consumption prediction becomes a vital issue for task scheduling and energy management. Most research focuses on automatic vehicles in transportation, but few focus on automatic ground vehicles…

Machine Learning · Computer Science 2025-01-22 Jia-Hao Syu , Jerry Chun-Wei Lin , Philip S. Yu

Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached…

Machine Learning · Computer Science 2019-05-27 Iddo Drori , Yamuna Krishnamurthy , Raoni Lourenco , Remi Rampin , Kyunghyun Cho , Claudio Silva , Juliana Freire

The next-generation autonomous vehicles (AVs), embedded with frequent real-time decision-making, will rely heavily on a large volume of multisource and multimodal data. In real-world settings, the data quality (DQ) of different sources and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yuhan Zhou , Haihua Chen , Kewei Sha

Enterprise data lakes often suffer from substantial amounts of duplicate and redundant data, with data volumes ranging from terabytes to petabytes. This leads to both increased storage costs and unnecessarily high maintenance costs for…