English
Related papers

Related papers: A Survey of Pipeline Tools for Data Engineering

200 papers

In recent years, Large Language Models (LLMs) have emerged as transformative tools across numerous domains, impacting how professionals approach complex analytical tasks. This systematic mapping study comprehensively examines the…

Computers and Society · Computer Science 2025-08-19 Sai Sanjna Chintakunta , Nathalia Nascimento , Everton Guimaraes

In the last couple of years we have witnessed an enormous increase of machine learning (ML) applications. More and more program functions are no longer written in code, but learnt from a huge amount of data samples using an ML algorithm.…

Software Engineering · Computer Science 2022-09-07 Peter Kriens , Tim Verbelen

Web Data Extraction is an important problem that has been studied by means of different scientific tools and in a broad range of applications. Many approaches to extracting data from the Web have been designed to solve specific problems and…

Information Retrieval · Computer Science 2017-03-07 Emilio Ferrara , Pasquale De Meo , Giacomo Fiumara , Robert Baumgartner

The dissertation provides a comparative analysis of a number of variability tools currently in use. It serves as a catalogue for practitioners interested in the topic. We compare a range of modelling, configuring, and management tools for…

Software Engineering · Computer Science 2013-04-16 Mahendra Reddy Bhumula

Context: Research at the intersection of cybersecurity, Machine Learning (ML), and Software Engineering (SE) has recently taken significant steps in proposing countermeasures for detecting sophisticated data exfiltration attacks. It is…

Cryptography and Security · Computer Science 2021-03-23 Bushra Sabir , Faheem Ullah , M. Ali Babar , Raj Gaire

Context: Machine learning (ML)-enabled systems are being increasingly adopted by companies aiming to enhance their products and operational processes. Objective: This paper aims to deliver a comprehensive overview of the current status quo…

Data-driven modeling is an approach in energy systems modeling that has been gaining popularity. In data-driven modeling, machine learning methods such as linear regression, neural networks or decision-tree based methods are being applied.…

Machine Learning · Computer Science 2023-01-05 Sandra Wilfling

Workflow technology is rapidly evolving and, rather than being limited to modeling the control flow in business processes, is becoming a key mechanism to perform advanced data management, such as big data analytics. This survey focuses on…

Databases · Computer Science 2017-01-27 Georgia Kougka , Anastasios Gounaris , Alkis Simitsis

Developing machine learning models can be seen as a process similar to the one established for traditional software development. A key difference between the two lies in the strong dependency between the quality of a machine learning model…

Machine Learning · Computer Science 2021-02-17 Cedric Renggli , Luka Rimanic , Nezihe Merve Gürel , Bojan Karlaš , Wentao Wu , Ce Zhang

This doctoral dissertation proposes a novel approach to enhance the development of smart services for the Internet of Things (IoT) and smart Cyber-Physical Systems (CPS). The proposed approach offers abstraction and automation to the…

Software Engineering · Computer Science 2021-06-29 Armin Moin

Organizations rely on machine learning engineers (MLEs) to deploy models and maintain ML pipelines in production. Due to models' extensive reliance on fresh data, the operationalization of machine learning, or MLOps, requires MLEs to have…

Human-Computer Interaction · Computer Science 2024-03-26 Shreya Shankar , Rolando Garcia , Joseph M Hellerstein , Aditya G Parameswaran

Research on methods for planning and controlling water distribution networks gains increasing relevance as the availability of drinking water will decrease as a consequence of climate change. So far, the majority of approaches is based on…

Nowadays it is inevitable to use intelligent systems to improve the performance and optimization of different components of devices or factories. Furthermore, it's so essential to have appropriate predictions to make better decisions in…

Artificial Intelligence · Computer Science 2021-01-01 Ashkan Yousefi Zadeh , Meysam Shahbazy

Even though machine learning (ML) pipelines affect an increasing array of stakeholders, there is little work on how input from stakeholders is recorded and incorporated. We propose FeedbackLogs, addenda to existing documentation of ML…

Human-Computer Interaction · Computer Science 2023-07-31 Matthew Barker , Emma Kallina , Dhananjay Ashok , Katherine M. Collins , Ashley Casovan , Adrian Weller , Ameet Talwalkar , Valerie Chen , Umang Bhatt

The amazing advances being made in the fields of machine and deep learning are a highlight of the Big Data era for both enterprise and research communities. Modern applications require resources beyond a single node's ability to provide.…

Exploiting the recent advancements in artificial intelligence, showcased by ChatGPT and DALL-E, in real-world applications necessitates vast, domain-specific, and publicly accessible datasets. Unfortunately, the scarcity of such datasets…

Machine Learning · Computer Science 2023-05-17 Cyril Picard , Jürg Schiffmann , Faez Ahmed

Automated Machine Learning (AutoML) is a promising direction for democratizing AI by automatically deploying Machine Learning systems with minimal human expertise. The core technical challenge behind AutoML is optimizing the pipelines of…

Machine Learning · Computer Science 2023-05-26 Sebastian Pineda Arango , Josif Grabocka

As big data becomes ubiquitous across domains, and more and more stakeholders aspire to make the most of their data, demand for machine learning tools has spurred researchers to explore the possibilities of automated machine learning…

Recent advances in machine learning, coupled with low-cost computation, availability of cheap streaming sensors, data storage and cloud technologies, has led to widespread multi-disciplinary research activity with significant interest and…

Computational Engineering, Finance, and Science · Computer Science 2021-11-23 Indranil Pan , Lachlan Mason , Omar Matar

The rapid advancement of software development practices has introduced challenges in ensuring quality and efficiency across the software engineering (SE) lifecycle. As SE systems grow in complexity, traditional approaches often fail to…

Software Engineering · Computer Science 2025-08-04 Samah Kansab