English
Related papers

Related papers: SystemDS: A Declarative Machine Learning System fo…

200 papers

Increasing availability of machine learning (ML) frameworks and tools, as well as their promise to improve solutions to data-driven decision problems, has resulted in popularity of using ML techniques in software systems. However,…

Software Engineering · Computer Science 2021-03-29 Grace A. Lewis , Stephany Bellomo , Ipek Ozkaya

Context: The software development industry is rapidly adopting machine learning for transitioning modern day software systems towards highly intelligent and self-learning systems. However, the full potential of machine learning for…

Software Engineering · Computer Science 2021-10-18 Saad Shafiq , Atif Mashkoor , Christoph Mayr-Dorn , Alexander Egyed

Recent advances in large language models (LLMs) have enabled a new class of AI agents that automate multiple stages of the data science workflow by integrating planning, tool use, and multimodal reasoning across text, code, tables, and…

This paper introduces a novel end-to-end framework that efficiently integrates data quality assessment with machine learning (ML) model operations in real-time production environments. While existing approaches treat data quality assessment…

Machine Learning · Computer Science 2025-12-24 Firas Bayram , Bestoun S. Ahmed , Erik Hallin

The development and deployment of machine learning (ML) systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope creep and misaligned…

Machine learning has evolved into an enabling technology for a wide range of highly successful applications. The potential for this success to continue and accelerate has placed machine learning (ML) at the top of research, economic and…

Machine Learning · Computer Science 2019-05-13 Rob Ashmore , Radu Calinescu , Colin Paterson

The rise of Big Data has led to new demands for Machine Learning (ML) systems to learn complex models with millions to billions of parameters, that promise adequate capacity to digest massive datasets and offer powerful predictive analytics…

Machine Learning · Statistics 2016-01-01 Eric P. Xing , Qirong Ho , Pengtao Xie , Wei Dai

Machine learning (ML) - based software systems are rapidly gaining adoption across various domains, making it increasingly essential to ensure they perform as intended. This report presents best practices for the Test and Evaluation (T&E)…

Software Engineering · Computer Science 2023-10-11 Jaganmohan Chandrasekaran , Tyler Cody , Nicola McCarthy , Erin Lanus , Laura Freeman

Modern distributed data processing systems struggle to balance performance, maintainability, and developer productivity when integrating machine learning at scale. These challenges intensify in large collaborative environments due to high…

The life cycle of machine learning (ML) applications consists of two stages: model development and model deployment. However, traditional ML systems (e.g., training-specific or inference-specific systems) focus on one particular stage or…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-09 Cheng-Wei Ching , Boyuan Guan , Hailu Xu , Liting Hu

Datasets play a central role in the training and evaluation of machine learning (ML) models. But they are also the root cause of many undesired model behaviors, such as biased predictions. To overcome this situation, the ML community is…

Machine Learning · Computer Science 2024-01-23 Joan Giner-Miguelez , Abel Gómez , Jordi Cabot

Machine Learning (ML), particularly deep learning, has seen vast advancements, leading to the rise of Machine Learning-Enabled Systems (MLS). However, numerous software engineering challenges persist in propelling these MLS into production,…

Software Engineering · Computer Science 2023-08-22 Shubham Kulkarni , Arya Marda , Karthik Vaidhyanathan

Modern software systems increasingly integrate machine learning (ML) due to its advancements and ability to enhance data-driven decision-making. However, this integration introduces significant challenges for software engineering,…

Software Engineering · Computer Science 2025-11-03 Luz-Viviana Cobaleda , Julián Carvajal , Paola Vallejo , Andrés López , Raúl Mazo

Background:Technical systems are growing in complexity with more components and functions across various disciplines. Model-Driven Engineering (MDE) helps manage this complexity by using models as key artifacts. Domain-Specific Languages…

Software Engineering · Computer Science 2025-01-13 Simon Raedler , Luca Berardinelli , Karolin Winter , Abbas Rahimi , Stefanie Rinderle-Ma

[Context] The increasing adoption of machine learning (ML) in software systems demands specialized ideation approaches that address ML-specific challenges, including data dependencies, technical feasibility, and alignment between business…

Software Engineering · Computer Science 2025-06-26 Silvio Alonso , Antonio Pedro Santos Alves , Lucas Romao , Hélio Lopes , Marcos Kalinowski

We recently proposed a new cluster operating system stack, DBOS, centered on a DBMS. DBOS enables unique support for ML applications by encapsulating ML code within stored procedures, centralizing ancillary ML data, providing security built…

Cryptography and Security · Computer Science 2022-08-11 Robert Redmond , Nathan W. Weckwerth , Brian S. Xia , Qian Li , Peter Kraft , Deeptaanshu Kumar , Çağatay Demiralp , Michael Stonebraker

It has been a long time that computer architecture and systems are optimized for efficient execution of machine learning (ML) models. Now, it is time to reconsider the relationship between ML and systems, and let ML transform the way that…

Machine Learning · Computer Science 2022-02-25 Nan Wu , Yuan Xie

Reproducibility remains a central challenge in machine learning (ML), especially in collaborative eScience projects where teams iterate over data, features, and models. Current ML workflows are often dynamic yet fragmented, relying on…

Machine Learning · Computer Science 2025-06-23 Zhiwei Li , Carl Kesselman , Tran Huy Nguyen , Benjamin Yixing Xu , Kyle Bolo , Kimberley Yu

Most research using machine learning (ML) for network intrusion detection systems (NIDS) uses well-established datasets such as KDD-CUP99, NSL-KDD, UNSW-NB15, and CICIDS-2017. In this context, the possibilities of machine learning…

The popularity of data science as a discipline and its importance in the emerging economy and industrial progress dictate that machine learning be democratized for the masses. This also means that the current practice of workforce training…

Machine Learning · Computer Science 2024-05-28 Hasan M Jamil