English
Related papers

Related papers: PipeSim: Trace-driven Simulation of Large-Scale AI…

200 papers

Automated Machine Learning (AutoML) has been used successfully in settings where the learning task is assumed to be static. In many real-world scenarios, however, the data distribution will evolve over time, and it is yet to be shown…

Machine Learning · Computer Science 2022-12-08 Bilge Celik , Prabhant Singh , Joaquin Vanschoren

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

This paper introduces CAAI, a novel cognitive architecture for artificial intelligence in cyber-physical production systems. The goal of the architecture is to reduce the implementation effort for the usage of artificial intelligence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-15 Andreas Fischbach , Jan Strohschein , Andreas Bunte , Jörg Stork , Heide Faeskorn-Woyke , Natalia Moriz , Thomas Bartz-Beielstein

The rapid expansion of artificial intelligence and machine learning (ML) applications has intensified the demand for integrated environments that unify model development, deployment, and monitoring. Traditional Integrated Development…

Software Engineering · Computer Science 2025-11-04 Jiawei Jin , Yingxin Su , Xiaotong Zhu

The rapidly growing demand for high-quality data in Large Language Models (LLMs) has intensified the need for scalable, reliable, and semantically rich data preparation pipelines. However, current practices remain dominated by ad-hoc…

The increasing prominence of AI necessitates the deployment of inference platforms for efficient and effective management of AI pipelines and compute resources. As these pipelines grow in complexity, the demand for distributed serving rises…

Networking and Internet Architecture · Computer Science 2025-02-25 Mike Wong , Ulysses Butler , Emma Farkash , Praveen Tammana , Anirudh Sivaraman , Ravi Netravali

We introduce DataCI, a comprehensive open-source platform designed specifically for data-centric AI in dynamic streaming data settings. DataCI provides 1) an infrastructure with rich APIs for seamless streaming dataset management,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-04 Huaizheng Zhang , Yizheng Huang , Yuanming Li

HPC is an enabling platform for AI. The introduction of AI workloads in the HPC applications basket has non-trivial consequences both on the way of designing AI applications and on the way of providing HPC computing. This is the leitmotif…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-03 Iacopo Colonnelli , Barbara Cantalupo , Concetto Spampinato , Matteo Pennisi , Marco Aldinucci

Trace clustering has been extensively used to preprocess event logs. By grouping similar behavior, these techniques guide the identification of sub-logs, producing more understandable models and conformance analytics. Nevertheless, little…

Machine Learning · Computer Science 2021-09-03 Sylvio Barbon , Paolo Ceravolo , Ernesto Damiani , Gabriel Marques Tavares

Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supercomputers and AI training and inference tasks on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-04 Logan Ward , J. Gregory Pauloski , Valerie Hayot-Sasson , Ryan Chard , Yadu Babuji , Ganesh Sivaraman , Sutanay Choudhury , Kyle Chard , Rajeev Thakur , Ian Foster

GraphFlow is a visual workflow system designed to improve the reliability of agentic AI automation in multi-step, mission-critical processes. In these workflows, small errors compound rapidly: under an idealized model of independent steps,…

Artificial Intelligence · Computer Science 2026-05-15 Drewry H. Morris , Luis Valles , Reza Hosseini Ghomi

Sustainability and efficiency have become essential considerations in the development and deployment of Artificial Intelligence systems, but existing regulatory practices for Green AI still lack standardized, model-agnostic evaluation…

Machine Learning · Computer Science 2026-03-19 Jorge Paz-Ruza , João Gama , Amparo Alonso-Betanzos , Bertha Guijarro-Berdiñas

Artificial intelligence pipelines -- spanning data collection, model training, deployment, and post-deployment monitoring -- concentrate ethical risks that intensify with multimodal and agentic systems. Existing governance instruments,…

Computers and Society · Computer Science 2026-03-10 Jasper Kyle Catapang

Artificial Intelligence (AI) systems are increasingly dependent on complex, multi-layered software supply chains that introduce challenges for reproducibility, transparency, and security assurance. This study presents an Artificial…

Software Engineering · Computer Science 2026-05-20 Petar Radanliev , Omar Santos , Carsten Maple , Kay Atefi

Companies dealing with Artificial Intelligence (AI) models in Autonomous Systems (AS) face several problems, such as users' lack of trust in adverse or unknown conditions, gaps between software engineering and AI model development, and…

Software Engineering · Computer Science 2021-04-26 Silverio Martínez-Fernández , Xavier Franch , Andreas Jedlitschka , Marc Oriol , Adam Trendowicz

The increasing demand for artificial intelligence (AI) workloads across diverse computing environments has driven the need for more efficient data management strategies. Traditional cloud-based architectures struggle to handle the sheer…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-03 Alex Barceló , Sebastián A. Cajas Ordoñez , Jaydeep Samanta , Andrés L. Suárez-Cetrulo , Romila Ghosh , Ricardo Simón Carbajo , Anna Queralt

In regulated domains such as finance, the integrity and governance of data pipelines are critical - yet existing systems treat data quality control (QC) as an isolated preprocessing step rather than a first-class system component. We…

Computational Finance · Quantitative Finance 2025-12-08 Devender Saini , Bhavika Jain , Nitish Ujjwal , Philip Sommer , Dan Romuald Mbanga , Dhagash Mehta

IBM Research Castor, a cloud-native system for managing and deploying large numbers of AI time-series models in IoT applications, is described. Modelling code templates, in Python and R, following a typical machine-learning workflow are…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-30 Bradley Eck , Francesco Fusco , Robert Gormally , Mark Purcell , Seshu Tirupathi

AI-enabled features built on LLMs and agentic workflows are difficult to test, debug, and reproduce, especially for product-focused software engineers without a machine learning background. We present the AI Toolkit plugin for JetBrains…

Software Engineering · Computer Science 2026-05-15 Yaroslav Sokolov , Yury Khudyakov , Lenar Sharipov , Andrei Gasparian , Parth Tiwary , Artem Trofimov

The advances in data, computing and networking over the last two decades led to a shift in many application domains that includes machine learning on big data as a part of the scientific process, requiring new capabilities for integrated…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-19 Ilkay Altintas , Kyle Marcus , Isaac Nealey , Scott L. Sellars , John Graham , Dima Mishin , Joel Polizzi , Daniel Crawl , Thomas DeFanti , Larry Smarr