English
Related papers

Related papers: A Taxonomy of Error Sources in HPC I/O Machine Lea…

200 papers

We present a taxonomy of research on Machine Learning (ML) applied to enhance simulations together with a catalog of some activities. We cover eight patterns for the link of ML to the simulations or systems plus three algorithmic areas:…

Machine Learning · Computer Science 2019-10-15 Geoffrey Fox , Shantenu Jha

LLMs trained in the understanding of programming syntax are now providing effective assistance to developers and are being used in programming education such as in generation of coding problem examples or providing code explanations. A key…

Artificial Intelligence · Computer Science 2024-11-19 Yanggyu Lee , Suchae Jeong , Jihie Kim

Training data plays an essential role in modern applications of machine learning. However, gathering labeled training data is time-consuming. Therefore, labeling is often outsourced to less experienced users, or completely automated. This…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Alex Bäuerle , Heiko Neumann , Timo Ropinski

With the rapid advancements of deep learning in the past decade, it can be foreseen that deep learning will be continuously deployed in more and more safety-critical applications such as autonomous driving and robotics. In this context,…

Hardware Architecture · Computer Science 2022-04-06 Cheng Liu , Zhen Gao , Siting Liu , Xuefei Ning , Huawei Li , Xiaowei Li

High Performance Distributed Computing is essential to boost scientific progress in many areas of science and to efficiently deploy a number of complex scientific applications. These applications have different characteristics that require…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-04 Mariza Ferro , Antonio R. Mury , Laion F. Manfroi , Bruno Schlze

Powerful detectors at modern experimental facilities routinely collect data at multiple GB/s. Online analysis methods are needed to enable the collection of only interesting subsets of such massive data streams, such as by explicitly…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Rafael Vescovi , Ryan Chard , Nickolaus Saint , Ben Blaiszik , Jim Pruyne , Tekin Bicer , Alex Lavens , Zhengchun Liu , Michael E. Papka , Suresh Narayanan , Nicholas Schwarz , Kyle Chard , Ian Foster

The software engineering field has a long history of classifying software failure causes. Understanding them is paramount for fault injection, focusing testing efforts or reliability prediction. Since software fails in manifold complex…

Software Engineering · Computer Science 2016-03-15 Lena Feinbube , Peter Tröger , Andreas Polze

Resource allocation in High Performance Computing (HPC) settings is still not easy for end-users due to the wide variety of application and environment configuration options. Users have difficulties to estimate the number of processors and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-10 Eduardo R. Rodrigues , Renato L. F. Cunha , Marco A. S. Netto , Michael Spriggs

Containers, enabling lightweight environment and performance isolation, fast and flexible deployment, and fine-grained resource sharing, have gained popularity in better application management and deployment in addition to hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-06 Maria A. Rodriguez , Rajkumar Buyya

Reliability is a fundamental challenge in operating large-scale machine learning (ML) infrastructures, particularly as the scale of ML models and training clusters continues to grow. Despite decades of research on infrastructure failures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Apostolos Kokolis , Michael Kuchnik , John Hoffman , Adithya Kumar , Parth Malani , Faye Ma , Zachary DeVito , Shubho Sengupta , Kalyan Saladi , Carole-Jean Wu

The capabilities of Large Language Models (LLMs) in code generation have been extensively studied, particularly for implementing target functionalities from natural-language descriptions. Alternatively, input-output (I/O) examples provide…

Software Engineering · Computer Science 2025-05-13 Yingjie Fu , Bozhou Li , Linyi Li , Wentao Zhang , Tao Xie

Machine learning has been applied to network traffic classification (TC) for over two decades. While early efforts used shallow models, the latter 2010s saw a shift toward complex neural networks, often reporting near-perfect accuracy.…

Machine Learning · Computer Science 2025-06-11 Kamil Jerabek , Jan Luxemburk , Richard Plny , Josef Koumar , Jaroslav Pesek , Karel Hynek

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

Following continuous software engineering practices, there has been an increasing interest in rapid deployment of machine learning (ML) features, called MLOps. In this paper, we study the importance of MLOps in the context of data…

Software Engineering · Computer Science 2021-03-17 Sasu Mäkinen , Henrik Skogström , Eero Laaksonen , Tommi Mikkonen

This paper presents a taxonomy that allows defining the fault tolerance regimes fail-operational, fail-degraded, and fail-safe in the context of automotive systems. Fault tolerance regimes such as these are widely used in recent…

Systems and Control · Electrical Eng. & Systems 2022-07-13 Torben Stolte , Stefan Ackermann , Robert Graubohm , Inga Jatzkowski , Björn Klamann , Hermann Winner , Markus Maurer

This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict expected tactical descriptions of operational solutions (TDOSs). The…

Machine Learning · Computer Science 2022-06-10 Eric Larsen , Sébastien Lachapelle , Yoshua Bengio , Emma Frejinger , Simon Lacoste-Julien , Andrea Lodi

We describe lessons learned from developing and deploying machine learning models at scale across the enterprise in a range of financial analytics applications. These lessons are presented in the form of antipatterns. Just as design…

IT systems of today are becoming larger and more complex, rendering their human supervision more difficult. Artificial Intelligence for IT Operations (AIOps) has been proposed to tackle modern IT administration challenges thanks to AI and…

Computers and Society · Computer Science 2020-12-17 Paolo Notaro , Jorge Cardoso , Michael Gerndt

As IoT systems are given more responsibility and autonomy, they offer greater benefits, but also carry greater risks. We believe this trend invigorates an old challenge of software engineering: how to develop high-risk software-intensive…

Software Engineering · Computer Science 2022-09-20 Dharun Anandayuvaraj , James C. Davis

Agentic AI systems combine LLM-based reasoning, orchestration, tool invocation, and interaction with external environments. These systems introduce faults that are difficult to characterize using existing taxonomies. To address this gap, we…

Software Engineering · Computer Science 2026-05-08 Mehil B Shah , Mohammad Mehdi Morovati , Mohammad Masudur Rahman , Foutse Khomh