English
Related papers

Related papers: Detecting Anomalies in Machine Learning Infrastruc…

200 papers

Automated Machine Learning (AutoML) significantly simplifies the deployment of machine learning models by automating tasks from data preprocessing to model selection to ensembling. AutoML systems for tabular data often employ post hoc…

Machine Learning · Computer Science 2024-08-06 Jannis Maier , Felix Möller , Lennart Purucker

Modern time-domain surveys continuously monitor large swaths of the sky to look for astronomical variability. Astrophysical discovery in such data sets is complicated by the fact that detections of real transient and variable sources are…

Instrumentation and Methods for Astrophysics · Physics 2015-06-11 Henrik Brink , Joseph W. Richards , Dovi Poznanski , Joshua S. Bloom , John Rice , Sahand Negahban , Martin Wainwright

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical…

Machine Learning · Computer Science 2023-11-01 Nadun Wijesinghe , Hadi Hemmati

Machine learning (ML) algorithms can often differ in performance across domains. Understanding $\textit{why}$ their performance differs is crucial for determining what types of interventions (e.g., algorithmic or operational) are most…

Machine Learning · Computer Science 2024-02-23 Jean Feng , Harvineet Singh , Fan Xia , Adarsh Subbaswamy , Alexej Gossmann

Machine learning workflow development is a process of trial-and-error: developers iterate on workflows by testing out small modifications until the desired accuracy is achieved. Unfortunately, existing machine learning systems focus…

Databases · Computer Science 2018-12-17 Doris Xin , Stephen Macke , Litian Ma , Jialin Liu , Shuchen Song , Aditya Parameswaran

Large unlabeled data and difficult-to-identify anomalies are the urgent issues need to overcome in most industrial scene. In order to address this issue, a new meth-odology for detecting surface defects in in-dustrial settings is…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Junzhuo Chen , Shitong Kang

This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables…

Machine Learning · Computer Science 2025-01-29 Nimesh Jha , Shuxin Lin , Srideepika Jayaraman , Kyle Frohling , Christodoulos Constantinides , Dhaval Patel

High Energy Physics (HEP) distributed computing infrastructures require automatic tools to monitor, analyze and react to potential security incidents. These tools should collect and inspect data such as resource consumption, logs and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-14 A. Gomez Ramirez , M. Martinez Pedreira , C. Grigoras , L. Betev , C. Lara , U. Kebschull

The Internet of Underwater Things (IoUT) is becoming a critical infrastructure for ocean observation, marine resource management, and climate science. Its development is hindered by severe acoustic attenuation, propagation delays far…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Kenechi Omeke , Attai Abubakar , Michael Mollel , Lei Zhang , Qammer H. Abbasi , Muhammad Ali Imran

Insider threat detection aims to identify malicious user behavior by analyzing logs that record user interactions. Due to the lack of fine-grained behavior-level annotations, detecting specific behavior-level anomalies within user behavior…

Cryptography and Security · Computer Science 2025-08-18 Yang Wang , Yaxin Zhao , Xinyu Jiao , Sihan Xu , Xiangrui Cai , Ying Zhang , Xiaojie Yuan

Robust network security systems are essential to prevent and mitigate the harming effects of the ever-growing occurrence of network attacks. In recent years, machine learning-based systems have gain popularity for network security…

Cryptography and Security · Computer Science 2020-03-26 Gonzalo Marín , Pedro Casas , Germán Capdehourat

Training large-scale distributed machine learning models imposes considerable demands on network infrastructure, often resulting in sudden traffic spikes that lead to congestion, increased latency, and reduced throughput, which would…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-23 Yisu Wang , Xinjiao Li , Ruilong Wu , Huangxun Chen , Dirk Kutscher

The rapid scaling of large language models (LLMs) has unveiled critical limitations in current hardware architectures, including constraints in memory capacity, computational efficiency, and interconnection bandwidth. DeepSeek-V3, trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Chenggang Zhao , Chengqi Deng , Chong Ruan , Damai Dai , Huazuo Gao , Jiashi Li , Liyue Zhang , Panpan Huang , Shangyan Zhou , Shirong Ma , Wenfeng Liang , Ying He , Yuqing Wang , Yuxuan Liu , Y. X. Wei

We study the problem of distributed training of neural networks (NNs) on devices with heterogeneous, limited, and time-varying availability of computational resources. We present an adaptive, resource-aware, on-device learning mechanism,…

Machine Learning · Computer Science 2022-04-05 Martin Rapp , Ramin Khalili , Kilian Pfeiffer , Jörg Henkel

Detecting anomalies over real-world datasets remains a challenging task. Data annotation is an intensive human labor problem, particularly in sequential datasets, where the start and end time of anomalies are not known. As a result, data…

Machine Learning · Computer Science 2022-10-05 Parastoo Kamranfar , David Lattanzi , Amarda Shehu , Daniel Barbará

Neural networks have become dominant computational workloads across cloud and edge platforms, but their rapid growth in model size and deployment diversity has exposed hardware bottlenecks increasingly dominated by memory movement,…

Systems and Control · Electrical Eng. & Systems 2026-01-16 Bin Xu , Ayan Banerjee , Sandeep Gupta

Anomaly detection is critical in the smart industry for preventing equipment failure, reducing downtime, and improving safety. Internet of Things (IoT) has enabled the collection of large volumes of data from industrial machinery, providing…

Automated Machine Learning (AutoML) is used more than ever before to support users in determining efficient hyperparameters, neural architectures, or even full machine learning pipelines. However, users tend to mistrust the optimization…

Machine Learning · Computer Science 2022-07-12 René Sass , Eddie Bergman , André Biedenkapp , Frank Hutter , Marius Lindauer

The rapidly evolving cloud platforms and the escalating complexity of network traffic demand proper network traffic monitoring and anomaly detection to ensure network security and performance. This paper introduces a large language model…

Networking and Internet Architecture · Computer Science 2025-04-28 Ze Yang , Yihong Jin , Juntian Liu , Xinhe Xu , Yihan Zhang , Shuyang Ji