English
Related papers

Related papers: Learning Dependencies in Distributed Cloud Applica…

200 papers

We develop graph-based methods for semi-supervised learning based on label propagation on a data similarity graph. When data is abundant or arrive in a stream, the problems of computation and data storage arise for any graph-based method.…

Machine Learning · Computer Science 2026-05-06 Michal Valko

As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 William Marfo , Enrique A. Rico , Deepak K. Tosh , Shirley V. Moore

Surface anomaly classification is critical for manufacturing system fault diagnosis and quality control. However, the following challenges always hinder accurate anomaly classification in practice: (i) Anomaly patterns exhibit intra-class…

Machine Learning · Statistics 2025-02-18 Xuanming Cao , Chengyu Tao , Juan Du

Many unsupervised visual anomaly detection methods train an auto-encoder to reconstruct normal samples and then leverage the reconstruction error map to detect and localize the anomalies. However, due to the powerful modeling and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Qingqing Fang , Qinliang Su , Wenxi Lv , Wenchao Xu , Jianxing Yu

Cloud systems are complex, large, and dynamic systems whose behavior must be continuously analyzed to timely detect misbehaviors and failures. Although there are solutions to flexibly monitor cloud systems, cost-effectively controlling the…

Software Engineering · Computer Science 2019-09-19 Marco Mobilio , Matteo Orrù , Oliviero Riganelli , Alessandro Tundo , Leonardo Mariani

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. Therefore, in order to have performance guarantees in unsupervised anomaly detection, priors need to be assumed on what the…

Machine Learning · Statistics 2020-04-08 Tiago Pimentel , Marianne Monteiro , Adriano Veloso , Nivio Ziviani

Clouds classification is a great challenge in meteorological research. The different types of clouds, currently known and present in our skies, can produce radioactive effects that impact on the variation of atmospheric conditions, with the…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Mario Manzo , Simone Pellino

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new…

Machine Learning · Computer Science 2019-11-21 Guansong Pang , Chunhua Shen , Anton van den Hengel

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Cloud platforms, under the hood, consist of a complex inter-connected stack of hardware and software components. Each of these components can fail which may lead to an outage. Our goal is to improve the quality of Cloud services through…

Software Engineering · Computer Science 2021-02-12 Mohammad Saiful Islam , Andriy Miranskyy

Anomaly detection is crucial for understanding unusual behaviors in data, as anomalies offer valuable insights. This paper introduces Dependency-based Anomaly Detection (DepAD), a general framework that utilizes variable dependencies to…

Machine Learning · Computer Science 2024-04-18 Sha Lu , Lin Liu , Kui Yu , Thuc Duy Le , Jixue Liu , Jiuyong Li

Workloads in modern cloud data centers are becoming increasingly complex. The number of workloads running in cloud data centers has been growing exponentially for the last few years, and cloud service providers (CSP) have been supporting…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-30 Mohammad Hossain , Derssie Mebratu , Niranjan Hasabnis , Jun Jin , Gaurav Chaudhary , Noah Shen

This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables…

Machine Learning · Computer Science 2025-01-29 Nimesh Jha , Shuxin Lin , Srideepika Jayaraman , Kyle Frohling , Christodoulos Constantinides , Dhaval Patel

This paper considers the real-time detection of anomalies in high-dimensional systems. The goal is to detect anomalies quickly and accurately so that the appropriate countermeasures could be taken in time, before the system possibly gets…

Machine Learning · Computer Science 2020-07-16 Mahsa Mozaffari , Yasin Yilmaz

Anomaly detection is fundamental yet, challenging problem with practical applications in industry. The current approaches neglect the higher-order dependencies within the networks of interconnected sensors in the high-dimensional time…

Machine Learning · Computer Science 2024-08-22 Sakhinana Sagar Srinivas , Rajat Kumar Sarkar , Venkataramana Runkana

Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that…

Machine Learning · Computer Science 2023-12-25 João B. S. Carvalho , Mengtao Zhang , Robin Geyer , Carlos Cotrini , Joachim M. Buhmann

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Within today's large-scale systems, one anomaly can impact millions of users. Detecting such events in real-time is essential to maintain the quality of services. It allows the monitoring team to prevent or diminish the impact of a failure.…

Artificial Intelligence · Computer Science 2023-04-25 Arthur Vervaet

Semi-supervised Anomaly Detection (AD) is a kind of data mining task which aims at learning features from partially-labeled datasets to help detect outliers. In this paper, we classify existing semi-supervised AD methods into two…

Machine Learning · Computer Science 2022-10-27 Chao Chen , Dawei Wang , Feng Mao , Zongzhang Zhang , Yang Yu

In this paper, Decentralized Periodic Approach for Adaptive Fault Diagnosis (DP-AFD) algorithm is proposed for fault diagnosis in distributed systems with arbitrary topology. Faulty nodes may be either unresponsive, may have either software…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-20 Latika Sarna , Sumedha Shenolikar , Poorva Kulkarni , Varsha Deshpande , Supriya Kelkar