English
Related papers

Related papers: ClusterLog: Clustering Logs for Effective Log-base…

200 papers

Anomaly detection in distributed systems such as High-Performance Computing (HPC) clusters is vital for early fault detection, performance optimisation, security monitoring, reliability in general but also operational insights. Deep Neural…

Machine Learning · Computer Science 2024-05-14 Franz Kevin Stehle , Wainer Vandelli , Giuseppe Avolio , Felix Zahn , Holger Fröning

Clustering is an unsupervised machine learning methodology where unlabeled elements/objects are grouped together aiming to the construction of well-established clusters that their elements are classified according to their similarity. The…

Machine Learning · Statistics 2023-10-20 Dimitrios Saligkaras , Vasileios E. Papageorgiou

In response to the demand for higher computational power, the number of computing nodes in high performance computers (HPC) increases rapidly. Exascale HPC systems are expected to arrive by 2020. With drastic increase in the number of HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-21 Siavash Ghiasvand , Florina M. Ciorba

Anomaly detection to recognize unusual events in large scale systems in a time sensitive manner is critical in many industries, eg. bank fraud, enterprise systems, medical alerts, etc. Large-scale systems often grow in size and complexity…

Machine Learning · Computer Science 2022-10-31 Srishti Mishra , Tvarita Jain , Dinkar Sitaram

This paper presents a methodology and a system, named LogMaster, for mining correlations of events that have multiple attributions, i.e., node ID, application ID, event type, and event severity, in logs of large-scale cluster systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-18 Rui Ren , Xiaoyu Fu , Jianfeng Zhan , Wei Zhou

Logs provide first-hand information for engineers to diagnose failures in large-scale online service systems. Log parsing, which transforms semi-structured raw log messages into structured data, is a prerequisite of automated log analysis…

Software Engineering · Computer Science 2022-02-15 Yudong Liu , Xu Zhang , Shilin He , Hongyu Zhang , Liqun Li , Yu Kang , Yong Xu , Minghua Ma , Qingwei Lin , Yingnong Dang , Saravan Rajmohan , Dongmei Zhang

With rapidly increasing data, clustering algorithms are important tools for data analytics in modern research. They have been successfully applied to a wide range of domains; for instance, bioinformatics, speech recognition, and financial…

Data Structures and Algorithms · Computer Science 2015-12-01 Ka-Chun Wong

The ability to detect log anomalies from system logs is a vital activity needed to ensure cyber resiliency of systems. It is applied for fault identification or facilitate cyber investigation and digital forensics. However, as logs…

Cryptography and Security · Computer Science 2023-11-10 Jonathan Pan , Swee Liang Wong , Yidi Yuan

The increasing popularity of server usage has brought a plenty of anomaly log events, which have threatened a vast collection of machines. Recognizing and categorizing the anomalous events thereby is a much salient work for our systems,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-03 Jiechao Cheng , Rui Ren , Lei Wang , Jianfeng Zhan

Log-based anomaly detection is crucial for ensuring software system stability. However, the scarcity of labeled logs limits rapid deployment to new systems. Cross-system transfer has become an important research direction. State-of-the-art…

Software Engineering · Computer Science 2025-11-11 Xinlong Zhao , Tong Jia , Minghua He , Ying Li

Anomaly detection is an important step in the management and monitoring of data centers and cloud computing platforms. The ability to detect anomalous virtual machines before real failures occur results in reduced downtime while operations…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-08 Roman Nikiforov

Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis…

Machine Learning · Computer Science 2024-09-17 Shuzhan Wang , Ruxue Jiang , Zhaoqi Wang , Yan Zhou

Due to the wider availability of modern electronic health records, patient care data is often being stored in the form of time-series. Clustering such time-series data is crucial for patient phenotyping, anticipating patients' prognoses by…

Medical Physics · Physics 2020-06-17 Changhee Lee , Mihaela van der Schaar

Recent advances in technology have made our work easier compare to earlier times. Computer network is growing day by day but while discussing about the security of computers and networks it has always been a major concerns for organizations…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-11 Ravi Ranjan , G. Sahoo

Log data are generated from logging statements in the source code, providing insights into the execution processes of software applications and systems. State-of-the-art log-based anomaly detection approaches typically leverage deep…

Software Engineering · Computer Science 2025-03-12 Xingfang Wu , Heng Li , Foutse Khomh

Short text stream clustering is an important but challenging task since massive amount of text is generated from different sources such as micro-blogging, question-answering, and social news aggregation websites. One of the major challenges…

Information Retrieval · Computer Science 2021-01-22 Md Rashadul Hasan Rakib , Muhammad Asaduzzaman

Mining Time Series data has a tremendous growth of interest in today's world. To provide an indication various implementations are studied and summarized to identify the different problems in existing applications. Clustering time series is…

Information Retrieval · Computer Science 2010-05-25 V. Kavitha , M. Punithavalli

Fully supervised log anomaly detection methods suffer the heavy burden of annotating massive unlabeled log data. Recently, many semi-supervised methods have been proposed to reduce annotation costs with the help of parsed templates.…

Software Engineering · Computer Science 2023-04-12 Hongcheng Guo , Yuhui Guo , Renjie Chen , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Weichao Hou , Liangfan Zheng , Bo Zhang

We study anomaly clustering, grouping data into coherent clusters of anomaly types. This is different from anomaly detection that aims to divide anomalies from normal data. Unlike object-centered image clustering, anomaly clustering is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Kihyuk Sohn , Jinsung Yoon , Chun-Liang Li , Chen-Yu Lee , Tomas Pfister

Clustering multivariate time series data is a crucial task in many domains, as it enables the identification of meaningful patterns and groups in time-evolving data. Traditional approaches, such as crisp clustering, rely on the assumption…

Methodology · Statistics 2025-09-05 Ziling Ma , Ángel López-Oriona , Hernando Ombao , Ying Sun