English
Related papers

Related papers: LogLAB: Attention-Based Labeling of Log Data Anoma…

200 papers

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

Detecting anomalies in discrete event logs is critical for ensuring system reliability, security, and efficiency. Traditional window-based methods for log anomaly detection often suffer from context bias and fuzzy localization, which hinder…

Software Engineering · Computer Science 2025-01-22 Jiaxing Qi , Chang Zeng , Zhongzhi Luan , Shaohan Huang , Shu Yang , Yao Lu , Hailong Yang , Depei Qian

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the…

Software Engineering · Computer Science 2021-10-06 Yongzheng Xie , Hongyu Zhang , Bo Zhang , Muhammad Ali Babar , Sha Lu

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang

Software systems often record important runtime information in system logs for troubleshooting purposes. There have been many studies that use log data to construct machine learning models for detecting system anomalies. Through our…

Software Engineering · Computer Science 2021-09-01 Van-Hoang Le , Hongyu Zhang

Labeled data are critical to modern machine learning applications, but obtaining labels can be expensive. To mitigate this cost, machine learning methods, such as transfer learning, semi-supervised learning and active learning, aim to be…

High-quality data is crucial for the success of machine learning, but labeling large datasets is often a time-consuming and costly process. While semi-supervised learning can help mitigate the need for labeled data, label quality remains an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Lars Schmarje , Vasco Grossmann , Tim Michels , Jakob Nazarenus , Monty Santarossa , Claudius Zelenka , Reinhard Koch

Labeling data (e.g., labeling the people, objects, actions and scene in images) comprehensively and efficiently is a widely needed but challenging task. Numerous models were proposed to label various data and many approaches were designed…

Machine Learning · Computer Science 2020-02-14 Mu Yuan , Lan Zhang , Xiang-Yang Li , Hui Xiong

Unlabelled data appear in many domains and are particularly relevant to streaming applications, where even though data is abundant, labelled data is rare. To address the learning problems associated with such data, one can ignore the…

Machine Learning · Computer Science 2021-06-18 Heitor Murilo Gomes , Maciej Grzenda , Rodrigo Mello , Jesse Read , Minh Huong Le Nguyen , Albert Bifet

Curation of large fully supervised datasets has become one of the major roadblocks for machine learning. Weak supervision provides an alternative to supervised learning by training with cheap, noisy, and possibly correlated labeling…

Machine Learning · Computer Science 2021-06-01 Chidubem Arachie , Bert Huang

Effective alert diagnosis is essential for ensuring the reliability of large-scale online service systems. However, on-call engineers are often burdened with manually inspecting massive volumes of logs to identify root causes. While various…

Software Engineering · Computer Science 2025-10-01 Zhihan Jiang , Jinyang Liu , Yichen Li , Haiyu Huang , Xiao He , Tieying Zhang , Jianjun Chen , Yi Li , Rui Shi , Michael R. Lyu

Log analysis is one of the main techniques engineers use to troubleshoot faults of large-scale software systems. During the past decades, many log analysis approaches have been proposed to detect system anomalies reflected by logs. They…

Software Engineering · Computer Science 2022-09-19 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Semi-supervised anomaly detection, which aims to improve the anomaly detection performance by using a small amount of labeled anomaly data in addition to unlabeled data, has attracted attention. Existing semi-supervised approaches assume…

Machine Learning · Statistics 2025-02-11 Hiroshi Takahashi , Tomoharu Iwata , Atsutoshi Kumagai , Yuuki Yamanaka

The availability of labelled data is one of the main limitations in machine learning. We can alleviate this using weak supervision: a framework that uses expert-defined rules $\boldsymbol{\lambda}$ to estimate probabilistic labels…

Machine Learning · Computer Science 2021-05-03 Samantha Biegel , Rafah El-Khatib , Luiz Otavio Vilas Boas Oliveira , Max Baak , Nanne Aben

Anomaly detection is an important task for complex systems (e.g., industrial facilities, manufacturing, large-scale science experiments), where failures in a sub-system can lead to low yield, faulty products, or even damage to components.…

Machine Learning · Computer Science 2023-09-06 Ryan Humble , Zhe Zhang , Finn O'Shea , Eric Darve , Daniel Ratner

Scarcity of labeled data is a bottleneck for supervised learning models. A paradigm that has evolved for dealing with this problem is data programming. An existing data programming paradigm allows human supervision to be provided as a set…

Machine Learning · Computer Science 2019-11-25 Oishik Chatterjee , Ganesh Ramakrishnan , Sunita Sarawagi

Logs have been an imperative resource to ensure the reliability and continuity of many software systems, especially large-scale distributed systems. They faithfully record runtime information to facilitate system troubleshooting and…

Software Engineering · Computer Science 2022-01-12 Zhuangbin Chen , Jinyang Liu , Wenwei Gu , Yuxin Su , Michael R. Lyu

This article introduces a novel method for detecting anomalies within log data from control system nodes at the European XFEL accelerator. Effective anomaly detection is crucial for providing operators with a clear understanding of each…

Cryptography and Security · Computer Science 2025-09-26 Antonin Sulc , Annika Eichler , Tim Wilksen

In the past decade, deep neural networks have achieved significant progress in point cloud learning. However, collecting large-scale precisely-annotated training data is extremely laborious and expensive, which hinders the scalability of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Aoran Xiao , Xiaoqin Zhang , Ling Shao , Shijian Lu

Deep learning has proven effective for various application tasks, but its applicability is limited by the reliance on annotated examples. Self-supervised learning has emerged as a promising direction to alleviate the supervision bottleneck,…

Machine Learning · Computer Science 2021-07-28 Hoifung Poon , Hai Wang , Hunter Lang