English
Related papers

Related papers: LogSD: Detecting Anomalies from System Logs throug…

200 papers

Semi-supervised anomaly detection methods leverage a few anomaly examples to yield drastically improved performance compared to unsupervised models. However, they still suffer from two limitations: 1) unlabeled anomalies (i.e., anomaly…

Machine Learning · Computer Science 2023-07-26 Hongzuo Xu , Yijie Wang , Guansong Pang , Songlei Jian , Ning Liu , Yongjun Wang

Log-system is an important mechanism for recording the runtime status and events of Web service systems, and anomaly detection in logs is an effective method of detecting problems. However, manual anomaly detection in logs is inefficient,…

Machine Learning · Computer Science 2024-11-26 Jiawei Lu , Chengrong Wu

As the IT industry advances, system log data becomes increasingly crucial. Many computer systems rely on log texts for management due to restricted access to source code. The need for log anomaly detection is growing, especially in…

Machine Learning · Computer Science 2023-11-10 Gunho No , Yukyung Lee , Hyeongwon Kang , Pilsung Kang

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in…

Machine Learning · Computer Science 2023-07-10 Ling Chen , Chaodu Song , Xu Wang , Dachao Fu , Feifei Li

Anomaly detection is crucial for ensuring the stability and reliability of web service systems. Logs and metrics contain multiple information that can reflect the system's operational state and potential anomalies. Thus, existing anomaly…

Software Engineering · Computer Science 2025-01-29 Xixuan Yang , Xin Huang , Chiming Duan , Tong Jia , Shandong Dong , Ying Li , Gang Huang

Recently, anomaly detection and localization in multimedia data have received significant attention among the machine learning community. In real-world applications such as medical diagnosis and industrial defect detection, anomalies only…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Chaoqin Huang , Qinwei Xu , Yanfeng Wang , Yu Wang , Ya Zhang

Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by…

Software Engineering · Computer Science 2024-08-20 Zanis Ali Khan , Donghwan Shin , Domenico Bianculli , Lionel Briand

Logs are semi-structured text files that represent software's execution paths and states during its run-time. Therefore, detecting anomalies in software logs reflect anomalies in the software's execution path or state. So, it has become a…

Software Engineering · Computer Science 2024-08-06 Shayan Hashemi , Mika Mäntylä

Unsupervised anomaly detection aims to build models to effectively detect unseen anomalies by only training on the normal data. Although previous reconstruction-based methods have made fruitful progress, their generalization ability is…

Machine Learning · Computer Science 2022-01-04 Yuxin Zhang , Jindong Wang , Yiqiang Chen , Han Yu , Tao Qin

Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical…

Machine Learning · Computer Science 2023-11-01 Nadun Wijesinghe , Hadi Hemmati

Anomaly detection (AD) is a critical task across domains such as cybersecurity and healthcare. In the unsupervised setting, an effective and theoretically-grounded principle is to train classifiers to distinguish normal data from…

Machine Learning · Statistics 2025-06-18 Matthew Lau , Tian-Yi Zhou , Xiangchi Yuan , Jizhou Chen , Wenke Lee , Xiaoming Huo

Detecting system anomalies based on log data is important for ensuring the security and reliability of computer systems. Recently, deep learning models have been widely used for log anomaly detection. The core idea is to model the log…

Machine Learning · Computer Science 2023-12-12 Xiao Han , Shuhan Yuan , Mohamed Trabelsi

Numerous Deep Learning (DL)-based approaches have gained attention in software Log Anomaly Detection (LAD), yet class imbalance in training data remains a challenge, with anomalies often comprising less than 1% of datasets like Thunderbird.…

Software Engineering · Computer Science 2024-10-31 Xiaoxue Ma , Huiqi Zou , Pinjia He , Jacky Keung , Yishu Li , Xiao Yu , Federica Sarro

Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may…

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

Log-based anomaly detection is a essential task for ensuring the reliability and performance of software systems. However, the performance of existing anomaly detection methods heavily relies on labeling, while labeling a large volume of…

Machine Learning · Computer Science 2025-10-10 Chiming Duan , Minghua He , Pei Xiao , Tong Jia , Xin Zhang , Zhewei Zhong , Xiang Luo , Yan Niu , Lingzhe Zhang , Yifan Wu , Siyu Yu , Weijie Hong , Ying Li , Gang Huang

Mining information from logs is an old and still active research topic. In recent years, with the rapid emerging of cloud computing, log mining becomes increasingly important to industry. This paper focus on one major mission of log mining:…

Machine Learning · Computer Science 2011-09-09 Nan Wang , Jizhong Han , Jinyun Fang

Logs are an essential source of information for people to understand the running status of a software system. Due to the evolving modern software architecture and maintenance methods, more research efforts have been devoted to automated log…

Software Engineering · Computer Science 2024-04-09 Xingfang Wu , Heng Li , Foutse Khomh

Deep anomaly detection models using a supervised mode of learning usually work under a closed set assumption and suffer from overfitting to previously seen rare anomalies at training, which hinders their applicability in a real scenario. In…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Behzad Bozorgtabar , Dwarikanath Mahapatra , Guillaume Vray , Jean-Philippe Thiran

Anomaly detection or more generally outliers detection is one of the most popular and challenging subject in theoretical and applied machine learning. The main challenge is that in general we have access to very few labeled data or no…

Machine Learning · Computer Science 2023-05-31 Mansour Zoubeirou A Mayaki , Michel Riveill