English
Related papers

Related papers: Feature Selection for Fault Detection and Predicti…

200 papers

Effective anomaly detection from logs is crucial for enhancing cybersecurity defenses by enabling the early identification of threats. Despite advances in anomaly detection, existing systems often fall short in areas such as post-detection…

Cryptography and Security · Computer Science 2025-04-04 Zhuoran Tan , Qiyuan Wang , Christos Anagnostopoulos , Shameem P. Parambath , Jeremy Singer , Sam Temple

Anomaly detection is concerned with identifying data patterns that deviate remarkably from the expected behaviour. This is an important research problem, due to its broad set of application domains, from data analysis to e-health,…

Machine Learning · Computer Science 2021-08-23 L. Erhan , M. Ndubuaku , M. Di Mauro , W. Song , M. Chen , G. Fortino , O. Bagdasar , A. Liotta

Log data store event execution patterns that correspond to underlying workflows of systems or applications. While most logs are informative, log data also include artifacts that indicate failures or incidents. Accordingly, log data are…

Machine Learning · Computer Science 2024-09-06 Max Landauer , Florian Skopik , Markus Wurzenberger

Automated detection of abnormalities in data has been studied in research area in recent years because of its diverse applications in practice including video surveillance, industrial damage detection and network intrusion detection.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Hung Vu , Dinh Phung , Tu Dinh Nguyen , Anthony Trevors , Svetha Venkatesh

In response to the demand for higher computational power, the number of computing nodes in high performance computers (HPC) increases rapidly. Exascale HPC systems are expected to arrive by 2020. With drastic increase in the number of HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-21 Siavash Ghiasvand , Florina M. Ciorba

With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many state-of-the-art…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-20 Chris Egersdoerfer , Dong Dai , Di Zhang

There is a growing need for machine learning-based anomaly detection strategies to broaden the search for Beyond-the-Standard-Model (BSM) physics at the Large Hadron Collider (LHC) and elsewhere. The first step of any anomaly detection…

High Energy Physics - Phenomenology · Physics 2023-01-18 Gregor Kasieczka , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , Mariel Pettee , David Shih

Software logs record system activities, aiding maintainers in identifying the underlying causes for failures and enabling prompt mitigation actions. However, maintainers need to inspect a large volume of daily logs to identify the anomalous…

Software Engineering · Computer Science 2023-08-16 Yintong Huo , Cheryl Lee , Yuxin Su , Shiwen Shan , Jinyang Liu , Michael R. Lyu

We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes one process at a time and obtains a noisy binary indicator of whether or not the…

Machine Learning · Computer Science 2021-05-14 Geethu Joseph , M. Cenk Gursoy , Pramod K. Varshney

In this era of big data, databases are growing rapidly in terms of the number of records. Fast automatic detection of anomalous records in these massive databases is a challenging task. Traditional distance based anomaly detectors are not…

Machine Learning · Computer Science 2019-09-30 Sunil Aryal , Arbind Agrahari Baniya , KC Santosh

Event datasets in the financial domain are often constructed based on actual application scenarios, and their event types are weakly reusable due to scenario constraints; at the same time, the massive and diverse new financial big data…

Machine Learning · Computer Science 2023-02-17 Dianyue Gu , Zixu Li , Zhenhai Guan , Rui Zhang , Lan Huang

While variable selection is essential to optimize the learning complexity by prioritizing features, automating the selection process is preferred since it requires laborious efforts with intensive analysis otherwise. However, it is not an…

Machine Learning · Computer Science 2019-10-29 Makiya Nakashima , Alex Sim , Youngsoo Kim , Jonghyun Kim , Jinoh Kim

Condition monitoring is one of the routine tasks in all major process industries. The mechanical parts such as a motor, gear, bearings are the major components of a process industry and any fault in them may cause a total shutdown of the…

Machine Learning · Computer Science 2018-10-23 Mohendra Roy , Sumon Kumar Bose , Bapi Kar , Pradeep Kumar Gopalakrishnan , Arindam Basu

Software systems often record important runtime information in system logs for troubleshooting purposes. There have been many studies that use log data to construct machine learning models for detecting system anomalies. Through our…

Software Engineering · Computer Science 2021-09-01 Van-Hoang Le , Hongyu Zhang

As the IT industry advances, system log data becomes increasingly crucial. Many computer systems rely on log texts for management due to restricted access to source code. The need for log anomaly detection is growing, especially in…

Machine Learning · Computer Science 2023-11-10 Gunho No , Yukyung Lee , Hyeongwon Kang , Pilsung Kang

Time series anomaly detection has been recognized as of critical importance for the reliable and efficient operation of real-world systems. Many anomaly detection methods have been developed based on various assumptions on anomaly…

Machine Learning · Computer Science 2022-07-28 Jiuqi Elise Zhang , Di Wu , Benoit Boulet

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

The reliability of cloud platforms is of significant relevance because society increasingly relies on complex software systems running on the cloud. To improve it, cloud providers are automating various maintenance tasks, with failure…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Li Wu , Jorge Cardoso , Odej Kao

Outlier, or anomaly, detection is essential for optimal performance of machine learning methods and statistical predictive models. It is not just a technical step in a data cleaning process but a key topic in many fields such as fraudulent…

Machine Learning · Computer Science 2020-02-19 O. Ramos Terrades , A. Berenguel , D. Gil

Log-system is an important mechanism for recording the runtime status and events of Web service systems, and anomaly detection in logs is an effective method of detecting problems. However, manual anomaly detection in logs is inefficient,…

Machine Learning · Computer Science 2024-11-26 Jiawei Lu , Chengrong Wu