English
Related papers

Related papers: Anomaly Detection in OKTA Logs using Autoencoders

200 papers

The current practice of manually processing features for high-dimensional and heterogeneous aviation data is labor-intensive, does not scale well to new problems, and is prone to information loss, affecting the effectiveness and…

Machine Learning · Computer Science 2020-11-10 Liya Wang , Panta Lucic , Keith Campbell , Craig Wanke

Existing Log Anomaly Detection (LogAD) methods are often slow, dependent on error-prone parsing, and use unrealistic evaluation protocols. We introduce $K^4$, an unsupervised and parser-independent framework for high-performance online…

Machine Learning · Computer Science 2026-05-12 Weicong Chen , Vikash Singh , Zahra Rahmani , Debargha Ganguly , Mohsen Hariri , Vipin Chaudhary

Software log analysis can be laborious and time consuming. Time and labeled data are usually lacking in industrial settings. This paper studies unsupervised and time efficient methods for anomaly detection. We study two custom and two…

Software Engineering · Computer Science 2024-09-23 Jesse Nyyssölä , Mika Mäntylä

Secure and reliable data communication in optical networks is critical for high-speed internet. We propose a data driven approach for the anomaly detection and faults identification in optical networks to diagnose physical attacks such as…

Cryptography and Security · Computer Science 2022-02-25 Khouloud Abdelli , Joo Yeon Cho , Carsten Tropschug

Detecting anomalies in discrete event logs is critical for ensuring system reliability, security, and efficiency. Traditional window-based methods for log anomaly detection often suffer from context bias and fuzzy localization, which hinder…

Software Engineering · Computer Science 2025-01-22 Jiaxing Qi , Chang Zeng , Zhongzhi Luan , Shaohan Huang , Shu Yang , Yao Lu , Hailong Yang , Depei Qian

Advanced Persistent Threats (APTs) are among the most challenging cyberattacks to detect. They are carried out by highly skilled attackers who carefully study their targets and operate in a stealthy, long-term manner. Because APTs exhibit…

At the crossway of machine learning and data analysis, anomaly detection aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Methodology · Statistics 2025-06-06 Romain Valla , Pavlo Mozharovskyi , Florence d'Alché-Buc

An autoencoder is a specific type of a neural network, which is mainly designed to encode the input into a compressed and meaningful representation, and then decode it back such that the reconstructed input is similar as possible to the…

Machine Learning · Computer Science 2021-04-06 Dor Bank , Noam Koenigstein , Raja Giryes

A stable, reliable, and controllable orbit lock system is crucial to an electron (or ion) accelerator because the beam orbit and beam energy instability strongly affect the quality of the beam delivered to experimental halls. Currently,…

Machine Learning · Computer Science 2024-01-30 Zhiyuan Chen , Wei Lu , Radhika Bhong , Yimin Hu , Brian Freeman , Adam Carpenter

Anomaly detection through employing machine learning techniques has emerged as a novel powerful tool in the search for new physics beyond the Standard Model. Historically similar to the development of jet observables, theoretical…

High Energy Physics - Phenomenology · Physics 2022-08-02 Oliver Atkinson , Akanksha Bhardwaj , Christoph Englert , Partha Konar , Vishal S. Ngairangbam , Michael Spannowsky

Fully supervised log anomaly detection methods suffer the heavy burden of annotating massive unlabeled log data. Recently, many semi-supervised methods have been proposed to reduce annotation costs with the help of parsed templates.…

Software Engineering · Computer Science 2023-04-12 Hongcheng Guo , Yuhui Guo , Renjie Chen , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Weichao Hou , Liangfan Zheng , Bo Zhang

In this paper, we show how to adapt and deploy anomaly detection algorithms based on deep autoencoders, for the unsupervised detection of new physics signatures in the extremely challenging environment of a real-time event selection system…

NetFlow data is a popular network log format used by many network analysts and researchers. The advantages of using NetFlow over deep packet inspection are that it is easier to collect and process, and it is less privacy intrusive. Many…

Machine Learning · Computer Science 2025-01-09 Clinton Cao , Annibale Panichella , Sicco Verwer , Agathe Blaise , Filippo Rebecchi

Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. As log lines record events during the execution of IT services, they are a primary source for diagnostics. Thereby, unsupervised…

Machine Learning · Computer Science 2021-09-21 Thorsten Wittkopp , Alexander Acker , Sasho Nedelkoski , Jasmin Bogatinovski , Dominik Scheinert , Wu Fan , Odej Kao

In this article, we will look at autoencoders. This article covers the mathematics and the fundamental concepts of autoencoders. We will discuss what they are, what the limitations are, the typical use cases, and we will look at some…

Machine Learning · Computer Science 2022-01-12 Umberto Michelucci

Log anomaly detection has become a common practice for software engineers to analyze software system behavior. Despite significant research efforts in log anomaly detection over the past decade, it remains unclear what are practitioners'…

Software Engineering · Computer Science 2024-12-03 Xiaoxue Ma , Yishu Li , Jacky Keung , Xiao Yu , Huiqi Zou , Zhen Yang , Federica Sarro , Earl T. Barr

This study explores the application of autoencoder-based machine learning techniques for anomaly detection to identify exoplanet atmospheres with unconventional chemical signatures using a low-dimensional data representation. We use the…

Earth and Planetary Astrophysics · Physics 2026-01-06 Alexander Roman , Emilie Panek , Roy T. Forestano , Eyup B. Unlu , Katia Matcheva , Konstantin T. Matchev

Log analysis is one of the main techniques engineers use to troubleshoot faults of large-scale software systems. During the past decades, many log analysis approaches have been proposed to detect system anomalies reflected by logs. They…

Software Engineering · Computer Science 2022-09-19 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Many autonomous systems, such as driverless taxis, perform safety critical functions. Autonomous systems employ artificial intelligence (AI) techniques, specifically for the environment perception. Engineers cannot completely test or…

Artificial Intelligence · Computer Science 2021-11-02 Andreas Rausch , Azarmidokht Motamedi Sedeh , Meng Zhang

Complex networks have now become integral parts of modern information infrastructures. This paper proposes a user-centric method for detecting anomalies in heterogeneous information networks, in which nodes and/or edges might be from…

Social and Information Networks · Computer Science 2018-10-22 Vahid Ranjbar , Mostafa Salehi , Pegah Jandaghi , Mahdi Jalili