English
Related papers

Related papers: Anomaly detection optimization using big data and …

200 papers

High false-positive rate is a long-standing challenge for anomaly detection algorithms, especially in high-stake applications. To identify the true anomalies, in practice, analysts or domain experts will be employed to investigate the top…

Machine Learning · Computer Science 2020-09-17 Daochen Zha , Kwei-Herng Lai , Mingyang Wan , Xia Hu

Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may…

Deep neural networks (DNN) can achieve high performance when applied to In-Distribution (ID) data which come from the same distribution as the training set. When presented with anomaly inputs not from the ID, the outputs of a DNN should be…

Machine Learning · Computer Science 2021-10-08 Fangzhen Zhao , Chenyi Zhang , Naipeng Dong , Zefeng You , Zhenxin Wu

The detection of anomalous behaviours is an emerging need in many applications, particularly in contexts where security and reliability are critical aspects. While the definition of anomaly strictly depends on the domain framework, it is…

Machine Learning · Computer Science 2022-07-11 Elisa Marcelli , Tommaso Barbariol , Gian Antonio Susto

Intrusion Detection Systems (IDS) are critical components in safeguarding 5G/6G networks from both internal and external cyber threats. While traditional IDS approaches rely heavily on signature-based methods, they struggle to detect novel…

Cryptography and Security · Computer Science 2025-12-16 Neha , Tarunpreet Bhatia

Semi-supervised Anomaly Detection (AD) is a kind of data mining task which aims at learning features from partially-labeled datasets to help detect outliers. In this paper, we classify existing semi-supervised AD methods into two…

Machine Learning · Computer Science 2022-10-27 Chao Chen , Dawei Wang , Feng Mao , Zongzhang Zhang , Yang Yu

One-class classification has been a prevailing method in building deep anomaly detection models under the assumption that a dataset consisting of normal samples is available. In practice, however, abnormal samples are often mixed in a…

Machine Learning · Computer Science 2023-02-14 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

It is widely recognized that deep neural networks are sensitive to bias in the data. This means that during training these models are likely to learn spurious correlations between data and labels, resulting in limited generalization…

Machine Learning · Computer Science 2024-12-06 Vito Paolo Pastore , Massimiliano Ciranni , Davide Marinelli , Francesca Odone , Vittorio Murino

With the increase in the learning capability of deep convolution-based architectures, various applications of such models have been proposed over time. In the field of anomaly detection, improvements in deep learning opened new prospects of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jin-Ha Lee , Marcella Astrid , Muhammad Zaigham Zaheer , Seung-Ik Lee

Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting…

Machine Learning · Statistics 2024-09-16 Tian-Yi Zhou , Matthew Lau , Jizhou Chen , Wenke Lee , Xiaoming Huo

Intrusion detection systems (IDSs) built on artificial intelligence (AI) are presented as latent mechanisms for actively detecting fresh attacks over a complex network. Although review papers are used the systematic review or simple methods…

Cryptography and Security · Computer Science 2023-08-14 Ziadoon K. Maseer , Robiah Yusof , Baidaa Al-Bander , Abdu Saif , Qusay Kanaan Kadhim

Unsupervised Deep Learning (DL) techniques have been widely used in various security-related anomaly detection applications, owing to the great promise of being able to detect unforeseen threats and superior performance provided by Deep…

Cryptography and Security · Computer Science 2021-09-24 Dongqi Han , Zhiliang Wang , Wenqi Chen , Ying Zhong , Su Wang , Han Zhang , Jiahai Yang , Xingang Shi , Xia Yin

The widespread usage of the Internet of Things (IoT) has raised the risks of cyber threats, thus developing Anomaly Detection Systems (ADSs) that can adapt to evolving or new attacks is critical. Previous studies primarily focused on…

Machine Learning · Computer Science 2025-07-03 Yachao Yuan , Yu Huang , Jin Wang

Time series anomaly detection (TSAD) is an important data mining task with numerous applications in the IoT era. In recent years, a large number of deep neural network-based methods have been proposed, demonstrating significantly better…

Machine Learning · Computer Science 2022-08-04 Wenkai Li , Cheng Feng , Ting Chen , Jun Zhu

Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or…

Machine Learning · Computer Science 2020-07-30 Andrea Borghesi , Andrea Bartolini , Michele Lombardi , Michela Milano , Luca Benini

An application of software known as an Intrusion Detection System (IDS) employs machine algorithms to identify network intrusions. Selective logging, safeguarding privacy, reputation-based defense against numerous attacks, and dynamic…

Cryptography and Security · Computer Science 2025-06-24 Muhammad Zawad Mahmud , Samiha Islam , Shahran Rahman Alve , Al Jubayer Pial

Through continuous observation and modeling of normal behavior in networks, Anomaly-based Network Intrusion Detection System (A-NIDS) offers a way to find possible threats via deviation from the normal model. The analysis of network traffic…

Networking and Internet Architecture · Computer Science 2019-06-13 Nguyen Thanh Van , Tran Ngoc Thinh , Le Thanh Sach

Most deep anomaly detection models are based on learning normality from datasets due to the difficulty of defining abnormality by its diverse and inconsistent nature. Therefore, it has been a common practice to learn normality under the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Jongmin Yu , Junsik Kim , Tae-Hyun Oh , Jun Kyun Choi

The rapid expansion of varied network systems, including the Internet of Things (IoT) and Industrial Internet of Things (IIoT), has led to an increasing range of cyber threats. Ensuring robust protection against these threats necessitates…

Cryptography and Security · Computer Science 2024-03-19 Md. Ashraf Uddin , Sunil Aryal , Mohamed Reda Bouadjenek , Muna Al-Hawawreh , Md. Alamin Talukder

In anomaly detection, a prominent task is to induce a model to identify anomalies learned solely based on normal data. Generally, one is interested in finding an anomaly detector that correctly identifies anomalies, i.e., data points that…

Machine Learning · Computer Science 2022-11-28 David Schubert , Pritha Gupta , Marcel Wever