English
Related papers

Related papers: Anomaly Detection in Big Data

200 papers

Anomaly detection, a critical facet in data analysis, involves identifying patterns that deviate from expected behavior. This research addresses the complexities inherent in anomaly detection, exploring challenges and adapting to…

Machine Learning · Computer Science 2024-05-07 Aditya Singh , Pavan Reddy

Sharing of telecommunication network data, for example, even at high aggregation levels, is nowadays highly restricted due to privacy legislation and regulations and other important ethical concerns. It leads to scattering data across…

Machine Learning · Computer Science 2022-05-18 Paula Raissa Silva , João Vinagre , João Gama

Hacking and false data injection from adversaries can threaten power grids' everyday operations and cause significant economic loss. Anomaly detection in power grids aims to detect and discriminate anomalies caused by cyber attacks against…

Machine Learning · Computer Science 2023-03-14 Xijuan Sun , Di Wu , Arnaud Zinflou , Benoit Boulet

Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or…

Machine Learning · Computer Science 2020-07-30 Andrea Borghesi , Andrea Bartolini , Michele Lombardi , Michela Milano , Luca Benini

Anomaly detection is the process of identifying abnormal instances or events in data sets which deviate from the norm significantly. In this study, we propose a signatures based machine learning algorithm to detect rare or unexpected items…

Computational Finance · Quantitative Finance 2022-02-09 Erdinc Akyildirim , Matteo Gambara , Josef Teichmann , Syang Zhou

There is a growing need for machine learning-based anomaly detection strategies to broaden the search for Beyond-the-Standard-Model (BSM) physics at the Large Hadron Collider (LHC) and elsewhere. The first step of any anomaly detection…

High Energy Physics - Phenomenology · Physics 2023-01-18 Gregor Kasieczka , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , Mariel Pettee , David Shih

Much of the world's data is streaming, time-series data, where anomalies give significant information in critical situations; examples abound in domains such as finance, IT, security, medical, and energy. Yet detecting anomalies in…

Artificial Intelligence · Computer Science 2016-11-17 Alexander Lavin , Subutai Ahmad

With the widely used smart meters in the energy sector, anomaly detection becomes a crucial mean to study the unusual consumption behaviors of customers, and to discover unexpected events of using energy promptly. Detecting consumption…

Databases · Computer Science 2016-06-21 Xiufeng Liu , Per Sieverts Nielsen

Anomalies are occurrences in a dataset that are in some way unusual and do not fit the general patterns. The concept of the anomaly is typically ill-defined and perceived as vague and domain-dependent. Moreover, despite some 250 years of…

Databases · Computer Science 2023-05-30 Ralph Foorthuis

Automated detection of abnormalities in data has been studied in research area in recent years because of its diverse applications in practice including video surveillance, industrial damage detection and network intrusion detection.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Hung Vu , Dinh Phung , Tu Dinh Nguyen , Anthony Trevors , Svetha Venkatesh

The sophistication and diversity of contemporary cyberattacks have rendered the use of proxies, gateways, firewalls, and encrypted tunnels as a standalone defensive strategy inadequate. Consequently, the proactive identification of data…

Machine Learning · Computer Science 2024-09-24 Liyang Wang , Yu Cheng , Hao Gong , Jiacheng Hu , Xirui Tang , Iris Li

Most current anomaly detection methods suffer from the curse of dimensionality when dealing with high-dimensional data. We propose an anomaly detection algorithm that can scale to high-dimensional data using concepts from the theory of…

Machine Learning · Computer Science 2021-09-29 Sreelekha Guggilam , Varun Chandola , Abani Patra

Anomaly detection is a longstanding and active research area that has many applications in domains such as finance, security, and manufacturing. However, the efficiency and performance of anomaly detection algorithms are challenged by the…

Machine Learning · Computer Science 2025-04-16 Yang Cao , Haolong Xiang , Hang Zhang , Ye Zhu , Kai Ming Ting

Anomaly event detection is crucial for critical infrastructure security(transportation system, social-ecological sector, insurance service, government sector etc.) due to its ability to reveal and address the potential cyber-threats in…

Social and Information Networks · Computer Science 2021-04-20 Yipeng Ji , Jingyi Wang , Shaoning Li , Yangyang Li , Shenwen Lin , Xiong Li

Anomalies are cases that are in some way unusual and do not appear to fit the general patterns present in the dataset. Several conceptualizations exist to distinguish between different types of anomalies. However, these are either too…

Machine Learning · Computer Science 2021-07-06 Ralph Foorthuis

An important task in network analysis is the detection of anomalous events in a network time series. These events could merely be times of interest in the network timeline or they could be examples of malicious activity or network…

Machine Learning · Computer Science 2016-08-03 Timothy La Fond , Jennifer Neville , Brian Gallagher

Anomaly detection aims to detect data that do not conform to regular patterns, and such data is also called outliers. The anomalies to be detected are often tiny in proportion, containing crucial information, and are suitable for…

Machine Learning · Computer Science 2023-06-06 Fan Xu , Nan Wang , Xibin Zhao

Detecting the anomaly behaviors such as network failure or Internet intentional attack in the large-scale Internet is a vital but challenging task. While numerous techniques have been developed based on Internet traffic in past years,…

Networking and Internet Architecture · Computer Science 2017-10-18 Jinfa Wang , Siyuan Jia , Hai Zhao , Jiuqiang Xu , Chuan Lin

Anomaly detection is defined as the problem of finding data points that do not follow the patterns of the majority. Among the various proposed methods for solving this problem, classification-based methods, including one-class Support…

Optimization and Control · Mathematics 2023-12-05 Amir Hossein Noormohammadia , Seyed Ali MirHassania , Farnaz Hooshmand Khaligh

Ever growing volume and velocity of data coupled with decreasing attention span of end users underscore the critical need for real-time analytics. In this regard, anomaly detection plays a key role as an application as well as a means to…

Machine Learning · Statistics 2017-10-16 Dhruv Choudhary , Arun Kejariwal , Francois Orsini