English
Related papers

Related papers: Attention and Autoencoder Hybrid Model for Unsuper…

200 papers

We seek to enable classic processing of continuous ultra-sparse spatiotemporal data generated by event-based sensors with dense machine learning models. We propose a novel hybrid pipeline composed of asynchronous sensing and synchronous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Carmen Martin-Turrero , Maxence Bouvier , Manuel Breitenstein , Pietro Zanuttigh , Vincent Parret

Unsupervised Anomaly Detection has become a popular method to detect pathologies in medical images as it does not require supervision or labels for training. Most commonly, the anomaly detection model generates a "normal" version of an…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Felix Meissen , Johannes Paetzold , Georgios Kaissis , Daniel Rueckert

This paper presents an anomaly detection model that combines the strong statistical foundation of density-estimation-based anomaly detection methods with the representation-learning ability of deep-learning models. The method combines an…

Machine Learning · Computer Science 2022-11-17 Joseph Gallego-Mejia , Oscar Bustos-Brinez , Fabio A. González

As the number of heterogenous IP-connected devices and traffic volume increase, so does the potential for security breaches. The undetected exploitation of these breaches can bring severe cybersecurity and privacy risks. Anomaly-based…

Machine Learning · Computer Science 2022-12-15 Willian T. Lunardi , Martin Andreoni Lopez , Jean-Pierre Giacalone

Hacking and false data injection from adversaries can threaten power grids' everyday operations and cause significant economic loss. Anomaly detection in power grids aims to detect and discriminate anomalies caused by cyber attacks against…

Machine Learning · Computer Science 2023-03-14 Xijuan Sun , Di Wu , Arnaud Zinflou , Benoit Boulet

A visual hard attention model actively selects and observes a sequence of subregions in an image to make a prediction. The majority of hard attention models determine the attention-worthy regions by first analyzing a complete image.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Samrudhdhi B. Rangrej , James J. Clark

Precision beekeeping allows to monitor bees' living conditions by equipping beehives with sensors. The data recorded by these hives can be analyzed by machine learning models to learn behavioral patterns of or search for unusual events in…

Machine Learning · Computer Science 2020-03-11 Padraig Davidson , Michael Steininger , Florian Lautenschlager , Konstantin Kobs , Anna Krause , Andreas Hotho

In this paper, we deploy the self-attention mechanism to achieve improved channel estimation for orthogonal frequency-division multiplexing waveforms in the downlink. Specifically, we propose a new hybrid encoder-decoder structure (called…

Signal Processing · Electrical Eng. & Systems 2022-04-29 Dianxin Luan , John Thompson

On-line detection of anomalies in time series is a key technique used in various event-sensitive scenarios such as robotic system monitoring, smart sensor networks and data center security. However, the increasing diversity of data sources…

Machine Learning · Computer Science 2021-04-26 Wentai Wu , Ligang He , Weiwei Lin , Yi Su , Yuhua Cui , Carsten Maple , Stephen Jarvis

Recently, with the development of deep learning, end-to-end neural network architectures have been increasingly applied to condition monitoring signals. They have demonstrated superior performance for fault detection and classification, in…

Machine Learning · Computer Science 2021-07-01 Oliver Ammann , Gabriel Michau , Olga Fink

Auditory attention decoding (AAD) is the process of identifying the attended speech in a multi-talker environment using brain signals, typically recorded through electroencephalography (EEG). Over the past decade, AAD has undergone…

Sound · Computer Science 2025-07-08 Nhan Duc Thanh Nguyen , Huy Phan , Simon Geirnaert , Kaare Mikkelsen , Preben Kidmose

Advanced Persistent Threats (APTs) pose a significant challenge in cybersecurity due to their stealthy and long-term nature. Modern supervised learning methods require extensive labeled data, which is often scarce in real-world…

Machine Learning · Computer Science 2025-11-26 Sidahmed Benabderrahmane , James Cheney , Talal Rahwan

Due to the rare occurrence of anomalous events, a typical approach to anomaly detection is to train an autoencoder (AE) with normal data only so that it learns the patterns or representations of the normal training data. At test time, the…

Machine Learning · Computer Science 2024-05-20 Marcella Astrid , Muhammad Zaigham Zaheer , Djamila Aouada , Seung-Ik Lee

Road accident can be triggered by wet road because it decreases skid resistance. To prevent the road accident, detecting road surface abnomality is highly useful. In this paper, we propose the deep learning based cost-effective real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 YeongHyeon Park , JongHee Jung

A common belief in designing deep autoencoders (AEs), a type of unsupervised neural network, is that a bottleneck is required to prevent learning the identity function. Learning the identity function renders the AEs useless for anomaly…

Machine Learning · Computer Science 2022-02-28 Bang Xiang Yong , Alexandra Brintrup

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based auto encoders have shown great potential in detecting anomalies in medical images. However, state-of-the-art…

Machine Learning · Computer Science 2018-12-17 David Zimmerer , Simon A. A. Kohl , Jens Petersen , Fabian Isensee , Klaus H. Maier-Hein

Unsupervised anomaly detection (UAD) aims to find anomalous images by optimising a detector using a training set that contains only normal images. UAD approaches can be based on reconstruction methods, self-supervised approaches, and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Yu Tian , Guansong Pang , Yuyuan Liu , Chong Wang , Yuanhong Chen , Fengbei Liu , Rajvinder Singh , Johan W Verjans , Mengyu Wang , Gustavo Carneiro

Variational autoencoders are widely used for unsupervised anomaly detection. Model selection however remains an open-question: to remain fully unsupervised, hyperparameters are often chosen to minimize the reconstruction error on normal…

Machine Learning · Computer Science 2026-05-06 Agathe Senellart , Maëlys Solal , Stéphanie Allassonnière , Ninon Burgos

Anomaly detection is a common analytical task that aims to identify rare cases that differ from the typical cases that make up the majority of a dataset. When applied to the analysis of event sequence data, the task of anomaly detection can…

Human-Computer Interaction · Computer Science 2020-04-16 Shunan Guo , Zhuochen Jin , Qing Chen , David Gotz , Hongyuan Zha , Nan Cao

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

Machine Learning · Computer Science 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li