English
Related papers

Related papers: Masked-Token Prediction for Anomaly Detection at t…

200 papers

Anomaly detection is a crucial task in various domains. Most of the existing methods assume the normal sample data clusters around a single central prototype while the real data may consist of multiple categories or subgroups. In addition,…

Machine Learning · Statistics 2024-12-03 Zhijin Dong , Hongzhi Liu , Boyuan Ren , Weimin Xiong , Zhonghai Wu

In this work, we significantly enhance masked particle modeling (MPM), a self-supervised learning scheme for constructing highly expressive representations of unordered sets relevant to developing foundation models for high-energy physics.…

High Energy Physics - Phenomenology · Physics 2024-10-02 Matthew Leigh , Samuel Klein , François Charton , Tobias Golling , Lukas Heinrich , Michael Kagan , Inês Ochoa , Margarita Osadchy

Masked image modeling (MIM) has become a leading self-supervised learning strategy. MIMs such as Masked Autoencoder (MAE) learn strong representations by randomly masking input tokens for the encoder to process, with the decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taekyung Kim , Sanghyuk Chun , Byeongho Heo , Dongyoon Han

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

This paper introduces a novel anomaly detection framework that combines the robust statistical principles of density-estimation-based anomaly detection methods with the representation-learning capabilities of deep learning models. The…

Machine Learning · Computer Science 2024-08-15 Joseph Gallego-Mejia , Oscar Bustos-Brinez , Fabio A. González

In this paper, we show how to adapt and deploy anomaly detection algorithms based on deep autoencoders, for the unsupervised detection of new physics signatures in the extremely challenging environment of a real-time event selection system…

The main aim of the the Large Hadron Collider (LHC) experiments is to search for exotic particles with masses in the TeV range as predicted by Beyond Standard Model (BSM) theories. However, there is no hint of BSM around TeV scale so far.…

High Energy Physics - Phenomenology · Physics 2024-12-20 Nilanjana Kumar

Anomaly detection is a promising, model-agnostic strategy to find physics beyond the Standard Model. State-of-the-art machine learning methods offer impressive performance on anomaly detection tasks, but interpretability, resource, and…

High Energy Physics - Phenomenology · Physics 2024-07-12 Nathaniel Craig , Jessica N. Howard , Hancheng Li

Machine learning--based anomaly detection (AD) methods are promising tools for extending the coverage of searches for physics beyond the Standard Model (BSM). One class of AD methods that has received significant attention is resonant…

Given the lack of evidence for new particle discoveries at the Large Hadron Collider (LHC), it is critical to broaden the search program. A variety of model-independent searches have been proposed, adding sensitivity to unexpected signals.…

High Energy Physics - Phenomenology · Physics 2020-05-13 Anders Andreassen , Benjamin Nachman , David Shih

Anomaly detection on attributed networks aims at finding nodes whose patterns deviate significantly from the majority of reference nodes, which is pervasive in many applications such as network intrusion detection and social spammer…

Machine Learning · Computer Science 2020-02-13 Haoyi Fan , Fengbin Zhang , Zuoyong Li

Anomaly detection is critical for the secure and reliable operation of industrial control systems. As our reliance on such complex cyber-physical systems grows, it becomes paramount to have automated methods for detecting anomalies,…

Machine Learning · Computer Science 2024-05-10 Mayra Macas , Chunming Wu , Walter Fuertes

Contrary to the general trend of looking for new physics at energies beyond the current reach of the Large Hadron Collider (LHC), this article proposes a strategy to look for light new physics via a meticulous study of well known and…

High Energy Physics - Phenomenology · Physics 2024-10-22 Dibyashree Sengupta

Anomaly detection in wind turbines typically involves using normal behaviour models to detect faults early. However, training autoencoder models for each turbine is time-consuming and resource intensive. Thus, transfer learning becomes…

Machine Learning · Computer Science 2024-05-07 Cyriana M. A. Roelofs , Christian Gück , Stefan Faulstich

We present a novel unsupervised deep learning approach that utilizes the encoder-decoder architecture for detecting anomalies in sequential sensor data collected during industrial manufacturing. Our approach is designed not only to detect…

Many extensions of the standard model (SM) predict the existence of axion-like particles and/or dark Higgs in the sub-GeV scale. Two new sub-GeV particles, a scalar and a pseudoscalar, produced through the Higgs boson exotic decays, are…

High Energy Physics - Phenomenology · Physics 2023-03-01 Xiaocong Ai , Shih-Chieh Hsu , Ke Li , Chih-Ting Lu

The identification of anomalous events, not explained by the Standard Model of particle physics, and the possible discovery of exotic physical phenomena pose significant theoretical, experimental and computational challenges. The task will…

Quantum Physics · Physics 2025-12-23 Miranda Carou Laiño , Veronika Chobanova , Miriam Lucio Martínez

We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data. This work provides a…

High Energy Physics - Phenomenology · Physics 2024-07-12 Tobias Golling , Lukas Heinrich , Michael Kagan , Samuel Klein , Matthew Leigh , Margarita Osadchy , John Andrew Raine

With the high requirements of automation in the era of Industry 4.0, anomaly detection plays an increasingly important role in higher safety and reliability in the production and manufacturing industry. Recently, autoencoders have been…

Machine Learning · Computer Science 2021-03-09 Yiwen Liao , Alexander Bartler , Bin Yang

The top quark, being the heaviest particle of the Standard Model, is a prime candidate of where physics beyond the SM might currently hide before our eyes. There are many natural extensions of the SM that rely on top compositeness, and the…

High Energy Physics - Phenomenology · Physics 2014-04-30 Christoph Englert , Dorival Goncalves , Michael Spannowsky