English
Related papers

Related papers: Diminishing Empirical Risk Minimization for Unsupe…

200 papers

Semi-supervised Anomaly Detection (AD) is a kind of data mining task which aims at learning features from partially-labeled datasets to help detect outliers. In this paper, we classify existing semi-supervised AD methods into two…

Machine Learning · Computer Science 2022-10-27 Chao Chen , Dawei Wang , Feng Mao , Zongzhang Zhang , Yang Yu

Empirical risk minimization (ERM) is the workhorse of machine learning, whether for classification and regression or for off-policy policy learning, but its model-agnostic guarantees can fail when we use adaptively collected data, such as…

Machine Learning · Statistics 2021-06-04 Aurélien Bibaut , Antoine Chambaz , Maria Dimakopoulou , Nathan Kallus , Mark van der Laan

Anomaly detection in Endpoint Detection and Response (EDR) is a critical task in cybersecurity programs of large companies. With rapidly growing amounts of data and the omnipresence of zero-day attacks, manual and rule-based detection…

Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that…

Machine Learning · Computer Science 2023-12-25 João B. S. Carvalho , Mengtao Zhang , Robin Geyer , Carlos Cotrini , Joachim M. Buhmann

Existing anomaly detection paradigms overwhelmingly focus on training detection models using exclusively normal data or unlabeled data (mostly normal samples). One notorious issue with these approaches is that they are weak in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Guansong Pang , Choubo Ding , Chunhua Shen , Anton van den Hengel

Empirical Risk Minimization (ERM) is a foundational framework for supervised learning but primarily optimizes average-case performance, often neglecting fairness and robustness considerations. Tilted Empirical Risk Minimization (TERM)…

Machine Learning · Statistics 2025-09-19 Yigit E. Yildirim , Samet Demir , Zafer Dogan

Semi-supervised anomaly detection, which aims to improve the anomaly detection performance by using a small amount of labeled anomaly data in addition to unlabeled data, has attracted attention. Existing semi-supervised approaches assume…

Machine Learning · Statistics 2025-02-11 Hiroshi Takahashi , Tomoharu Iwata , Atsutoshi Kumagai , Yuuki Yamanaka

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

Domain Generalization (DG) aims to develop classifiers that can generalize to new, unseen data distributions, a critical capability when collecting new domain-specific data is impractical. A common DG baseline minimizes the empirical risk…

Machine Learning · Computer Science 2024-12-11 Piotr Teterwak , Kuniaki Saito , Theodoros Tsiligkaridis , Kate Saenko , Bryan A. Plummer

Visual defect assessment is a form of anomaly detection. This is very relevant in finding faults such as cracks and markings in various surface inspection tasks like pavement and automotive parts. The task involves detection of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Manpreet Singh Minhas , John Zelek

In order to detect unknown intrusions and runtime errors of computer programs, the cyber-security community has developed various detection techniques. Anomaly detection is an approach that is designed to profile the normal runtime behavior…

Cryptography and Security · Computer Science 2021-06-03 Byunggu Yu , Junwhan Kim

Deep neural networks (DNN) can achieve high performance when applied to In-Distribution (ID) data which come from the same distribution as the training set. When presented with anomaly inputs not from the ID, the outputs of a DNN should be…

Machine Learning · Computer Science 2021-10-08 Fangzhen Zhao , Chenyi Zhang , Naipeng Dong , Zefeng You , Zhenxin Wu

Anomaly detection in medical imaging is a challenging task in contexts where abnormalities are not annotated. This problem can be addressed through unsupervised anomaly detection (UAD) methods, which identify features that do not match with…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Geoffroy Oudoumanessah , Carole Lartizien , Michel Dojat , Florence Forbes

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

Anomaly detection (AD) plays a crucial role in time series applications, primarily because time series data is employed across real-world scenarios. Detecting anomalies poses significant challenges since anomalies take diverse forms making…

Machine Learning · Computer Science 2025-01-03 Jihan Ghanim , Mariette Awad

In real-world applications, anomaly detection (AD) often operates without access to anomalous data, necessitating semi-supervised methods that rely solely on normal data. Among these methods, deep k-nearest neighbor (deep kNN) AD stands out…

Many real-world scenarios involving streaming information can be represented as temporal graphs, where data flows through dynamic changes in edges over time. Anomaly detection in this context has the objective of identifying unusual…

Machine Learning · Computer Science 2025-12-01 Simone Mungari , Albert Bifet , Giuseppe Manco , Bernhard Pfahringer

Supervised deep learning techniques show promise in medical image analysis. However, they require comprehensive annotated data sets, which poses challenges, particularly for rare diseases. Consequently, unsupervised anomaly detection (UAD)…

Image and Video Processing · Electrical Eng. & Systems 2024-03-22 Finn Behrendt , Debayan Bhattacharya , Lennart Maack , Julia Krüger , Roland Opfer , Robin Mieling , Alexander Schlaefer

Anomaly detection has many applications ranging from bank-fraud detection and cyber-threat detection to equipment maintenance and health monitoring. However, choosing a suitable algorithm for a given application remains a challenging design…

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich