English
Related papers

Related papers: Diminishing Empirical Risk Minimization for Unsupe…

200 papers

Reconstruction error-based neural architectures constitute a classical deep learning approach to anomaly detection which has shown great performances. It consists in training an Autoencoder to reconstruct a set of examples deemed to…

Machine Learning · Computer Science 2024-06-06 Fabrizio Angiulli , Fabio Fassetti , Luca Ferragina

Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely manner or the risk of…

Machine Learning · Computer Science 2019-04-26 Mariem Ben Fadhel , Kofi Nyarko

Differential privacy has become a cornerstone in the development of privacy-preserving learning algorithms. This work addresses optimizing differentially private kernel learning within the empirical risk minimization (ERM) framework. We…

Machine Learning · Statistics 2026-04-30 Bonwoo Lee , Cheolwoo Park , Jeongyoun Ahn

There is a significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware regression-based neural networks (NNs), based…

Machine Learning · Computer Science 2023-07-21 Nis Meinert , Jakob Gawlikowski , Alexander Lavin

Detecting anomalies in time series data is important in a variety of fields, including system monitoring, healthcare, and cybersecurity. While the abundance of available methods makes it difficult to choose the most appropriate method for a…

Machine Learning · Computer Science 2023-02-03 Ferdinand Rewicki , Joachim Denzler , Julia Niebling

The study of the dynamics of natural and artificial systems has provided several examples of deviations from Brownian behavior, generally defined as anomalous diffusion. The investigation of these dynamics can provide a better understanding…

Data Analysis, Statistics and Probability · Physics 2025-08-29 Carlo Manzo

While deep neural networks (DNNs) are used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN estimator under…

Machine Learning · Statistics 2026-03-18 Xuran Meng , Yi Li

Given a collection of feature maps indexed by a set $\mathcal{T}$, we study the performance of empirical risk minimization (ERM) on regression problems with square loss over the union of the linear classes induced by these feature maps.…

Machine Learning · Statistics 2024-11-20 Ayoub El Hanchi , Chris J. Maddison , Murat A. Erdogdu

Undetected anomalies in time series can trigger catastrophic failures in safety-critical systems, such as chemical plant explosions or power grid outages. Although many detection methods have been proposed, their performance remains unclear…

We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. This is a common scenario in many important applications. Existing related methods either exclusively…

Machine Learning · Computer Science 2021-06-11 Guansong Pang , Anton van den Hengel , Chunhua Shen , Longbing Cao

Anomaly detection aims to distinguish abnormal instances that deviate significantly from the majority of benign ones. As instances that appear in the real world are naturally connected and can be represented with graphs, graph neural…

Machine Learning · Computer Science 2023-05-24 Sheng Tian , Jihai Dong , Jintang Li , Wenlong Zhao , Xiaolong Xu , Baokun wang , Bowen Song , Changhua Meng , Tianyi Zhang , Liang Chen

The goal of anomaly detection is to identify anomalous samples from normal ones. In this paper, a small number of anomalies are assumed to be available at the training stage, but they are assumed to be collected only from several anomaly…

Machine Learning · Computer Science 2022-05-03 Bowen Tian , Qinliang Su , Jian Yin

An interesting phenomenon arises: Empirical Risk Minimization (ERM) sometimes outperforms methods specifically designed for out-of-distribution tasks. This motivates an investigation into the reasons behind such behavior beyond algorithmic…

Machine Learning · Computer Science 2026-01-21 Hong Zheng , Fei Teng

A key task in actuarial modelling involves modelling the distributional properties of losses. Classic (distributional) regression approaches like Generalized Linear Models (GLMs; Nelder and Wedderburn, 1972) are commonly used, but…

Machine Learning · Statistics 2024-06-04 Benjamin Avanzi , Eric Dong , Patrick J. Laub , Bernard Wong

It can be challenging to identify brain MRI anomalies using supervised deep-learning techniques due to anatomical heterogeneity and the requirement for pixel-level labeling. Unsupervised anomaly detection approaches provide an alternative…

Image and Video Processing · Electrical Eng. & Systems 2023-08-30 Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Many real-world monitoring and surveillance applications require non-trivial anomaly detection to be run in the streaming model. We consider an incremental-learning approach, wherein a deep-autoencoding (DAE) model of what is normal is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Albert Akhriev , Jakub Marecek

Deep learning models excel in computer vision tasks but often fail to generalize to out-of-distribution (OOD) domains. Invariant Risk Minimization (IRM) aims to address OOD generalization by learning domain-invariant features. However, IRM…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Dong Miao , Zhongliang Fu , Xu Luo

In line with the development of Industry 4.0, surface defect detection/anomaly detection becomes a topical subject in the industry field. Improving efficiency as well as saving labor costs has steadily become a matter of great concern in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Yajie Cui , Zhaoxiang Liu , Shiguo Lian

Overparametrized Deep Neural Networks (DNNs) often achieve astounding performances, but may potentially result in severe generalization error. Recently, the relation between the sharpness of the loss landscape and the generalization error…

Artificial Intelligence · Computer Science 2022-05-31 Jiawei Du , Hanshu Yan , Jiashi Feng , Joey Tianyi Zhou , Liangli Zhen , Rick Siow Mong Goh , Vincent Y. F. Tan

Unsupervised anomaly detection (AD) is critical for a wide range of practical applications, from network security to health and medical tools. Due to the diversity of problems, no single algorithm has been found to be superior for all AD…

Machine Learning · Computer Science 2023-05-18 Małgorzata Gutowska , Suzanne Little , Andrew McCarren