English
Related papers

Related papers: Mitigating Long-Tailed Anomaly Score Distributions…

200 papers

We propose a supervised anomaly detection method based on neural density estimators, where the negative log likelihood is used for the anomaly score. Density estimators have been widely used for unsupervised anomaly detection. By the recent…

Machine Learning · Statistics 2019-04-15 Tomoharu Iwata , Yuki Yamanaka

Imbalanced regression occurs when continuous target variables have skewed distributions, creating sparse regions that are difficult for machine learning models to predict accurately. This issue particularly affects neural networks, which…

Machine Learning · Computer Science 2025-04-22 Shayan Alahyari , Mike Domaratzki

The success of deep learning depends on large-scale and well-curated training data, while data in real-world applications are commonly long-tailed and noisy. Many methods have been proposed to deal with long-tailed data or noisy data, while…

Machine Learning · Computer Science 2023-05-30 Lefan Zhang , Zhang-Hao Tian , Wujun Zhou , Wei Wang

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

Graph-level anomaly detection aims to identify anomalous graphs or subgraphs within graph datasets, playing a vital role in various fields such as fraud detection, review classification, and biochemistry. While Graph Neural Networks (GNNs)…

Machine Learning · Computer Science 2025-10-10 Liting Li , Yumeng Wang , Yueheng Sun

Current state-of-the-art anomaly detection (AD) methods exploit the powerful representations yielded by large-scale ImageNet training. However, catastrophic forgetting prevents the successful fine-tuning of pre-trained representations on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Oliver Rippel , Arnav Chavan , Chucai Lei , Dorit Merhof

In image anomaly detection, Autoencoders are the popular methods that reconstruct the input image that might contain anomalies and output a clean image with no abnormalities. These Autoencoder-based methods usually calculate the anomaly…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Masaki Nakanishi , Kazuki Sato , Hideo Terada

Reconstruction-based approaches to anomaly detection tend to fall short when applied to complex datasets with target classes that possess high inter-class variance. Similar to the idea of self-taught learning used in transfer learning, many…

Machine Learning · Computer Science 2021-11-16 Muhammad S. Battikh , Artem A. Lenskiy

Adaptive optimization methods (such as Adam) play a major role in LLM pretraining, significantly outperforming Gradient Descent (GD). Recent studies have proposed new smoothness assumptions on the loss function to explain the advantages of…

Machine Learning · Computer Science 2025-12-02 Robin Yadav , Shuo Xie , Tianhao Wang , Zhiyuan Li

Generalized Category Discovery (GCD) utilizes labeled samples of known classes to discover novel classes in unlabeled samples. Existing methods show effective performance on artificial datasets with balanced distributions. However,…

Artificial Intelligence · Computer Science 2025-07-31 Cuong Manh Hoang

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

Machine Learning · Computer Science 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

Real-world data often exhibits a long-tailed distribution, in which head classes occupy most of the data, while tail classes only have very few samples. Models trained on long-tailed datasets have poor adaptability to tail classes and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Qiong Chen , Tianlin Huang , Geren Zhu , Enlu Lin

Anomaly detection is a critical task in industrial manufacturing, aiming to identify defective parts of products. Most industrial anomaly detection methods assume the availability of sufficient normal data for training. This assumption may…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhenyu Yan , Qingqing Fang , Wenxi Lv , Qinliang Su

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

Sound · Computer Science 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

Real-world datasets usually are class-imbalanced and corrupted by label noise. To solve the joint issue of long-tailed distribution and label noise, most previous works usually aim to design a noise detector to distinguish the noisy and…

Machine Learning · Computer Science 2024-04-11 Zhuo Li , He Zhao , Zhen Li , Tongliang Liu , Dandan Guo , Xiang Wan

Loss reweighting is a widely used strategy for long-tailed classification, but existing reweighting strategies often rely on heuristics and rarely define a well-specified target. Inspired by Neural Collapse (NC), the ideal simplex…

Machine Learning · Computer Science 2026-05-12 Jinping Wang , Zixin Tong , Zhiwu Xie , Zhiqiang Gao

Anomaly detection (AD) plays an important role in numerous applications. We focus on two understudied aspects of AD that are critical for integration into real-world applications. First, most AD methods cannot incorporate labeled data that…

Machine Learning · Computer Science 2023-06-06 Chun-Hao Chang , Jinsung Yoon , Sercan Arik , Madeleine Udell , Tomas Pfister

Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned representations enable anomaly detection as the normality model is trained to capture certain key…

Machine Learning · Computer Science 2022-07-05 Feng Xue , Weizhong Yan

Anomaly detection techniques enable effective anomaly detection and diagnosis in multi-variate time series data, which are of major significance for today's industrial applications. However, establishing an anomaly detection system that can…

Machine Learning · Computer Science 2024-05-02 Lingrui Yu

Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Mingle Xu , Jaehwan Lee , Sook Yoon , Dong Sun Park