English
Related papers

Related papers: Memory-Distilled Selection for Noise-Robust Anomal…

200 papers

With the wide application of knowledge distillation between an ImageNet pre-trained teacher model and a learnable student model, unsupervised anomaly detection has witnessed a significant achievement in the past few years. The success of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Canhui Tang , Sanping Zhou , Yizhe Li , Yonghao Dong , Le Wang

Unsupervised anomaly detection is a challenging computer vision task, in which 2D-based anomaly detection methods have been extensively studied. However, multimodal anomaly detection based on RGB images and 3D point clouds requires further…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhongbin Sun , Xiaolong Li , Yiran Li , Yue Ma

The frequent breakdowns and malfunctions of industrial equipment have driven increasing interest in utilizing cost-effective and easy-to-deploy sensors, such as microphones, for effective condition monitoring of machinery. Microphones offer…

Unsupervised image anomaly detection (UAD) has become a critical process in industrial and medical applications, but it faces growing challenges due to increasing concerns over data privacy. The limited class diversity inherent to one-class…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Silin Chen , Andy Liu , Kangjian Di , Yichu Xu , Han-Jia Ye , Wenhan Luo , Ningmu Zou

We present a selective sampling method designed to accelerate the training of deep neural networks. To this end, we introduce a novel measurement, the minimal margin score (MMS), which measures the minimal amount of displacement an input…

Machine Learning · Computer Science 2019-11-19 Berry Weinstein , Shai Fine , Yacov Hel-Or

Knowledge distillation has been widely used to produce portable and efficient neural networks which can be well applied on edge devices for computer vision tasks. However, almost all top-performing knowledge distillation methods need to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Haoran Zhao , Xin Sun , Junyu Dong , Hui Yu , Huiyu Zhou

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Anomaly detection has a wide range of applications and is especially important in industrial quality inspection. Currently, many top-performing anomaly-detection models rely on feature-embedding methods. However, these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Shiqi Deng , Zhiyu Sun , Ruiyan Zhuang , Jun Gong

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

Machine Learning · Computer Science 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Detecting anomaly patterns from images is a crucial artificial intelligence technique in industrial applications. Recent research in this domain has emphasized the necessity of a large volume of training data, overlooking the practical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shenxing Wei , Xing Wei , Zhiheng Ma , Songlin Dong , Shaochen Zhang , Yihong Gong

In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy. Addressing this challenge, we propose a novel approach called Meta-learned…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hu Wang , Salma Hassan , Yuyuan Liu , Congbo Ma , Yuanhong Chen , Qing Li , Jiahui Geng , Bingjie Wang , Yu Tian , Yutong Xie , Jodie Avery , Louise Hull , Ian Reid , Mohammad Yaqub , Gustavo Carneiro

Fully Unsupervised Anomaly Detection (FUAD) is a practical extension of Unsupervised Anomaly Detection (UAD), aiming to detect anomalies without any labels even when the training set may contain anomalous samples. To achieve FUAD, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinyue Liu , Jianyuan Wang , Biao Leng , Shuo Zhang

The NAND flash memory channel is corrupted by different types of noises, such as the data retention noise and the wear-out noise, which lead to unknown channel offset and make the flash memory channel non-stationary. In the literature,…

Information Theory · Computer Science 2024-10-10 Zhen Mei , Kui Cai , Long Shi , Jun Li , Li Chen , Kees A. Schouhamer Immink

Herein, we propose a novel dataset distillation method for constructing small informative datasets that preserve the information of the large original datasets. The development of deep learning models is enabled by the availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

Huge amount of data is the key of the success of deep learning, however, redundant information impairs the generalization ability of the model and increases the burden of calculation. Dataset Distillation (DD) compresses the original…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hangyang Kong , Wenbo Zhou , Xuxiang He , Xiaotong Tu , Xinghao Ding

Anomaly detection is the task of identifying rarely occurring (i.e. anormal or anomalous) samples that differ from almost all other samples in a dataset. As the patterns of anormal samples are usually not known a priori, this task is highly…

Applications · Statistics 2025-06-30 Nicolas Thewes , Philipp Steinhauer , Patrick Trampert , Markus Pauly , Georg Schneider

Detecting anomalies in real-world multivariate time series data is challenging due to complex temporal dependencies and inter-variable correlations. Recently, reconstruction-based deep models have been widely used to solve the problem.…

Machine Learning · Computer Science 2023-12-06 Junho Song , Keonwoo Kim , Jeonglyul Oh , Sungzoon Cho

So-called unsupervised anomaly detection is better described as semi-supervised, as it assumes all training data are nominal. This assumption simplifies training but requires manual data curation, introducing bias and limiting adaptability.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti