English
Related papers

Related papers: Robust training on approximated minimal-entropy se…

200 papers

Visual anomaly detection in real-world industrial settings faces two major limitations. First, most existing methods are trained on purely normal data or on unlabeled datasets assumed to be predominantly normal, presuming the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Anindya Sundar Das , Monowar Bhuyan

Existing training criteria in automatic speech recognition(ASR) permit the model to freely explore more than one time alignments between the feature and label sequences. In this paper, we use entropy to measure a model's uncertainty, i.e.…

Computation and Language · Computer Science 2022-12-26 Ehsan Variani , Ke Wu , David Rybach , Cyril Allauzen , Michael Riley

Data augmentation methods are commonly integrated into the training of anomaly detection models. Previous approaches have primarily focused on replicating real-world anomalies or enhancing diversity, without considering that the standard of…

Artificial Intelligence · Computer Science 2024-12-30 Jiang Lin , Yaping Yan

Entropy integrals are widely used as a powerful empirical process tool to obtain upper bounds for the rates of convergence of global empirical risk minimizers (ERMs), in standard settings such as density estimation and regression. The upper…

Statistics Theory · Mathematics 2021-01-08 Qiyang Han

Anomaly detection is fundamental for ensuring quality control and operational efficiency in industrial environments, yet conventional approaches face significant challenges when training data contains mislabeled samples-a common occurrence…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

Remote sensing anomaly detector can find the objects deviating from the background as potential targets for Earth monitoring. Given the diversity in earth anomaly types, designing a transferring model with cross-modality detection ability…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Jingtao Li , Xinyu Wang , Hengwei Zhao , Liangpei Zhang , Yanfei Zhong

Anomaly Detection and Segmentation (AD&S) is crucial for industrial quality control. While existing methods excel in generating anomaly scores for each pixel, practical applications require producing a binary segmentation to identify…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Alex Costanzino , Pierluigi Zama Ramirez , Mirko Del Moro , Agostino Aiezzo , Giuseppe Lisanti , Samuele Salti , Luigi Di Stefano

Anomaly detection often relies on supervised or clustering approaches, with limited success in specialized domains like automotive communication systems where scalable solutions are essential. We propose a novel decoder-only Large Language…

Machine Learning · Computer Science 2025-07-03 Bogdan Bogdan , Arina Cazacu , Laura Vasilie

We approach multivariate mode estimation through Gibbs distributions and introduce GERVE (Gibbs-measure Entropy-Regularised Variational Estimation), a likelihood-free framework that approximates Gibbs measures directly from samples by…

Methodology · Statistics 2026-02-23 Tâm LeMinh , Julyan Arbel , Florence Forbes , Hien Duy Nguyen

Metric learning aims to learn a distance metric such that semantically similar instances are pulled together while dissimilar instances are pushed away. Many existing methods consider maximizing or at least constraining a distance margin in…

Machine Learning · Statistics 2022-08-17 Xiaochen Yang , Yiwen Guo , Mingzhi Dong , Jing-Hao Xue

We propose a novel data-driven method to learn a mixture of multiple kernels with random features that is certifiabaly robust against adverserial inputs. Specifically, we consider a distributionally robust optimization of the kernel-target…

Machine Learning · Computer Science 2021-04-15 Masoud Badiei Khuzani , Hongyi Ren , Md Tauhidul Islam , Lei Xing

We present an extension of Vapnik's classical empirical risk minimizer (ERM) where the empirical risk is replaced by a median-of-means (MOM) estimator, the new estimators are called MOM minimizers. While ERM is sensitive to corruption of…

Statistics Theory · Mathematics 2018-08-10 Guillaume Lecué , Matthieu Lerasle , Timothée Mathieu

Self-training is a powerful approach to deep learning. The key process is to find a pseudo-label for modeling. However, previous self-training algorithms suffer from the over-confidence issue brought by the hard labels, even some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

The fundamental theorem of statistical learning states that for binary classification problems, any Empirical Risk Minimization (ERM) learning rule has close to optimal sample complexity. In this paper we seek for a generic optimal learner…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Shai Shalev-Shwartz

Obtaining high-quality labels is costly, whereas unlabeled covariates are often abundant, motivating semi-supervised inference methods with reliable uncertainty quantification. Prediction-powered inference (PPI) leverages a machine-learning…

Machine Learning · Statistics 2026-05-29 Se Yoon Lee , Jae Kwang Kim

Existing ordinal embedding methods usually follow a two-stage routine: outlier detection is first employed to pick out the inconsistent comparisons; then an embedding is learned from the clean data. However, learning in a multi-stage manner…

Machine Learning · Computer Science 2018-12-06 Ke Ma , Qianqian Xu , Xiaochun Cao

The detection and the quantification of anomalies in image data are critical tasks in industrial scenes such as detecting micro scratches on product. In recent years, due to the difficulty of defining anomalies and the limit of correcting…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Masanari Kimura , Takashi Yanagihara

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not belong to. However,…

Machine Learning · Statistics 2020-07-24 Yuzhou Cao , Shuqi Liu , Yitian Xu

This paper introduces a random modulation technique that is decoupled from the channel matrix, allowing it to be applied to arbitrary norm-bounded and spectrally convergent channel matrices. The proposed random modulation constructs an…

Information Theory · Computer Science 2026-01-01 Lei Liu , Yuhao Chi , Shunqi Huang

For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of…

Information Theory · Computer Science 2015-06-18 Justin Ziniel , Philip Schniter , Per Sederberg