English
Related papers

Related papers: Typicalness-Aware Learning for Failure Detection

200 papers

With the growing adoption of AI-based systems across everyday life, the need to understand their decision-making mechanisms is correspondingly increasing. The level at which we can trust the statistical inferences made from AI-based…

Machine Learning · Statistics 2024-04-15 Adam Spannaus , Heidi A. Hanson , Lynne Penberthy , Georgia Tourassi

There is a family of label modification approaches including self and non-self label correction (LC), and output regularisation. They are widely used for training robust deep neural networks (DNNs), but have not been mathematically and…

Machine Learning · Computer Science 2022-09-07 Xinshao Wang , Yang Hua , Elyor Kodirov , Sankha Subhra Mukherjee , David A. Clifton , Neil M. Robertson

Auxiliary information can be exploited in machine learning models using the paradigm of evidence based conditional inference. Multi-modal techniques in Deep Neural Networks (DNNs) can be seen as perturbing the latent feature representation…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Dinesh Khandelwal , Suyash Agrawal , Parag Singla , Chetan Arora

Traditional deep learning algorithms often fail to generalize when they are tested outside of the domain of the training data. The issue can be mitigated by using unlabeled data from the target domain at training time, but because data…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

Machine Learning · Statistics 2019-08-05 Sunil Thulasidasan , Tanmoy Bhattacharya , Jeff Bilmes , Gopinath Chennupati , Jamal Mohd-Yusof

The NAND flash memory channel is corrupted by different types of noises, such as the data retention noise and the wear-out noise, which lead to unknown channel offset and make the flash memory channel non-stationary. In the literature,…

Information Theory · Computer Science 2024-10-10 Zhen Mei , Kui Cai , Long Shi , Jun Li , Li Chen , Kees A. Schouhamer Immink

Deep anomaly detection (AD) aims to provide robust and efficient classifiers for one-class and unbalanced settings. However current AD models still struggle on edge-case normal samples and are often unable to keep high performance over…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Loic Jezequel , Ngoc-Son Vu , Jean Beaudet , Aymeric Histace

The phenomenon of adversarial examples illustrates one of the most basic vulnerabilities of deep neural networks. Among the variety of techniques introduced to surmount this inherent weakness, adversarial training has emerged as the most…

Machine Learning · Computer Science 2022-09-14 Matan Levi , Idan Attias , Aryeh Kontorovich

Multi-modal deep metric learning is crucial for effectively capturing diverse representations in tasks such as face verification, fine-grained object recognition, and product search. Traditional approaches to metric learning, whether based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Hadush Hailu Gebrerufael , Anil Kumar Tiwari , Gaurav Neupane , Goitom Ybrah Hailu

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

It is well-known that a deep neural network has a strong fitting capability and can easily achieve a low training error even with randomly assigned class labels. When the number of training samples is small, or the class labels are noisy,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Avraham Chapman , Lingqiao Liu

Anomaly detection is crucial to ensure the security of cyber-physical systems (CPS). However, due to the increasing complexity of CPSs and more sophisticated attacks, conventional anomaly detection methods, which face the growing volume of…

Cryptography and Security · Computer Science 2021-01-20 Yuan Luo , Ya Xiao , Long Cheng , Guojun Peng , Danfeng Daphne Yao

Pre-trained deep neural networks (DNNs) are being widely deployed by industry for making business decisions and to serve users; however, a major problem is model decay, where the DNN's predictions become more erroneous over time, resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Md Yousuf Harun , Christopher Kanan

Regularizing Deep Neural Networks (DNNs) is essential for improving generalizability and preventing overfitting. Fixed penalty methods, though common, lack adaptability and suffer from hyperparameter sensitivity. In this paper, we propose a…

Machine Learning · Computer Science 2023-10-26 Diogo Lavado , Cláudia Soares , Alessandra Micheletti

Anomaly detection is a crucial task in various domains. Most of the existing methods assume the normal sample data clusters around a single central prototype while the real data may consist of multiple categories or subgroups. In addition,…

Machine Learning · Statistics 2024-12-03 Zhijin Dong , Hongzhi Liu , Boyuan Ren , Weimin Xiong , Zhonghai Wu

The malicious use and widespread dissemination of deepfake pose a significant crisis of trust. Current deepfake detection models can generally recognize forgery images by training on a large dataset. However, the accuracy of detection…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Kun Pan , Yin Yifang , Yao Wei , Feng Lin , Zhongjie Ba , Zhenguang Liu , ZhiBo Wang , Lorenzo Cavallaro , Kui Ren

Anomaly detection (AD) is increasingly recognized as a key component for ensuring the resilience of future communication systems. While deep learning has shown state-of-the-art AD performance, its application in critical systems is hindered…

Machine Learning · Computer Science 2025-10-29 Lukas Schynol , Marius Pesavento

Machine learning models are increasingly being utilized across various fields and tasks due to their outstanding performance and strong generalization capabilities. Nonetheless, their success hinges on the availability of large volumes of…

Machine Learning · Computer Science 2024-11-26 Shreen Gul , Mohamed Elmahallawy , Sanjay Madria , Ardhendu Tripathy

As deep neural networks(DNN) become increasingly prevalent, particularly in high-stakes areas such as autonomous driving and healthcare, the ability to detect incorrect predictions of models and intervene accordingly becomes crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ge Yan , Tsui-Wei Weng

Deep neural networks can be unreliable in the real world when the training set does not adequately cover all the settings where they are deployed. Focusing on image classification, we consider the setting where we have an error distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sahil Singla , Atoosa Malemir Chegini , Mazda Moayeri , Soheil Feiz