English
Related papers

Related papers: Improving robustness of classifiers by training ag…

200 papers

Deep neural networks (DNNs) are a contemporary solution for semantic segmentation and are usually trained to operate on a predefined closed set of classes. In open-set environments, it is possible to encounter semantically unknown objects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jurica Runtas , Tomislav Petkovic

Traditionally artificial neural networks (ANNs) are trained by minimizing the cross-entropy between a provided groundtruth delta distribution (encoded as one-hot vector) and the ANN's predictive softmax distribution. It seems, however,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Pooran Singh Negi , David chan , Mohammad Mahoor

Large-scale pre-trained models have achieved remarkable success in many applications, but how to leverage them to improve the prediction reliability of downstream models is undesirably under-explored. Moreover, modern neural networks have…

Machine Learning · Computer Science 2023-10-31 Peng Cui , Dan Zhang , Zhijie Deng , Yinpeng Dong , Jun Zhu

Mobile robots navigating in crowds trained using reinforcement learning are known to suffer performance degradation when faced with out-of-distribution scenarios. We propose that by properly accounting for the uncertainties of pedestrians,…

Robotics · Computer Science 2025-08-08 Jianpeng Yao , Xiaopan Zhang , Yu Xia , Zejin Wang , Amit K. Roy-Chowdhury , Jiachen Li

Generative Adversarial Networks (GANs) based semi-supervised learning (SSL) approaches are shown to improve classification performance by utilizing a large number of unlabeled samples in conjunction with limited labeled samples. However,…

Machine Learning · Computer Science 2020-09-16 Zexi Chen , Bharathkumar Ramachandra , Ranga Raju Vatsavai

The proper handling of out-of-distribution (OOD) samples in deep classifiers is a critical concern for ensuring the suitability of deep neural networks in safety-critical systems. Existing approaches developed for robust OOD detection in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Nasrin Alipour , Seyyed Ali SeyyedSalehi

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

Machine Learning · Computer Science 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke

We investigate an entropy-regularized reinforcement learning (RL) approach to optimal stopping problems motivated by real option models. Classical stopping rules are strict and non-randomized, limiting natural exploration in RL settings. To…

Optimization and Control · Mathematics 2026-02-18 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

In this work, we introduce a novel approach to regularization in multivariable regression problems. Our regularizer, called DLoss, penalises differences between the model's derivatives and derivatives of the data generating function as…

Machine Learning · Computer Science 2024-05-02 Enrico Lopedoto , Maksim Shekhunov , Vitaly Aksenov , Kizito Salako , Tillman Weyde

We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We…

Machine Learning · Computer Science 2019-12-19 Charlie Frogner , Sebastian Claici , Edward Chien , Justin Solomon

Recently, Generative Adversarial Networks (GANs) have emerged as a popular alternative for modeling complex high dimensional distributions. Most of the existing works implicitly assume that the clean samples from the target distribution are…

Machine Learning · Statistics 2019-02-14 Mohammadreza Soltani , Swayambhoo Jain , Abhinav Sambasivan

We study regularization in the context of small sample-size learning with over-parameterized neural networks. Specifically, we shift focus from architectural properties, such as norms on the network weights, to properties of the internal…

Machine Learning · Computer Science 2021-05-18 Christoph D. Hofer , Florian Graf , Marc Niethammer , Roland Kwitt

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Deep learning has emerged as a powerful approach for malware detection, demonstrating impressive accuracy across various data representations. However, these models face critical limitations in real-world, non-stationary environments where…

Cryptography and Security · Computer Science 2026-04-24 Pawan Acharya , Lan Zhang

Traffic sign recognition is a well-researched problem in computer vision. However, the state of the art methods works only for frequent sign classes, which are well represented in training datasets. We consider the task of rare traffic sign…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Anton Konushin , Boris Faizov , Vlad Shakhuro

Deep neural networks (DNNs) play a crucial role in the field of machine learning, demonstrating state-of-the-art performance across various application domains. However, despite their success, DNN-based models may occasionally exhibit…

Machine Learning · Computer Science 2024-07-02 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Deep learning classifiers are now known to have flaws in the representations of their class. Adversarial attacks can find a human-imperceptible perturbation for a given image that will mislead a trained model. The most effective methods to…

Machine Learning · Computer Science 2021-05-19 Quentin Bouniot , Romaric Audigier , Angélique Loesch

Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification…

Machine Learning · Computer Science 2019-04-30 Sachin Vernekar , Ashish Gaurav , Taylor Denouden , Buu Phan , Vahdat Abdelzad , Rick Salay , Krzysztof Czarnecki

Detecting test samples drawn sufficiently far away from the training distribution statistically or adversarially is a fundamental requirement for deploying a good classifier in many real-world machine learning applications. However, deep…

Machine Learning · Statistics 2018-10-30 Kimin Lee , Kibok Lee , Honglak Lee , Jinwoo Shin