English
Related papers

Related papers: On-manifold Adversarial Data Augmentation Improves…

200 papers

Obtaining reliable and accurate quantification of uncertainty estimates from deep neural networks is important in safety-critical applications. A well-calibrated model should be accurate when it is certain about its prediction and indicate…

Machine Learning · Computer Science 2020-12-16 Ranganath Krishnan , Omesh Tickoo

Recent studies imply that deep neural networks are vulnerable to adversarial examples -- inputs with a slight but intentional perturbation are incorrectly classified by the network. Such vulnerability makes it risky for some…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Jinyu Yang , Chunyuan Li , Weizhi An , Hehuan Ma , Yuzhi Guo , Yu Rong , Peilin Zhao , Junzhou Huang

We present an approach to quantifying both aleatoric and epistemic uncertainty for deep neural networks in image classification, based on generative adversarial networks (GANs). While most works in the literature that use GANs to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Philipp Oberdiek , Gernot A. Fink , Matthias Rottmann

Reliable uncertainty estimation is crucial for perception systems in safe autonomous driving. Recently, many methods have been proposed to model uncertainties in deep learning based object detectors. However, the estimated probabilities are…

Robotics · Computer Science 2019-09-30 Di Feng , Lars Rosenbaum , Claudius Glaeser , Fabian Timm , Klaus Dietmayer

Deep neural networks have significantly contributed to the success in predictive accuracy for classification tasks. However, they tend to make over-confident predictions in real-world settings, where domain shifting and out-of-distribution…

Artificial Intelligence · Computer Science 2021-07-16 Yibo Hu , Latifur Khan

Detecting out of distribution (OOD) samples is of paramount importance in all Machine Learning applications. Deep generative modeling has emerged as a dominant paradigm to model complex data distributions without labels. However, prior work…

Machine Learning · Computer Science 2021-01-05 Gowthami Somepalli , Yexin Wu , Yogesh Balaji , Bhanukiran Vinzamuri , Soheil Feizi

Cost-sensitive classification is critical in applications where misclassification errors widely vary in cost. However, over-parameterization poses fundamental challenges to the cost-sensitive modeling of deep neural networks (DNNs). The…

Machine Learning · Computer Science 2024-04-01 Qiyuan Chen , Raed Al Kontar , Maher Nouiehed , Jessie Yang , Corey Lester

Designing deep networks robust to adversarial examples remains an open problem. Likewise, recent zeroth order hard-label attacks on image classification models have shown comparable performance to their first-order, gradient-level…

Machine Learning · Computer Science 2021-03-08 Washington Garcia , Pin-Yu Chen , Somesh Jha , Scott Clouse , Kevin R. B. Butler

Despite achieving enormous success in predictive accuracy for visual classification problems, deep neural networks (DNNs) suffer from providing overconfident probabilities on out-of-distribution (OOD) data. Yet, accurate uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

Computer-aided diagnosis systems must make critical decisions from medical images that are often noisy, ambiguous, or conflicting, yet today's models are trained on overly simplistic labels that ignore diagnostic uncertainty. One-hot labels…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Ang Nan Gu , Michael Tsang , Hooman Vaseli , Purang Abolmaesumi , Teresa Tsang

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Domain shift remains a key challenge in deploying machine learning models to the real world. Unsupervised domain adaptation (UDA) aims to address this by minimising domain discrepancy during training, but the discrepancy estimates suffer…

Machine Learning · Computer Science 2026-05-07 Andrea Napoli , Paul White

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

Machine Learning · Computer Science 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

Deep learning-based edge detectors heavily rely on pixel-wise labels which are often provided by multiple annotators. Existing methods fuse multiple annotations using a simple voting process, ignoring the inherent ambiguity of edges and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Caixia Zhou , Yaping Huang , Mengyang Pu , Qingji Guan , Li Huang , Haibin Ling

Neural networks are fragile when confronted with data that significantly deviates from their training distribution. This is true in particular for simulation-based inference methods, such as neural amortized Bayesian inference (ABI), where…

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

Machine Learning · Computer Science 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

Recent advances in deep learning have shown that uncertainty estimation is becoming increasingly important in applications such as medical imaging, natural language processing, and autonomous systems. However, accurately quantifying…

Machine Learning · Computer Science 2023-07-04 Uddeshya Upadhyay , Jae Myung Kim , Cordelia Schmidt , Bernhard Schölkopf , Zeynep Akata

It is critical that the models pay attention not only to accuracy but also to the certainty of prediction. Uncertain predictions of deep models caused by noisy data raise significant concerns in trustworthy AI areas. To explore and handle…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Hongze Li , Ying Wu

Convolutional neural networks (CNNs) can learn directly from raw data, resulting in exceptional performance across various research areas. However, factors present in non-controllable environments such as unlabeled datasets with varying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Lucas Fernando Alvarenga e Silva , Samuel Felipe dos Santos , Nicu Sebe , Jurandy Almeida