English
Related papers

Related papers: On-manifold Adversarial Data Augmentation Improves…

200 papers

When incorporating deep neural networks into robotic systems, a major challenge is the lack of uncertainty measures associated with their output predictions. Methods for uncertainty estimation in the output of deep object detectors (DNNs)…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Ali Harakeh , Michael Smart , Steven L. Waslander

Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.This setting neglects the more practical scenario where training data are…

Artificial Intelligence · Computer Science 2023-11-23 Wenqiao Zhang , Zheqi Lv , Hao Zhou , Jia-Wei Liu , Juncheng Li , Mengze Li , Siliang Tang , Yueting Zhuang

Efficiently and meaningfully estimating prediction uncertainty is important for exploration in active learning campaigns in materials discovery, where samples with high uncertainty are interpreted as containing information missing from the…

Materials Science · Physics 2025-11-25 Ashley S. Dale , Kangming Li , Brian DeCost , Hao Wan , Yuchen Han , Yao Fehlis , Jason Hattrick-Simpers

Adversarial examples are augmented data points generated by imperceptible perturbation of input samples. They have recently drawn much attention with the machine learning and data mining community. Being difficult to distinguish from real…

Machine Learning · Computer Science 2016-03-03 Chunchuan Lyu , Kaizhu Huang , Hai-Ning Liang

For responsible decision making in safety-critical settings, machine learning models must effectively detect and process edge-case data. Although existing works show that predictive uncertainty is useful for these tasks, it is not evident…

Machine Learning · Computer Science 2022-08-09 Mark Penrod , Harrison Termotto , Varshini Reddy , Jiayu Yao , Finale Doshi-Velez , Weiwei Pan

In this work, we consider model robustness of deep neural networks against adversarial attacks from a global manifold perspective. Leveraging both the local and global latent information, we propose a novel adversarial training method…

Machine Learning · Computer Science 2022-10-04 Zhuang Qian , Shufei Zhang , Kaizhu Huang , Qiufeng Wang , Rui Zhang , Xinping Yi

The diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-10-07 Peng Liu , Charlie T. Tran , Bin Kong , Ruogu Fang

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Rigorous statistical methods, including parameter estimation with accompanying uncertainties, underpin the validity of scientific discovery, especially in the natural sciences. With increasingly complex data models such as deep learning…

Machine Learning · Computer Science 2026-02-18 Aurora Grefsrud , Nello Blaser , Trygve Buanes

Modern recommendation systems frequently employ online learning to dynamically update their models with freshly collected data. The most commonly used optimizer for updating neural networks in these contexts is the Adam optimizer, which…

Machine Learning · Computer Science 2025-06-05 Shaowen Wang , Anan Liu , Jian Xiao , Huan Liu , Yuekui Yang , Cong Xu , Qianqian Pu , Suncong Zheng , Wei Zhang , Di Wang , Jie Jiang , Jian Li

The extreme fragility of deep neural networks, when presented with tiny perturbations in their inputs, was independently discovered by several research groups in 2013. However, despite enormous effort, these adversarial examples remained a…

Machine Learning · Computer Science 2022-06-02 Adi Shamir , Odelia Melamed , Oriel BenShmuel

Anomaly detection suffered from the lack of anomalies due to the diversity of abnormalities and the difficulties of obtaining large-scale anomaly data. Semi-supervised anomaly detection methods are often used to solely leverage normal data…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jian Shi , Ni Zhang

Models that perform well on a training domain often fail to generalize to out-of-domain (OOD) examples. Data augmentation is a common method used to prevent overfitting and improve OOD generalization. However, in natural language, it is…

Computation and Language · Computer Science 2020-10-06 Nathan Ng , Kyunghyun Cho , Marzyeh Ghassemi

This paper is concerned with the defense of deep models against adversarial attacks. Inspired by the certificate defense approach, we propose a maximal adversarial distortion (MAD) optimization method for robustifying deep networks. MAD…

Machine Learning · Computer Science 2020-06-16 Shai Rozenberg , Gal Elidan , Ran El-Yaniv

Handling missing data is a central challenge in data-driven analysis. Modern imputation methods not only aim for accurate reconstruction but also differ in how they represent and quantify uncertainty. Yet, the reliability and calibration of…

Databases · Computer Science 2025-11-27 Zarin Tahia Hossain , Mostafa Milani

Unsupervised domain adaptive object detection aims to adapt detectors from a labelled source domain to an unlabelled target domain. Most existing works take a two-stage strategy that first generates region proposals and then detects objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Dayan Guan , Jiaxing Huang , Aoran Xiao , Shijian Lu , Yanpeng Cao

Uncertainty estimation is essential to make neural networks trustworthy in real-world applications. Extensive research efforts have been made to quantify and reduce predictive uncertainty. However, most existing works are designed for…

Machine Learning · Computer Science 2022-10-07 Myong Chol Jung , He Zhao , Joanna Dipnall , Belinda Gabbe , Lan Du

Deep neural networks (DNNs) are shown to be vulnerable to adversarial examples. A well-trained model can be easily attacked by adding small perturbations to the original data. One of the hypotheses of the existence of the adversarial…

Machine Learning · Computer Science 2022-10-04 Jiancong Xiao , Liusha Yang , Yanbo Fan , Jue Wang , Zhi-Quan Luo

Probability estimates generated by boosting ensembles are poorly calibrated because of the margin maximization nature of the algorithm. The outputs of the ensemble need to be properly calibrated before they can be used as probability…

Machine Learning · Computer Science 2020-01-20 Nikolaos Nikolaou , Joseph Mellor , Nikunj C. Oza , Gavin Brown

Data augmentation has been widely employed to improve the generalization of deep neural networks. Most existing methods apply fixed or random transformations. However, we find that sample difficulty evolves along with the model's…

Machine Learning · Computer Science 2025-10-02 Suorong Yang , Jie Zong , Lihang Wang , Ziheng Qin , Hai Gan , Pengfei Zhou , Kai Wang , Yang You , Furao Shen