English
Related papers

Related papers: Effective Robustness against Natural Distribution …

200 papers

Image classification with neural networks (NNs) is widely used in industrial processes, situations where the model likely encounters unknown objects during deployment, i.e., out-of-distribution (OOD) data. Worryingly, NNs tend to make…

Machine Learning · Computer Science 2025-01-14 Arthur Thuy , Dries F. Benoit

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

A common goal in statistics and machine learning is to learn models that can perform well against distributional shifts, such as latent heterogeneous subpopulations, unknown covariate shifts, or unmodeled temporal effects. We develop and…

Machine Learning · Statistics 2020-07-21 John Duchi , Hongseok Namkoong

Current methods for training robust networks lead to a drop in test accuracy, which has led prior works to posit that a robustness-accuracy tradeoff may be inevitable in deep learning. We take a closer look at this phenomenon and first show…

Machine Learning · Computer Science 2020-07-14 Yao-Yuan Yang , Cyrus Rashtchian , Hongyang Zhang , Ruslan Salakhutdinov , Kamalika Chaudhuri

A major challenge in machine learning is resilience to out-of-distribution data, that is data that exists outside of the distribution of a model's training data. Training is often performed using limited, carefully curated datasets and so…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Christopher J. Holder , Majid Khonji , Jorge Dias , Muhammad Shafique

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

Estimating the generalization performance is practically challenging on out-of-distribution (OOD) data without ground-truth labels. While previous methods emphasize the connection between distribution difference and OOD accuracy, we show…

Machine Learning · Computer Science 2023-10-24 Renchunzi Xie , Hongxin Wei , Lei Feng , Yuzhou Cao , Bo An

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li

Benchmarks for out-of-distribution (OOD) generalization frequently show a strong positive correlation between in-distribution (ID) and OOD accuracy across models, termed "accuracy-on-the-line." This pattern is often taken to imply that…

Machine Learning · Computer Science 2025-10-30 Olawale Salaudeen , Haoran Zhang , Kumail Alhamoud , Sara Beery , Marzyeh Ghassemi

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

Machine Learning · Computer Science 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Accurate trajectory prediction is essential for the safe operation of autonomous vehicles in real-world environments. Even well-trained machine learning models may produce unreliable predictions due to discrepancies between training data…

Robotics · Computer Science 2025-04-24 Tongfe Guo , Taposh Banerjee , Rui Liu , Lili Su

To ensure trust in AI models, it is becoming increasingly apparent that evaluation of models must be extended beyond traditional performance metrics, like accuracy, to other dimensions, such as fairness, explainability, adversarial…

Machine Learning · Computer Science 2021-10-01 Moninder Singh , Gevorg Ghalachyan , Kush R. Varshney , Reginald E. Bryant

While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real-world samples. We circumvent this challenge by using…

Machine Learning · Computer Science 2022-03-04 Vikash Sehwag , Saeed Mahloujifar , Tinashe Handina , Sihui Dai , Chong Xiang , Mung Chiang , Prateek Mittal

Various approaches have been proposed for out-of-distribution (OOD) detection by augmenting models, input examples, training sets, and optimization objectives. Deviating from existing work, we have a simple hypothesis that standard…

Machine Learning · Computer Science 2022-03-29 Xin Dong , Junfeng Guo , Ang Li , Wei-Te Ting , Cong Liu , H. T. Kung

Recent research on robustness has revealed significant performance gaps between neural image classifiers trained on datasets that are similar to the test set, and those that are from a naturally shifted distribution, such as sketches,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Hritik Bansal , Aditya Grover

Robustness against Out-of-Distribution (OoD) samples is a key performance indicator of a trajectory prediction model. However, the development and ranking of state-of-the-art (SotA) models are driven by their In-Distribution (ID)…

Machine Learning · Computer Science 2025-01-28 Yue Yao , Shengchao Yan , Daniel Goehring , Wolfram Burgard , Joerg Reichardt

Adversarial robustness research primarily focuses on L_p perturbations, and most defenses are developed with identical training-time and test-time adversaries. However, in real-world applications developers are unlikely to have access to…

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

Numerous pre-training techniques for visual document understanding (VDU) have recently shown substantial improvements in performance across a wide range of document tasks. However, these pre-trained VDU models cannot guarantee continued…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Jiabang He , Yi Hu , Lei Wang , Xing Xu , Ning Liu , Hui Liu , Heng Tao Shen

Out-of-distribution (OOD) detection is a critical task for reliable predictions over text. Fine-tuning with pre-trained language models has been a de facto procedure to derive OOD detectors with respect to in-distribution (ID) data. Despite…

Computation and Language · Computer Science 2023-05-23 Rheeya Uppaal , Junjie Hu , Yixuan Li