中文
相关论文

相关论文: Distributional Gaussian Processes Layers for Out-o…

200 篇论文

Addressing the Out-of-Distribution (OoD) segmentation task is a prerequisite for perception systems operating in an open-world environment. Large foundational models are frequently used in downstream tasks, however, their potential for OoD…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Nazir Nayal , Youssef Shoeb , Fatma Güney

In satellite image analysis, distributional mismatch between the training and test data may arise due to several reasons, including unseen classes in the test data and differences in the geographic area. Deep learning based models may…

机器学习 · 计算机科学 2021-04-13 Jakob Gawlikowski , Sudipan Saha , Anna Kruspe , Xiao Xiang Zhu

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

机器学习 · 计算机科学 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

Graph Neural Networks have achieved impressive results across diverse network modeling tasks, but accurately estimating uncertainty on graphs remains difficult, especially under distributional shifts. Unlike traditional uncertainty…

机器学习 · 计算机科学 2025-10-15 Fred Xu , Thomas Markovich

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

The key to out-of-distribution detection is density estimation of the in-distribution data or of its feature representations. This is particularly challenging for dense anomaly detection in domains where the in-distribution data has a…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Silvio Galesso , Max Argus , Thomas Brox

Bayesian neural networks and deep ensemble methods have been proposed for uncertainty quantification; however, they are computationally intensive and require large storage. By utilizing a single deterministic model, we can solve the above…

机器学习 · 计算机科学 2025-08-04 Yaxin Ma , Benjamin Colburn , Jose C. Principe

We propose stochastic, non-parametric activation functions that are fully learnable and individual to each neuron. Complexity and the risk of overfitting are controlled by placing a Gaussian process prior over these functions. The result is…

机器学习 · 统计学 2017-12-01 Sebastian Urban , Marcus Basalla , Patrick van der Smagt

Despite their success, Machine Learning (ML) models do not generalize effectively to data not originating from the training distribution. To reliably employ ML models in real-world healthcare systems and avoid inaccurate predictions on…

机器学习 · 计算机科学 2023-09-29 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Ciná

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

机器学习 · 计算机科学 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…

In the recent years, researchers proposed a number of successful methods to perform out-of-distribution (OOD) detection in deep neural networks (DNNs). So far the scope of the highly accurate methods has been limited to image level…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Ertunc Erdil , Krishna Chaitanya , Neerav Karani , Ender Konukoglu

Open-world classification systems should discern out-of-distribution (OOD) data whose labels deviate from those of in-distribution (ID) cases, motivating recent studies in OOD detection. Advanced works, despite their promising progress, may…

机器学习 · 计算机科学 2023-12-27 Qizhou Wang , Zhen Fang , Yonggang Zhang , Feng Liu , Yixuan Li , Bo Han

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

机器学习 · 统计学 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

机器学习 · 统计学 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

机器学习 · 计算机科学 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Recent work has shown that deep generative models can assign higher likelihood to out-of-distribution data sets than to their training data (Nalisnick et al., 2019; Choi et al., 2019). We posit that this phenomenon is caused by a mismatch…

机器学习 · 统计学 2019-10-17 Eric Nalisnick , Akihiro Matsukawa , Yee Whye Teh , Balaji Lakshminarayanan

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

机器学习 · 计算机科学 2024-03-15 Tim Rensmeyer , Oliver Niggemann

We consider the problem of detecting out-of-distribution images in neural networks. We propose ODIN, a simple and effective method that does not require any change to a pre-trained neural network. Our method is based on the observation that…

机器学习 · 计算机科学 2020-09-01 Shiyu Liang , Yixuan Li , R. Srikant

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…