中文
相关论文

相关论文: Towards Distribution-Shift Uncertainty Estimation …

200 篇论文

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty…

机器学习 · 计算机科学 2021-03-11 Julian Bitterwolf , Alexander Meinke , Matthias Hein

Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks via a single diffusion prior without re-training for each…

机器学习 · 计算机科学 2023-10-03 Morteza Mardani , Jiaming Song , Jan Kautz , Arash Vahdat

Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of graphs are causally…

机器学习 · 计算机科学 2025-12-10 Bohan Wang , Yurui Chang , Wei Jin , Lu Lin

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Machine Learning classifiers used in Brain-Computer Interfaces make classifications based on the distribution of data they were trained on. When they need to make inferences on samples that fall outside of this distribution, they can only…

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

机器学习 · 计算机科学 2021-12-03 Peyman Morteza , Yixuan Li

Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification…

State-of-the-art image classifiers trained on massive datasets (such as ImageNet) have been shown to be vulnerable to a range of both intentional and incidental distribution shifts. On the other hand, several recent classifiers with…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Benjamin Feuer , Ameya Joshi , Chinmay Hegde

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

机器学习 · 计算机科学 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

The generalization ability of machine learning models degrades significantly when the test distribution shifts away from the training distribution. We investigate the problem of training models that are robust to shifts caused by changes in…

机器学习 · 计算机科学 2023-09-19 Jiaheng Wei , Harikrishna Narasimhan , Ehsan Amid , Wen-Sheng Chu , Yang Liu , Abhishek Kumar

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

机器学习 · 计算机科学 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

Out-of-distribution (OOD) detection is crucial for enhancing the generalization of AI models used in mammogram screening. Given the challenge of limited prior knowledge about OOD samples in external datasets, unsupervised generative…

图像与视频处理 · 电气工程与系统科学 2024-09-19 Zhemin Zhang , Bhavika Patel , Bhavik Patel , Imon Banerjee

Out-of-distribution (OOD) detection and lossless compression constitute two problems that can be solved by the training of probabilistic models on a first dataset with subsequent likelihood evaluation on a second dataset, where data…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Mingtian Zhang , Andi Zhang , Steven McDonagh

Deep neural networks (DNNs) remain challenged by distribution shifts in complex open-world domains like automated driving (AD): Robustness against yet unknown novel objects (semantic shift) or styles like lighting conditions (covariate…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Mert Keser , Halil Ibrahim Orhan , Niki Amini-Naieni , Gesina Schwalbe , Alois Knoll , Matthias Rottmann

Despite the significant research efforts on trajectory prediction for automated driving, limited work exists on assessing the prediction reliability. To address this limitation we propose an approach that covers two sources of error, namely…

机器人学 · 计算机科学 2023-08-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis

Accurate estimation of predictive uncertainty in modern neural networks is critical to achieve well calibrated predictions and detect out-of-distribution (OOD) inputs. The most promising approaches have been predominantly focused on…

机器学习 · 计算机科学 2020-07-13 Shreyas Padhy , Zachary Nado , Jie Ren , Jeremiah Liu , Jasper Snoek , Balaji Lakshminarayanan