中文
相关论文

相关论文: Rethinking Test-time Likelihood: The Likelihood Pa…

200 篇论文

Detecting out-of-distribution (OOD) samples is essential when deploying machine learning models in open-world scenarios. Zero-shot OOD detection, requiring no training on in-distribution (ID) data, has been possible with the advent of…

机器学习 · 计算机科学 2024-06-04 Chentao Cao , Zhun Zhong , Zhanke Zhou , Yang Liu , Tongliang Liu , Bo Han

Real-world data deviating from the independent and identically distributed (i.i.d.) assumption of in-distribution training data poses security threats to deep networks, thus advancing out-of-distribution (OOD) detection algorithms.…

计算与语言 · 计算机科学 2024-10-31 Yiming Wang , Pei Zhang , Baosong Yang , Derek F. Wong , Zhuosheng Zhang , Rui Wang

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

机器学习 · 计算机科学 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

机器学习 · 计算机科学 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke

Machine learning models encounter Out-of-Distribution (OoD) errors when the data seen at test time are generated from a different stochastic generator than the one used to generate the training data. One proposal to scale OoD detection to…

机器学习 · 统计学 2019-05-27 Hyunsun Choi , Eric Jang , Alexander A. Alemi

Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples. Previous studies on this issue are usually not…

机器学习 · 计算机科学 2024-01-04 Zezhen Zeng , Bin Liu

Out-of-distribution (OOD) detection is essential for the reliability of ML models. Most existing methods for OOD detection learn a fixed decision criterion from a given in-distribution dataset and apply it universally to decide if a data…

机器学习 · 计算机科学 2023-11-29 YiFan Zhang , Xue Wang , Tian Zhou , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

机器学习 · 计算机科学 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

Neural networks trained with SGD were recently shown to rely preferentially on linearly-predictive features and can ignore complex, equally-predictive ones. This simplicity bias can explain their lack of robustness out of distribution…

机器学习 · 计算机科学 2022-09-13 Damien Teney , Ehsan Abbasnejad , Simon Lucey , Anton van den Hengel

Variational autoencoders (VAEs) are influential generative models with rich representation capabilities from the deep neural network architecture and Bayesian method. However, VAE models have a weakness that assign a higher likelihood to…

机器学习 · 计算机科学 2021-11-02 Xuming Ran , Mingkun Xu , Lingrui Mei , Qi Xu , Quanying Liu

Reliable confidence estimation is a challenging yet fundamental requirement in many risk-sensitive applications. However, modern deep neural networks are often overconfident for their incorrect predictions, i.e., misclassified samples from…

计算机视觉与模式识别 · 计算机科学 2024-03-06 Fei Zhu , Xu-Yao Zhang , Zhen Cheng , Cheng-Lin Liu

Mechanistic dynamic models of biochemical networks such as Ordinary Differential Equations (ODEs) contain unknown parameters like the reaction rate constants and the initial concentrations of the compounds. The large number of parameters as…

数据分析、统计与概率 · 物理学 2017-08-14 Clemens Kreutz , Andreas Raue , Jens Timmer

Deep learning (DL)-based systems can exhibit unexpected behavior when exposed to out-of-distribution (OOD) scenarios, posing serious risks in safety-critical domains such as malware detection and autonomous driving. This underscores the…

软件工程 · 计算机科学 2026-04-28 Jingyu Zhang , Fan Wang , Jacky Keung , Yihan Liao , Yan Xiao , Lei Ma

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

机器学习 · 计算机科学 2024-04-09 Zhen Fang , Yixuan Li , Feng Liu , Bo Han , Jie Lu

Out-of-distribution (OOD) detection is crucial when deploying deep neural networks in the real world to ensure the reliability and safety of their applications. One main challenge in OOD detection is that neural network models often produce…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Jinlun Ye , Zhuohao Sun , Yiqiao Qiu , Qiu Li , Zhijun Tan , Ruixuan Wang

Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Mingle Xu , Jaehwan Lee , Sook Yoon , Dong Sun Park

Out-of-distribution (OOD) detection, i.e., finding test samples derived from a different distribution than the training set, as well as reasoning about such samples (OOD reasoning), are necessary to ensure the safety of results generated by…

机器学习 · 计算机科学 2022-10-19 Zahra Rahiminasab , Michael Yuhas , Arvind Easwaran

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

机器学习 · 计算机科学 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Out-of-Distribution (OOD) detection, aiming to distinguish outliers from known categories, has gained prominence in practical scenarios. Recently, the advent of vision-language models (VLM) has heightened interest in enhancing OOD detection…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Fanhu Zeng , Zhen Cheng , Fei Zhu , Hongxin Wei , Xu-Yao Zhang

Out-of-distribution (OOD) detection methods often exploit auxiliary outliers to train model identifying OOD samples, especially discovering challenging outliers from auxiliary outliers dataset to improve OOD detection. However, they may…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Yichen Bai , Zongbo Han , Changqing Zhang , Bing Cao , Xiaoheng Jiang , Qinghua Hu