中文
相关论文

相关论文: Characterizing Generalization under Out-Of-Distrib…

200 篇论文

Clinical machine learning models show a significant performance drop when tested in settings not seen during training. Domain generalisation models promise to alleviate this problem, however, there is still scepticism about whether they…

机器学习 · 计算机科学 2022-11-14 Dimitris Spathis , Stephanie L. Hyland

Deep neural networks (DNNs) for the semantic segmentation of images are usually trained to operate on a predefined closed set of object classes. This is in contrast to the "open world" setting where DNNs are envisioned to be deployed to.…

计算机视觉与模式识别 · 计算机科学 2021-07-28 Robin Chan , Matthias Rottmann , Hanno Gottschalk

Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where…

Detecting out-of-distribution (OOD) samples is vital for developing machine learning based models for critical safety systems. Common approaches for OOD detection assume access to some OOD samples during training which may not be available…

机器学习 · 计算机科学 2021-10-19 Koby Bibas , Meir Feder , Tal Hassner

Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is…

机器学习 · 计算机科学 2021-02-16 Thomas Kobber Panum , Zi Wang , Pengyu Kan , Earlence Fernandes , Somesh Jha

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

机器学习 · 计算机科学 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

Anomaly detection (AD) is a crucial machine learning task that aims to learn patterns from a set of normal training samples to identify abnormal samples in test data. Most existing AD studies assume that the training and test data are drawn…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Tri Cao , Jiawen Zhu , Guansong Pang

Out-of-distribution (OOD) detection plays a vital role in enhancing the reliability of machine learning (ML) models. The emergence of large language models (LLMs) has catalyzed a paradigm shift within the ML community, showcasing their…

计算与语言 · 计算机科学 2024-04-17 Bo Liu , Liming Zhan , Zexin Lu , Yujie Feng , Lei Xue , Xiao-Ming Wu

Deep metric learning (DML) is a popular approach for images retrieval, solving verification (same or not) problems and addressing open set classification. Arguably, the most common DML approach is with triplet loss, despite significant…

机器学习 · 计算机科学 2019-12-02 Istvan Fehervari , Avinash Ravichandran , Srikar Appalaraju

Deep neural networks (DNNs) play a crucial role in the field of machine learning, demonstrating state-of-the-art performance across various application domains. However, despite their success, DNN-based models may occasionally exhibit…

机器学习 · 计算机科学 2024-07-02 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

计算机视觉与模式识别 · 计算机科学 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

机器学习 · 计算机科学 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

This paper introduces a universal approach to seamlessly combine out-of-distribution (OOD) detection scores. These scores encompass a wide range of techniques that leverage the self-confidence of deep learning models and the anomalous…

机器学习 · 统计学 2024-06-25 Eduardo Dadalto , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

机器学习 · 计算机科学 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Detecting out-of-distribution (OOD) samples is crucial for trustworthy AI in real-world applications. Leveraging recent advances in representation learning and latent embeddings, Various scoring algorithms estimate distributions beyond the…

机器学习 · 计算机科学 2024-09-20 Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

机器学习 · 计算机科学 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry