中文
相关论文

相关论文: Towards out of distribution generalization for pro…

200 篇论文

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

Scientific machine learning (ML) endeavors to develop generalizable models with broad applicability. However, the assessment of generalizability is often based on heuristics. Here, we demonstrate in the materials science setting that…

Out-of-distribution (OOD) generalization is a challenging machine learning problem yet highly desirable in many high-stake applications. Existing methods suffer from overly pessimistic modeling with low generalization confidence. As…

机器学习 · 计算机科学 2024-06-10 Fengchun Qiao , Xi Peng

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

机器学习 · 计算机科学 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

In real word applications, data generating process for training a machine learning model often differs from what the model encounters in the test stage. Understanding how and whether machine learning models generalize under such…

机器学习 · 统计学 2022-02-08 Abdulkadir Canatar , Blake Bordelon , Cengiz Pehlevan

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

机器学习 · 计算机科学 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

The recent achievements of Deep Learning rely on the test data being similar in distribution to the training data. In an ideal case, Deep Learning models would achieve Out-of-Distribution (OoD) Generalization, i.e. reliably make predictions…

图像与视频处理 · 电气工程与系统科学 2021-09-07 Antoine Sanner , Camila Gonzalez , Anirban Mukhopadhyay

Generalizing to out-of-distribution (OOD) data or unseen domain, termed OOD generalization, still lacks appropriate theoretical guarantees. Canonical OOD bounds focus on different distance measurements between source and target domains but…

机器学习 · 计算机科学 2024-03-12 Yingtian Zou , Kenji Kawaguchi , Yingnan Liu , Jiashuo Liu , Mong-Li Lee , Wynne Hsu

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Open-world machine learning (ML) combines closed-world models trained on in-distribution data with out-of-distribution (OOD) detectors, which aim to detect and reject OOD inputs. Previous works on open-world ML systems usually fail to test…

机器学习 · 计算机科学 2020-07-10 Liwei Song , Vikash Sehwag , Arjun Nitin Bhagoji , Prateek Mittal

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Machine learning (ML) systems often encounter Out-of-Distribution (OoD) errors when dealing with testing data coming from a distribution different from training data. It becomes important for ML systems in critical applications to…

机器学习 · 计算机科学 2020-06-12 Randy Ardywibowo , Shahin Boluki , Xinyu Gong , Zhangyang Wang , Xiaoning Qian

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

机器学习 · 计算机科学 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Regression evaluation has been performed for decades. Some metrics have been identified to be robust against shifting and scaling of the data but considering the different distributions of data is much more difficult to address (imbalance…

机器学习 · 计算机科学 2020-09-14 Mario Michael Krell , Bilal Wehbe

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

机器学习 · 计算机科学 2025-04-04 Litian Liu , Yao Qin

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

机器学习 · 计算机科学 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

In real-world material research, machine learning (ML) models are usually expected to predict and discover novel exceptional materials that deviate from the known materials. It is thus a pressing question to provide an objective evaluation…

材料科学 · 物理学 2024-01-17 Sadman Sadeed Omee , Nihang Fu , Rongzhi Dong , Ming Hu , Jianjun Hu

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

Modern manufacturing relies heavily on fusion welding processes, including gas metal arc welding (GMAW). Despite significant advances in machine learning-based quality prediction, current models exhibit critical limitations when confronted…

机器学习 · 计算机科学 2026-02-18 Yannik Hahn , Jan Voets , Antonin Koenigsfeld , Hasan Tercan , Tobias Meisen

Climate change is accelerating the frequency and severity of unprecedented events, deviating from established patterns. Predicting these out-of-distribution (OOD) events is critical for assessing risks and guiding climate adaptation. While…

机器学习 · 计算机科学 2025-09-16 Maria Conchita Agana Navarro , Geng Li , Theo Wolf , María Pérez-Ortiz