English
Related papers

Related papers: Out-of-distribution generalization for learning qu…

200 papers

Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from…

Machine Learning · Computer Science 2023-08-29 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

Machine Learning · Statistics 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

Computation and Language · Computer Science 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced…

Machine Learning · Computer Science 2022-02-21 Andre T. Nguyen , Fred Lu , Gary Lopez Munoz , Edward Raff , Charles Nicholas , James Holt

Quantum machine learning offers a transformative approach to solving complex problems, but the inherent noise hinders its practical implementation in near-term quantum devices. This obstacle makes it difficult to understand the…

Machine Learning · Computer Science 2025-02-05 Bikram Khanal , Pablo Rivas

Quantization lowers memory usage, computational requirements, and latency by utilizing fewer bits to represent model weights and activations. In this work, we investigate the generalization properties of quantized neural networks, a…

Generalized Zero-Shot Learning (GZSL) is a challenging task requiring accurate classification of both seen and unseen classes. Within this domain, Audio-visual GZSL emerges as an extremely exciting yet difficult task, given the inclusion of…

Multimedia · Computer Science 2025-09-15 Liuyuan Wen

Machine Learning (ML) has been widely applied across numerous domains due to its ability to automatically identify informative patterns from data for various tasks. The availability of large-scale data and advanced computational power…

Quantum computing has recently emerged as a transformative technology. Yet, its promised advantages rely on efficiently translating quantum operations into viable physical realizations. In this work, we use generative machine learning…

Quantum Physics · Physics 2024-05-22 Florian Fürrutter , Gorka Muñoz-Gil , Hans J. Briegel

Modern deep learning systems do not generalize well when the test data distribution is slightly different to the training data distribution. While much promising work has been accomplished to address this fragility, a systematic study of…

Quantum machine learning (QML) is an emerging field that investigates the capabilities of quantum computers for learning tasks. While QML models can theoretically offer advantages such as exponential speed-ups, challenges in data loading…

Quantum Physics · Physics 2025-11-03 Florian J. Kiwit , Bernhard Jobst , Andre Luckow , Frank Pollmann , Carlos A. Riofrío

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

Software Engineering · Computer Science 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

Neural networks are promising tools for high-throughput and accurate transmission electron microscopy (TEM) analysis of nanomaterials, but are known to generalize poorly on data that is "out-of-distribution" from their training data. Given…

Materials Science · Physics 2023-06-22 Katherine Sytwu , Luis Rangel DaCosta , Mary C. Scott

Leveraging the intrinsic probabilistic nature of quantum systems, generative quantum machine learning (QML) offers the potential to outperform classical learning models. Current generative QML algorithms mostly rely on general-purpose…

Quantum Physics · Physics 2025-05-06 Bence Bakó , Dániel T. R. Nagy , Péter Hága , Zsófia Kallus , Zoltán Zimborás

We study a worst-case scenario in generalization: Out-of-domain generalization from a single source. The goal is to learn a robust model from a single source and expect it to generalize over many unknown distributions. This challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Fengchun Qiao , Xi Peng

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Out-of-distribution (OOD) generalization is indispensable for learning models in the wild, where testing distribution typically unknown and different from the training. Recent methods derived from causality have shown great potential in…

Machine Learning · Computer Science 2024-05-13 Mengyue Yang , Zhen Fang , Yonggang Zhang , Yali Du , Furui Liu , Jean-Francois Ton , Jianhong Wang , Jun Wang

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers can degrade significantly and provide overly-confident, wrong…

Computation and Language · Computer Science 2023-03-09 Jie Ren , Jiaming Luo , Yao Zhao , Kundan Krishna , Mohammad Saleh , Balaji Lakshminarayanan , Peter J. Liu

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models operating in open-world scenarios. Current OOD detectors mainly rely on statistical models to identify unusual patterns in the latent…

Machine Learning · Computer Science 2025-06-06 Konstantin Kirchheim , Frank Ortmeier