中文
相关论文

相关论文: X-GGM: Graph Generative Modeling for Out-of-Distri…

200 篇论文

Graph Neural Networks (GNNs)-based recommendation algorithms typically assume that training and testing data are drawn from independent and identically distributed (IID) spaces. However, this assumption often fails in the presence of…

机器学习 · 计算机科学 2025-04-03 Chu Zhao , Enneng Yang , Yuliang Liang , Pengxiang Lan , Yuting Liu , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

机器学习 · 计算机科学 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

There is increasing evidence suggesting neural networks' sensitivity to distribution shifts, so that research on out-of-distribution (OOD) generalization comes into the spotlight. Nonetheless, current endeavors mostly focus on Euclidean…

机器学习 · 计算机科学 2024-08-19 Qitian Wu , Hengrui Zhang , Junchi Yan , David Wipf

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

信息论 · 计算机科学 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Pre-trained language models (PLMs) are known to improve the generalization performance of natural language understanding models by leveraging large amounts of data during the pre-training phase. However, the out-of-distribution (OOD)…

计算与语言 · 计算机科学 2023-05-23 Linyi Yang , Shuibai Zhang , Libo Qin , Yafu Li , Yidong Wang , Hanmeng Liu , Jindong Wang , Xing Xie , Yue Zhang

Deep neural networks (DNNs) have become a key part of many modern software applications. After training and validating, the DNN is deployed as an irrevocable component and applied in real-world scenarios. Although most DNNs are built…

机器学习 · 计算机科学 2021-03-31 JingWei Xu , Siyuan Zhu , Zenan Li , Chang Xu

Out-of-distribution (OOD) generalization remains a central challenge in deploying deep learning models to real-world scenarios, particularly in domains such as biomedical images, where distribution shifts are both subtle and pervasive.…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Haoran Pei , Yuguang Yang , Kexin Liu , Baochang Zhang

To deal with distribution shifts in graph data, various graph out-of-distribution (OOD) generalization techniques have been recently proposed. These methods often employ a two-step strategy that first creates augmented environments and…

机器学习 · 计算机科学 2025-01-09 Song Wang , Xiaodong Yang , Rashidul Islam , Huiyuan Chen , Minghua Xu , Jundong Li , Yiwei Cai

Existing methods for graph out-of-distribution (OOD) detection typically depend on training graph neural network (GNN) classifiers using a substantial amount of labeled in-distribution (ID) data. However, acquiring high-quality labeled…

机器学习 · 计算机科学 2025-03-31 Haoyan Xu , Zhengtao Yao , Yushun Dong , Ziyi Wang , Ryan A. Rossi , Mengyuan Li , Yue Zhao

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Haoyue Bai

Graph generation is a crucial task in many fields, including network science and bioinformatics, as it enables the creation of synthetic graphs that mimic the properties of real-world networks for various applications. Graph Generative…

机器学习 · 计算机科学 2026-01-21 Salvatore Romano , Marco Grassia , Giuseppe Mangioni

Visual Grounding (VG) in VQA refers to a model's proclivity to infer answers based on question-relevant image regions. Conceptually, VG identifies as an axiomatic requirement of the VQA task. In practice, however, DNN-based VQA models are…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Daniel Reich , Tanja Schultz

Out-Of-Distribution (OOD) generalization has gained increasing attentions for machine learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation under distribution shifts. Existing graph OOD methods tend to…

机器学习 · 计算机科学 2025-05-12 Henan Sun , Xunkai Li , Lei Zhu , Junyi Han , Guang Zeng , Ronghua Li , Guoren Wang

Deep generative models (DGMs) seem a natural fit for detecting out-of-distribution (OOD) inputs, but such models have been shown to assign higher probabilities or densities to OOD images than images from the training distribution. In this…

机器学习 · 计算机科学 2021-07-20 Lily H. Zhang , Mark Goldstein , Rajesh Ranganath

Graph Neural Networks (GNNs) are susceptible to distribution shifts, creating vulnerability and security issues in critical domains. There is a pressing need to enhance the generalizability of GNNs on out-of-distribution (OOD) test data.…

机器学习 · 计算机科学 2024-10-29 Xiaoxue Han , Huzefa Rangwala , Yue Ning

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Neural networks (NNs), despite their success and wide adoption, still struggle to extrapolate out-of-distribution (OOD), i.e., to inputs that are not well-represented by their training dataset. Addressing the OOD generalization gap is…

机器学习 · 计算机科学 2025-04-01 Robert R. Nerem , Samantha Chen , Sanjoy Dasgupta , Yusu Wang

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

机器学习 · 计算机科学 2025-02-04 Behrooz Montazeran , Ullrich Köthe