English
Related papers

Related papers: Distributionally Robust Graph Out-of-Distribution …

200 papers

Graph Out-of-Distribution (OOD) detection aims to identify whether a test graph deviates from the distribution of graphs observed during training, which is critical for ensuring the reliability of Graph Neural Networks (GNNs) when deployed…

Machine Learning · Computer Science 2026-02-20 Luzhi Wang , Xuanshuo Fu , He Zhang , Chuang Liu , Xiaobao Wang , Hongbo Liu

Graph neural networks have shown remarkable success in exploiting the spatial and temporal patterns on dynamic graphs. However, existing GNNs exhibit poor generalization ability under distribution shifts, which is inevitable in dynamic…

Machine Learning · Computer Science 2025-11-25 Qingyun Sun , Jiayi Luo , Haonan Yuan , Xingcheng Fu , Hao Peng , Jianxin Li , Philip S. Yu

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

Machine Learning · Statistics 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

Diffusion models have become a leading paradigm in generative AI, with score estimation via denoising score matching as a central component. While recent theory provides strong statistical guarantees, it typically relies on…

Machine Learning · Computer Science 2026-04-21 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

Recently, a special case of precision matrix estimation based on a distributionally robust optimization (DRO) framework has been shown to be equivalent to the graphical lasso. From this formulation, a method for choosing the regularization…

Methodology · Statistics 2022-06-10 Chau Tran , Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

Machine Learning · Computer Science 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

As machine learning models are deployed ever more broadly, it becomes increasingly important that they are not only able to perform well on their training distribution, but also yield accurate predictions when confronted with distribution…

Machine Learning · Computer Science 2022-04-14 Paul Michel , Tatsunori Hashimoto , Graham Neubig

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Performative prediction aims to model scenarios where predictive outcomes subsequently influence the very systems they target. The pursuit of a performative optimum (PO) -- minimizing performative risk -- is generally reliant on modeling of…

Machine Learning · Computer Science 2025-02-11 Songkai Xue , Yuekai Sun

Detecting out-of-distribution (OOD) graphs is crucial for ensuring the safety and reliability of Graph Neural Networks. In unsupervised graph-level OOD detection, models are typically trained using only in-distribution (ID) data, resulting…

Machine Learning · Computer Science 2026-03-03 Li Sun , Lanxu Yang , Jiayu Tian , Bowen Fang , Xiaoyan Yu , Junda Ye , Peng Tang , Hao Peng , Philip S. Yu

Graph Neural Network(GNN) based social recommendation models improve the prediction accuracy of user preference by leveraging GNN in exploiting preference similarity contained in social relations. However, in terms of both effectiveness and…

Information Retrieval · Computer Science 2023-03-16 Yuhan Quan , Jingtao Ding , Chen Gao , Lingling Yi , Depeng Jin , Yong Li

Robust generalization aims to tackle the most challenging data distributions which are rare in the training set and contain severe noises, i.e., photon-limited corruptions. Common solutions such as distributionally robust optimization (DRO)…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zhuo Huang , Miaoxi Zhu , Xiaobo Xia , Li Shen , Jun Yu , Chen Gong , Bo Han , Bo Du , Tongliang Liu

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Recommender systems play an essential role in online services by providing personalized item lists to support users' decision-making processes. While collaborative filtering methods can achieve high accuracy, it is crucial to consider not…

Optimization and Control · Mathematics 2026-03-24 Tomoya Yanagi , Shunnosuke Ikeda , Ken Kobayashi , Yuichi Takano

Topology design is a critical task for the reliability, economic operation, and resilience of distribution systems. This paper proposes a distributionally robust optimization (DRO) model for designing the topology of a new distribution…

Optimization and Control · Mathematics 2018-08-29 Sadra Babaei , Ruiwei Jiang , Chaoyue Zhao

Large-scale datasets may contain significant proportions of noisy (incorrect) class labels, and it is well-known that modern deep neural networks (DNNs) poorly generalize from such noisy training datasets. To mitigate the issue, we propose…

Machine Learning · Statistics 2019-05-15 Kimin Lee , Sukmin Yun , Kibok Lee , Honglak Lee , Bo Li , Jinwoo Shin

Graph Neural Network (GNN) has demonstrated extraordinary performance in classifying graph properties. However, due to the selection bias of training and testing data (e.g., training on small graphs and testing on large graphs, or training…

Machine Learning · Computer Science 2023-08-17 Bin Lu , Xiaoying Gan , Ze Zhao , Shiyu Liang , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

Machine Learning · Computer Science 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung

Machine learning models struggle with generalization when encountering out-of-distribution (OOD) samples with unexpected distribution shifts. For vision tasks, recent studies have shown that test-time adaptation employing diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yun-Yun Tsai , Fu-Chen Chen , Albert Y. C. Chen , Junfeng Yang , Che-Chun Su , Min Sun , Cheng-Hao Kuo

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

Machine Learning · Computer Science 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding