English
Related papers

Related papers: Learning on Graphs with Out-of-Distribution Nodes

200 papers

Graph Anomaly Detection (GAD) is a challenging and practical research topic where Graph Neural Networks (GNNs) have recently shown promising results. The effectiveness of existing GNNs in GAD has been mainly attributed to the simultaneous…

Machine Learning · Computer Science 2024-10-25 Jiashun Cheng , Zinan Zheng , Yang Liu , Jianheng Tang , Hongwei Wang , Yu Rong , Jia Li , Fugee Tsung

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

Machine Learning · Computer Science 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

Machine Learning · Computer Science 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

A large number of real-world networks include multiple types of nodes and edges. Graph Neural Network (GNN) emerged as a deep learning framework to generate node and graph embeddings for downstream machine learning tasks. However, popular…

Machine Learning · Computer Science 2024-11-26 Ziynet Nesibe Kesimoglu , Serdar Bozdag

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

Machine Learning · Computer Science 2021-04-13 Yang Ye , Shihao Ji

Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jiangpeng He , Fengqing Zhu

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

Machine Learning · Computer Science 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

Real data collected from different applications that have additional topological structures and connection information are amenable to be represented as a weighted graph. Considering the node labeling problem, Graph Neural Networks (GNNs)…

Social and Information Networks · Computer Science 2020-02-06 Xiaoxiao Li , Joao Saude

Since deep learning models have been implemented in many commercial applications, it is important to detect out-of-distribution (OOD) inputs correctly to maintain the performance of the models, ensure the quality of the collected data, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Qing Yu , Kiyoharu Aizawa

Graph neural networks (GNNs) have attracted much attention because of their excellent performance on tasks such as node classification. However, there is inadequate understanding on how and why GNNs work, especially for node representation…

Machine Learning · Computer Science 2020-06-09 Guoji Fu , Yifan Hou , Jian Zhang , Kaili Ma , Barakeel Fanseu Kamhoua , James Cheng

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

A neural network trained on a classification dataset often exhibits a higher vector norm of hidden layer features for in-distribution (ID) samples, while producing relatively lower norm values on unseen instances from out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Jaewoo Park , Jacky Chen Long Chai , Jaeho Yoon , Andrew Beng Jin Teoh

A key challenge in graph out-of-distribution (OOD) detection lies in the absence of ground-truth OOD samples during training. Existing methods are typically optimized to capture features within the in-distribution (ID) data and calculate…

Machine Learning · Computer Science 2025-11-25 Yue Hou , Ruomei Liu , Yingke Su , Junran Wu , Ke Xu

The lack of well-calibrated confidence estimates makes neural networks inadequate in safety-critical domains such as autonomous driving or healthcare. In these settings, having the ability to abstain from making a prediction on…

Machine Learning · Computer Science 2022-07-27 Adam Dziedzic , Stephan Rabanser , Mohammad Yaghini , Armin Ale , Murat A. Erdogdu , Nicolas Papernot

Deep neural networks (DNNs) perform well at classifying inputs associated with the classes they have been trained on, which are known as in distribution inputs. However, out-of-distribution (OOD) inputs pose a great challenge to DNNs and…

Machine Learning · Computer Science 2021-02-24 Guy Amit , Moshe Levy , Ishai Rosenberg , Asaf Shabtai , Yuval Elovici

Diagnosing and cleaning data is a crucial step for building robust machine learning systems. However, identifying problems within large-scale datasets with real-world distributions is challenging due to the presence of complex issues such…

Machine Learning · Computer Science 2023-10-31 Jang-Hyun Kim , Sangdoo Yun , Hyun Oh Song

Outliers are samples that are generated by different mechanisms from other normal data samples. Graphs, in particular social network graphs, may contain nodes and edges that are made by scammers, malicious programs or mistakenly by normal…

Social and Information Networks · Computer Science 2016-06-22 Honglei Zhang , Serkan Kiranyaz , Moncef Gabbouj

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

Machine Learning · Computer Science 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

While Graph Neural Networks (GNNs) have recently become the de facto standard for modeling relational data, they impose a strong assumption on the availability of the node or edge features of the graph. In many real-world applications,…

Machine Learning · Computer Science 2022-05-24 Emanuele Rossi , Henry Kenlay , Maria I. Gorinova , Benjamin Paul Chamberlain , Xiaowen Dong , Michael Bronstein

Graph classification is a challenging problem owing to the difficulty in quantifying the similarity between graphs or representing graphs as vectors, though there have been a few methods using graph kernels or graph neural networks (GNNs).…

Machine Learning · Computer Science 2024-08-22 Zixiao Wang , Jicong Fan