English
Related papers

Related papers: Enhancing Size Generalization in Graph Neural Netw…

200 papers

Spatiotemporal activity prediction, aiming to predict user activities at a specific location and time, is crucial for applications like urban planning and mobile advertising. Existing solutions based on tensor decomposition or graph…

Machine Learning · Computer Science 2022-08-16 Yinfeng Li , Chen Gao , Quanming Yao , Tong Li , Depeng Jin , Yong Li

One of the biggest challenges for deep learning algorithms in medical image analysis is the indiscriminate mixing of image properties, e.g. artifacts and anatomy. These entangled image properties lead to a semantically redundant feature…

Machine Learning · Computer Science 2019-08-22 Qingjie Meng , Nick Pawlowski , Daniel Rueckert , Bernhard Kainz

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

How can we subsample graph data so that a graph neural network (GNN) trained on the subsample achieves performance comparable to training on the full dataset? This question is of fundamental interest, as smaller datasets reduce labeling…

Machine Learning · Computer Science 2025-02-25 Mika Sarkin Jain , Stefanie Jegelka , Ishani Karmarkar , Luana Ruiz , Ellen Vitercik

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Graph Neural Networks (GNNs) have achieved unprecedented success in identifying categorical labels of graphs. However, most existing graph classification problems with GNNs follow the protocol of balanced data splitting, which misaligns…

Machine Learning · Computer Science 2022-09-29 Yu Wang , Yuying Zhao , Neil Shah , Tyler Derr

Graph Neural Networks (GNNs) are a popular technique for modelling graph-structured data and computing node-level representations via aggregation of information from the neighborhood of each node. However, this aggregation implies an…

Machine Learning · Computer Science 2022-08-30 Ameya Daigavane , Gagan Madan , Aditya Sinha , Abhradeep Guha Thakurta , Gaurav Aggarwal , Prateek Jain

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Learning meaningful representations that disentangle the underlying structure of the data generating process is considered to be of key importance in machine learning. While disentangled representations were found to be useful for diverse…

Graph neural networks (GNNs) are naturally distributed architectures for learning representations from network data. This renders them suitable candidates for decentralized tasks. In these scenarios, the underlying graph often changes with…

Machine Learning · Computer Science 2022-08-31 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Graph representation of objects and their relations in a scene, known as a scene graph, provides a precise and discernible interface to manipulate a scene by modifying the nodes or the edges in the graph. Although existing works have shown…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Azade Farshad , Yousef Yeganeh , Helisa Dhamo , Federico Tombari , Nassir Navab

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Graph representation learning is to learn universal node representations that preserve both node attributes and structural information. The derived node representations can be used to serve various downstream tasks, such as node…

Machine Learning · Computer Science 2020-11-16 Yuxiang Ren , Bo Liu , Chao Huang , Peng Dai , Liefeng Bo , Jiawei Zhang

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Haiyang Lin , Mingyu Yan , Xiaochun Ye , Dongrui Fan , Shirui Pan , Wenguang Chen , Yuan Xie

The generalization ability of Convolutional neural networks (CNNs) for biometrics drops greatly due to the adverse effects of various occlusions. To this end, we propose a novel unified framework integrated the merits of both CNNs and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Min Ren , Yunlong Wang , Zhenan Sun , Tieniu Tan

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl