English
Related papers

Related papers: Graph Neural Network Expressivity and Meta-Learnin…

200 papers

Graph-based neural network models are gaining traction in the field of representation learning due to their ability to uncover latent topological relationships between entities that are otherwise challenging to identify. These models have…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Aryan Singh , Pepijn Van de Ven , Ciarán Eising , Patrick Denny

Message passing neural networks (MPNNs) have become a dominant flavor of graph neural networks (GNNs) in recent years. Yet, MPNNs come with notable limitations; namely, they are at most as powerful as the 1-dimensional Weisfeiler-Leman…

Machine Learning · Computer Science 2022-11-04 Lingxiao Zhao , Louis Härtel , Neil Shah , Leman Akoglu

Although recent advances in higher-order Graph Neural Networks (GNNs) improve the theoretical expressiveness and molecular property predictive performance, they often fall short of the empirical performance of models that explicitly use…

Machine Learning · Computer Science 2024-07-26 Tom Wollschläger , Niklas Kemper , Leon Hetzel , Johanna Sommer , Stephan Günnemann

While Graph Neural Networks (GNNs) recently became powerful tools in graph learning tasks, considerable efforts have been spent on improving GNNs' structural encoding ability. A particular line of work proposed subgraph GNNs that use…

Machine Learning · Computer Science 2023-10-31 Lecheng Kong , Jiarui Feng , Hao Liu , Dacheng Tao , Yixin Chen , Muhan Zhang

Meta-learning, i.e., "learning to learn", is a promising approach to enable efficient BCI classifier training with limited amounts of data. It can effectively use collections of in some way similar classification tasks, with rapid…

Machine Learning · Computer Science 2025-01-22 Daniil A. Berdyshev , Artem M. Grachev , Sergei L. Shishkin , Bogdan L. Kozyrskiy

Graph Neural Networks (GNNs) have become a standard approach for learning from graph-structured data. However, their reliance on parametric classifiers (most often linear softmax layers) limits interpretability and sometimes hinders…

Machine Learning · Computer Science 2026-02-03 Zeljko Bolevic , Milos Brajovic , Isidora Stankovic , Ljubisa Stankovic

Building in silico models to predict chemical properties and activities is a crucial step in drug discovery. However, limited labeled data often hinders the application of deep learning in this setting. Meanwhile advances in meta-learning…

Machine Learning · Computer Science 2020-07-21 Cuong Q. Nguyen , Constantine Kreatsoulas , Kim M. Branson

Modeling molecular potential energy surface is of pivotal importance in science. Graph Neural Networks have shown great success in this field. However, their message passing schemes need special designs to capture geometric information and…

Machine Learning · Computer Science 2023-04-24 Xiyuan Wang , Muhan Zhang

Symbolic regression is a powerful technique that can discover analytical equations that describe data, which can lead to explainable models and generalizability outside of the training data set. In contrast, neural networks have achieved…

Machine Learning · Computer Science 2022-03-10 Samuel Kim , Peter Y. Lu , Srijon Mukherjee , Michael Gilbert , Li Jing , Vladimir Čeperić , Marin Soljačić

Meta-learning is widely used in few-shot classification and function regression due to its ability to quickly adapt to unseen tasks. However, it has not yet been well explored on regression tasks with high dimensional inputs such as images.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Ning Gao , Hanna Ziesche , Ngo Anh Vien , Michael Volpp , Gerhard Neumann

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

The first provably efficient algorithm for learning graph neural networks (GNNs) with one hidden layer for node information convolution is provided in this paper. Two types of GNNs are investigated, depending on whether labels are attached…

Machine Learning · Computer Science 2020-12-08 Qunwei Li , Shaofeng Zou , Wenliang Zhong

Molecular property calculations are the bedrock of chemical physics. High-fidelity \textit{ab initio} modeling techniques for computing the molecular properties can be prohibitively expensive, and motivate the development of…

Machine Learning · Computer Science 2022-11-28 Hatem Helal , Jesun Firoz , Jenna Bilbrey , Mario Michael Krell , Tom Murray , Ang Li , Sotiris Xantheas , Sutanay Choudhury

Graph Neural Networks (GNNs) are deep learning models that take graph data as inputs, and they are applied to various tasks such as traffic prediction and molecular property prediction. However, owing to the complexity of the GNNs, it has…

Machine Learning · Computer Science 2021-11-02 Tetsu Kasanishi , Xueting Wang , Toshihiko Yamasaki

Deep neural networks (DNNs) have been used to create models for many complex analysis problems like image recognition and medical diagnosis. DNNs are a popular tool within machine learning due to their ability to model complex patterns and…

Machine Learning · Computer Science 2024-05-14 Parth Patil , Ben Boardley , Jack Gardner , Emily Loiselle , Deerajkumar Parthipan

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they…

Machine Learning · Computer Science 2017-08-17 Ruoyu Li , Junzhou Huang

Rule learning is critical to improving knowledge graph (KG) reasoning due to their ability to provide logical and interpretable explanations. Recently, Graph Neural Networks (GNNs) with tail entity scoring achieve the state-of-the-art…

Machine Learning · Computer Science 2024-04-11 Haiquan Qiu , Yongqi Zhang , Yong Li , Quanming Yao

The growing adoption of Graph Neural Networks (GNNs) in high-stakes domains like healthcare and finance demands reliable explanations of their decision-making processes. While inherently interpretable GNN architectures like Graph…

Machine Learning · Computer Science 2025-05-27 Rishabh Bhattacharya , Hari Shankar , Vaishnavi Shivkumar , Ponnurangam Kumaraguru