English
Related papers

Related papers: Generalizable Machine Learning in Neuroscience usi…

200 papers

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

Machine Learning · Computer Science 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

We introduce a convolutional neural network that operates directly on graphs. These networks allow end-to-end learning of prediction pipelines whose inputs are graphs of arbitrary size and shape. The architecture we present generalizes…

Deep learning's success has been widely recognized in a variety of machine learning tasks, including image classification, audio recognition, and natural language processing. As an extension of deep learning beyond these domains, graph…

Machine Learning · Computer Science 2021-07-22 Zhiqian Chen , Fanglan Chen , Lei Zhang , Taoran Ji , Kaiqun Fu , Liang Zhao , Feng Chen , Lingfei Wu , Charu Aggarwal , Chang-Tien Lu

Molecular activity prediction is critical in drug design. Machine learning techniques such as kernel methods and random forests have been successful for this task. These models require fixed-size feature vectors as input while the molecules…

Machine Learning · Computer Science 2018-01-30 Trang Pham , Truyen Tran , Svetha Venkatesh

This extended abstract describes a framework for analyzing the expressiveness, learning, and (structural) generalization of hypergraph neural networks (HyperGNNs). Specifically, we focus on how HyperGNNs can learn from finite datasets and…

Machine Learning · Computer Science 2023-03-10 Zhezheng Luo , Jiayuan Mao , Joshua B. Tenenbaum , Leslie Pack Kaelbling

Graph neural networks (GNNs) demonstrate outstanding performance in a broad range of applications. While the majority of GNN applications assume that a graph structure is given, some recent methods substantially expanded the applicability…

Graph Neural Networks (GNNs) have received considerable attention since its introduction. It has been widely applied in various fields due to its ability to represent graph structured data. However, the application of GNNs is constrained by…

Neurons and Cognition · Quantitative Biology 2023-09-20 Yihan Wu , Tao Chang , Peng Xu , Yangsong Zhang

Various machine learning models have been used to predict the properties of polycrystalline materials, but none of them directly consider the physical interactions among neighboring grains despite such microscopic interactions critically…

Materials Science · Physics 2021-07-16 Minyi Dai , Mehmet F. Demirel , Yingyu Liang , Jia-Mian Hu

Graph neural networks, trained on experimental or calculated data are becoming an increasingly important tool in computational materials science. Networks, once trained, are able to make highly accurate predictions at a fraction of the cost…

Materials Science · Physics 2024-06-19 Johannes Allotey , Keith T. Butler , Jeyan Thiyagalingam

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Graph structures are ubiquitous throughout the natural sciences. Here we consider graph-structured quantum data and describe how to carry out its quantum machine learning via quantum neural networks. In particular, we consider training data…

Quantum Physics · Physics 2021-03-22 Kerstin Beer , Megha Khosla , Julius Köhler , Tobias J. Osborne

Graph neural networks are widely used tools for graph prediction tasks. Motivated by their empirical performance, prior works have developed generalization bounds for graph neural networks, which scale with graph structures in terms of the…

Machine Learning · Computer Science 2023-10-25 Haotian Ju , Dongyue Li , Aneesh Sharma , Hongyang R. Zhang

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Neural networks have succeeded in many reasoning tasks. Empirically, these tasks require specialized network structures, e.g., Graph Neural Networks (GNNs) perform well on many such tasks, but less structured networks fail. Theoretically,…

Machine Learning · Computer Science 2020-02-18 Keyulu Xu , Jingling Li , Mozhi Zhang , Simon S. Du , Ken-ichi Kawarabayashi , Stefanie Jegelka

Graph Neural Networks (GNNs), which aggregate features from neighbors, are widely used for graph-structured data processing due to their powerful representation learning capabilities. It is generally believed that GNNs can implicitly remove…

Machine Learning · Computer Science 2022-09-30 Songtao Liu , Rex Ying , Hanze Dong , Lu Lin , Jinghui Chen , Dinghao Wu

Scaling deep learning models has been at the heart of recent revolutions in language modelling and image generation. Practitioners have observed a strong relationship between model size, dataset size, and performance. However,…

While the celebrated graph neural networks yield effective representations for individual nodes of a graph, there has been relatively less success in extending to the task of graph similarity learning. Recent work on graph similarity…

Machine Learning · Computer Science 2021-08-20 Xiang Ling , Lingfei Wu , Saizhuo Wang , Tengfei Ma , Fangli Xu , Alex X. Liu , Chunming Wu , Shouling Ji

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph neural networks (GNNs) have become increasingly popular for classification tasks on graph-structured data. Yet, the interplay between graph topology and feature evolution in GNNs is not well understood. In this paper, we focus on…

Machine Learning · Computer Science 2023-10-27 Vignesh Kothapalli , Tom Tirer , Joan Bruna