English
Related papers

Related papers: Training speedups via batching for geometric learn…

200 papers

We present a simple dynamic batching approach applicable to a large class of dynamic architectures that consistently yields speedups of over 10x. We provide performance bounds when the architecture is not known a priori and a stronger bound…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Joseph Suarez , Clare Zhu

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

We study a recent class of models which uses graph neural networks (GNNs) to improve forecasting in multivariate time series. The core assumption behind these models is that there is a latent graph between the time series (nodes) that…

Graph Neural Networks (GNNs) have become the leading paradigm for learning on (static) graph-structured data. However, many real-world systems are dynamic in nature, since the graph and node/edge attributes change over time. In recent…

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However,…

Machine Learning · Computer Science 2022-04-19 Ke-jia Chen , Jiajun Zhang , Linpu Jiang , Yunyun Wang , Yuxuan Dai

Presently with technology node scaling, an accurate prediction model at early design stages can significantly reduce the design cycle. Especially during logic synthesis, predicting cell congestion due to improper logic combination can…

Machine Learning · Computer Science 2021-11-12 Amur Ghose , Vincent Zhang , Yingxue Zhang , Dong Li , Wulong Liu , Mark Coates

The recent advancements in graph neural networks (GNNs) have led to state-of-the-art performances in various applications, including chemo-informatics, question-answering systems, and recommender systems. However, scaling up these methods…

Machine Learning · Computer Science 2022-03-30 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Existing Graph Neural Network (GNN) training frameworks have been designed to help developers easily create performant GNN implementations. However, most existing GNN frameworks assume that the input graphs are static, but ignore that most…

Machine Learning · Computer Science 2023-12-06 Chaoyi Chen , Dechao Gao , Yanfeng Zhang , Qiange Wang , Zhenbo Fu , Xuecang Zhang , Junhua Zhu , Yu Gu , Ge Yu

Graphlet counting is an important problem as it has numerous applications in several fields, including social network analysis, biological network analysis, transaction network analysis, etc. Most of the practical networks are dynamic. A…

Data Structures and Algorithms · Computer Science 2023-08-29 Hriday G , Pranav Saikiran Sista , Apurba Das

Rapid advancements in machine learning (ML) are transforming materials science by significantly speeding up material property calculations. However, the proliferation of ML approaches has made it challenging for scientists to keep up with…

Machine Learning · Computer Science 2024-07-12 Ali Ramlaoui , Théo Saulus , Basile Terver , Victor Schmidt , David Rolnick , Fragkiskos D. Malliaros , Alexandre Duval

Molecular property calculations are the bedrock of chemical physics. High-fidelity \textit{ab initio} modeling techniques for computing the molecular properties can be prohibitively expensive, and motivate the development of…

Machine Learning · Computer Science 2022-11-28 Hatem Helal , Jesun Firoz , Jenna Bilbrey , Mario Michael Krell , Tom Murray , Ang Li , Sotiris Xantheas , Sutanay Choudhury

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph neural networks (GNNs) fuel diverse machine learning tasks involving graph-structured data, ranging from predicting protein structures to serving personalized recommendations. Real-world graph data must often be stored distributed…

Machine Learning · Computer Science 2024-02-13 Aashish Kolluri , Sarthak Choudhary , Bryan Hooi , Prateek Saxena

Artificial neural networks (NNs) are one of the most frequently used machine learning approaches to construct interatomic potentials and enable efficient large-scale atomistic simulations with almost ab initio accuracy. However, the…

Computational Physics · Physics 2021-10-05 Viktor Zaverkin , David Holzmüller , Ingo Steinwart , Johannes Kästner

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

Machine Learning · Computer Science 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

Graph matching is a commonly used technique in computer vision and pattern recognition. Recent data-driven approaches have improved the graph matching accuracy remarkably, whereas some traditional algorithm-based methods are more robust to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haoru Tan , Chuang Wang , Sitong Wu , Xu-Yao Zhang , Fei Yin , Cheng-Lin Liu

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

Graph Neural Networks (GNNs) have demonstrated outstanding performance in various applications. Existing frameworks utilize CPU-GPU heterogeneous environments to train GNN models and integrate mini-batch and sampling techniques to overcome…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-13 Xin Ai , Qiange Wang , Chunyu Cao , Yanfeng Zhang , Chaoyi Chen , Hao Yuan , Yu Gu , Ge Yu

Graph Neural Networks (GNNs) have emerged as powerful tools for supervised machine learning over graph-structured data, while sampling-based node representation learning is widely utilized in unsupervised learning. However, scalability…

Machine Learning · Computer Science 2024-07-23 Vipul Gupta , Xin Chen , Ruoyun Huang , Fanlong Meng , Jianjun Chen , Yujun Yan

Using graph neural networks for large graphs is challenging since there is no clear way of constructing mini-batches. To solve this, previous methods have relied on sampling or graph clustering. While these approaches often lead to good…

Machine Learning · Computer Science 2022-12-20 Johannes Gasteiger , Chendi Qian , Stephan Günnemann