English
Related papers

Related papers: Exascale Multi-Task Graph Foundation Models for Im…

200 papers

Deep learning (DL) workflows demand an ever-increasing budget of compute and energy in order to achieve outsized gains. Neural architecture searches, hyperparameter sweeps, and rapid prototyping consume immense resources that can prevent…

Graph-based neural networks and, specifically, message-passing neural networks (MPNNs) have shown great potential in predicting physical properties of solids. In this work, we train an MPNN to first classify materials through density…

Computational Physics · Physics 2023-09-13 Tim Bechtel , Daniel T. Speckhard , Jonathan Godwin , Claudia Draxl

Graph Neural Networks (GNNs) have become popular across a diverse set of tasks in exploring structural relationships between entities. However, due to the highly connected structure of the datasets, distributed training of GNNs on…

Machine Learning · Computer Science 2025-09-08 Arefin Niam , Tevfik Kosar , M S Q Zulkar Nine

This study presents a deep learning approach to predicting structural and electronic properties of materials using Graph Neural Networks (GNNs). Leveraging data from the Materials Project database, we construct graph representations of…

Disordered Systems and Neural Networks · Physics 2024-12-20 Selva Chandrasekaran Selvaraj

We have characterized the structure of 176 different single-layer graphene grain boundaries using $>$1000 experimental HRTEM images using a semi-automated structure processing routine. We introduce a new algorithm for generating grain…

Materials Science · Physics 2015-08-04 Colin Ophus , Ashivni Shekhawat , Haider I Rasool , Alex Zettl

Experimental validation of chemical processes is slow and costly, limiting exploration in materials discovery. Machine learning can prioritize promising candidates, but existing data in patents and literature is heterogeneous and difficult…

Chemical Physics · Physics 2025-12-09 Mikhail Tsitsvero , Atsuyuki Nakao , Hisaki Ikebata

The atomistic modeling of amorphous materials requires structure sizes and sampling statistics that are challenging to achieve with first-principles methods. Here, we propose a methodology to speed up the sampling of amorphous and…

Disordered Systems and Neural Networks · Physics 2018-03-29 Nongnuch Artrith , Alexander Urban , Gerbrand Ceder

Light-matter dynamics in topological quantum materials enables ultralow-power, ultrafast devices. A challenge is simulating multiple field and particle equations for light, electrons, and atoms over vast spatiotemporal scales on Exaflop/s…

Foundation models have shown great promise in various fields of study. A potential application of such models is in computer network traffic analysis, where these models can grasp the complexities of network traffic dynamics and adapt to…

Machine Learning · Computer Science 2024-09-13 Louis Van Langendonck , Ismael Castell-Uroz , Pere Barlet-Ros

Applications of machine learning techniques in materials science are often based on two key ingredients, a set of empirical descriptors and a database of a particular material property of interest. The advent of graph neural networks, such…

Materials Science · Physics 2023-12-18 Xiang Zhang , Zichun Zhou , Chen Ming , Yi-Yang Sun

The inverse design of materials with specific desired properties, such as high-temperature superconductivity, represents a formidable challenge in materials science due to the vastness of chemical and structural space. We present a guided…

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu

Generative Flow Networks (GFlowNets) have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from rewards treated as unnormalized distributions. Previous works in this framework…

Machine Learning · Computer Science 2025-06-13 Mohit Pandey , Gopeshh Subbaraj , Artem Cherkasov , Martin Ester , Emmanuel Bengio

Large scale-free graphs are famously difficult to process efficiently: the skewed vertex degree distribution makes it difficult to obtain balanced partitioning. Our research instead aims to turn this into an advantage by partitioning the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-05 Scott Sallinen , Abdullah Gharaibeh , Matei Ripeanu

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

Machine Learning · Computer Science 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

Graph neural networks (GNNs) have emerged as a popular strategy for handling non-Euclidean data due to their state-of-the-art performance. However, most of the current GNN model designs mainly focus on task accuracy, lacking in considering…

Machine Learning · Computer Science 2023-04-14 Ao Zhou , Jianlei Yang , Yingjie Qi , Yumeng Shi , Tong Qiao , Weisheng Zhao , Chunming Hu

Domain Name System (DNS) tunneling remains a covert channel for data exfiltration and command-and-control communication. Although graph-based methods such as GraphTunnel achieve strong accuracy, they introduce significant latency and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Faraz Ali , Muhammad Afaq , Mahmood Niazi , Muzammil Behzad

We present exa-AMD, an open-source, high-performance framework designed for accelerated materials discovery on modern supercomputers. exa-AMD overcomes key computational bottlenecks in large-scale structure prediction through task-based…

Materials Science · Physics 2025-12-11 Weiyi Xia , Maxim Moraru , Ying Wai Li , Cai-Zhuang Wang

In biological tasks, data is rarely plentiful as it is generated from hard-to-gather measurements. Therefore, pre-training foundation models on large quantities of available data and then transfer to low-data downstream tasks is a promising…

Exascale computing delivers the raw power to simulate ever larger and more chemically realistic systems, but realizing this potential requires codes that can efficiently use thousands of processors. Our real-space multigrid (RMG) density…

Materials Science · Physics 2026-01-19 R. J. Morelock , S. Bagchi , E. L. Briggs , W. Lu , J. Bernholc , P. Ganesh