English
Related papers

Related papers: High-performance training and inference for deep e…

200 papers

Machine learning has been revolutionizing our world over the last few years and is also increasingly exploited in several areas of physics, including quantum dynamics and control.The need for a framework that brings together machine…

Quantum Physics · Physics 2025-01-31 Dimitris Koutromanos , Dionisis Stefanatos , Emmanuel Paspalakis

The development of machine learning models has led to an abundance of datasets containing quantum mechanical (QM) calculations for molecular and material systems. However, traditional training methods for machine learning models are unable…

In this work we present a new framework for neural networks compression with fine-tuning, which we called Neural Network Compression Framework (NNCF). It leverages recent advances of various network compression methods and implements some…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Alexander Kozlov , Ivan Lazarevich , Vasily Shamporov , Nikolay Lyalyushkin , Yury Gorbachev

Neural-network quantum molecular dynamics (NNQMD) simulations based on machine learning are revolutionizing atomistic simulations of materials by providing quantum-mechanical accuracy but orders-of-magnitude faster, illustrated by ACM…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-16 Hikaru Ibayashi , Taufeq Mohammed Razakh , Liqiu Yang , Thomas Linker , Marco Olguin , Shinnosuke Hattori , Ye Luo , Rajiv K. Kalia , Aiichiro Nakano , Ken-ichi Nomura , Priya Vashishta

Deep learning algorithms have made many breakthroughs and have various applications in real life. Computational resources become a bottleneck as the data and complexity of the deep learning pipeline increases. In this paper, we propose…

Machine Learning · Computer Science 2021-05-05 Salman Ahmed , Hammad Naveed

Computational high-throughput studies, especially in research on high-entropy materials and catalysts, are hampered by high-dimensional composition spaces and myriad structural microstates. They present bottlenecks to the conventional use…

Materials Science · Physics 2024-03-18 Christian M. Clausen , Jan Rossmeisl , Zachary W. Ulissi

Atomic-scale simulations have progressed tremendously over the past decade, largely due to the availability of machine-learning interatomic potentials. These potentials combine the accuracy of electronic structure calculations with the…

Simulating interactions between non-spherical colloidal particles is computationally challenging due to the complex dependency of forces and energies on their geometry. We introduce and evaluate both descriptor-based and end-to-end models…

Soft Condensed Matter · Physics 2025-09-22 B. Rusen Argun , Antonia Statt

In this research, we introduce an innovative three-network architecture that comprises an encoder-decoder framework with an attention mechanism. The architecture comprises a 1st-order-pre-trainer, a 2nd-order-improver, and a discriminator…

Computational Physics · Physics 2023-11-28 Jian-Nan Chen , Jun-Jie Zhang

GPUs have been favored for training deep learning models due to their highly parallelized architecture. As a result, most studies on training optimization focus on GPUs. There is often a trade-off, however, between cost and efficiency when…

Even though Bayesian neural networks offer a promising framework for modeling uncertainty, active learning and incorporating prior physical knowledge, few applications of them can be found in the context of interatomic force modeling. One…

Chemical Physics · Physics 2023-04-10 Tim Rensmeyer , Benjamin Craig , Denis Kramer , Oliver Niggemann

Machine learning has enabled the prediction of quantum chemical properties with high accuracy and efficiency, allowing to bypass computationally costly ab initio calculations. Instead of training on a fixed set of properties, more recent…

Foundation models for materials modeling are advancing quickly, but their training remains expensive, often placing state-of-the-art methods out of reach for many research groups. We introduce Nequix, a compact E(3)-equivariant potential…

Computational Physics · Physics 2025-10-10 Teddy Koker , Mit Kotak , Tess Smidt

Machine learned interatomic potentials, particularly equivariant message-passing (MP) models, have demonstrated high fidelity in representing first-principles data, revolutionizing computational studies in materials science, biophysics, and…

Chemical Physics · Physics 2025-09-01 Yaolong Zhang , Hua Guo

This work introduces a framework to address the computational complexity inherent in Mixed-Integer Programming (MIP) models by harnessing the potential of deep learning. By employing deep learning, we construct problem-specific heuristics…

Optimization and Control · Mathematics 2024-05-13 Niki Triantafyllou , Maria M. Papathanasiou

Machine learning methods have nowadays become easy-to-use tools for constructing high-dimensional interatomic potentials with ab initio accuracy. Although machine learned interatomic potentials are generally orders of magnitude faster than…

Computational Physics · Physics 2021-02-24 Yaolong Zhang , Ce Hu , Bin Jiang

Developing machine learning-based interatomic potentials from ab-initio electronic structure methods remains a challenging task for computational chemistry and materials science. This work studies the capability of transfer learning, in…

Computational Physics · Physics 2023-03-22 Viktor Zaverkin , David Holzmüller , Luca Bonfirraro , Johannes Kästner

Rapid progress in deep learning is leading to a diverse set of quickly changing models, with a dramatically growing demand for compute. However, as frameworks specialize performance optimization to patterns in popular networks, they…

Machine Learning · Computer Science 2022-08-31 Oliver Rausch , Tal Ben-Nun , Nikoli Dryden , Andrei Ivanov , Shigang Li , Torsten Hoefler

Crafting neural-network interatomic potentials (NNIPs) remains a complex task, demanding specialized expertise in both machine learning and electronic-structure calculations. Here, we introduce AiiDA-TrainsPot, an automated, open-source,…

Computational Physics · Physics 2026-05-08 Davide Bidoggia , Nataliia Manko , Maria Peressi , Antimo Marrazzo

Designing deep learning-based solutions is becoming a race for training deeper models with a greater number of layers. While a large-size deeper model could provide competitive accuracy, it creates a lot of logistical challenges and…