English
Related papers

Related papers: Implicit Delta Learning of High Fidelity Neural Ne…

200 papers

Despite remarkable successes in solving various complex decision-making tasks, training an imitation learning (IL) algorithm with deep neural networks (DNNs) suffers from the high computation burden. In this work, we propose quantum…

Quantum Physics · Physics 2023-04-06 Zhihao Cheng , Kaining Zhang , Li Shen , Dacheng Tao

The contribution of nuclear quantum effects (NQEs) to the properties of various hydrogen-bound systems, including biomolecules, is increasingly recognized. Despite the development of many acceleration techniques, the computational overhead…

Chemical Physics · Physics 2024-07-08 Iryna Zaporozhets , Félix Musil , Venkat Kapil , Cecilia Clementi

We propose the use of incomplete dot products (IDP) to dynamically adjust the number of input channels used in each layer of a convolutional neural network during feedforward inference. IDP adds monotonically non-increasing coefficients,…

Machine Learning · Computer Science 2017-10-25 Bradley McDanel , Surat Teerapittayanon , H. T. Kung

The capability of making interpretable and self-explanatory decisions is essential for developing responsible machine learning systems. In this work, we study the learning to explain problem in the scope of inductive logic programming…

Artificial Intelligence · Computer Science 2020-02-20 Yuan Yang , Le Song

Although deep learning models have driven state-of-the-art performance on a wide array of tasks, they are prone to spurious correlations that should not be learned as predictive clues. To mitigate this problem, we propose a causality-based…

Machine Learning · Computer Science 2021-10-27 Xinyi Wang , Wenhu Chen , Michael Saxon , William Yang Wang

Efficient materials discovery requires reducing costly first-principles calculations for training machine-learned interatomic potentials (MLIPs). We develop an active learning (AL) framework that iteratively selects informative structures…

Machine Learning · Computer Science 2026-01-22 Mohammed Azeez Khan , Aaron D'Souza , Vijay Choyal

Knowledge distillation (KD) is one of the most useful techniques for light-weight neural networks. Although neural networks have a clear purpose of embedding datasets into the low-dimensional space, the existing knowledge was quite far from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Seunghyun Lee , Byung Cheol Song

Simulations at the atomic scale provide a direct and effective way to understand the mechanical properties of materials. In the regime of classical mechanics, simulations for the thermodynamic properties of metals and alloys can be done by…

Computational Physics · Physics 2019-11-05 Ka-Ming Tam , Nicholas Walker , Samuel Kellar , Mark Jarrell

Modern deep neural networks increasingly make use of features such as dynamic control flow, data structures and dynamic tensor shapes. Existing deep learning systems focus on optimizing and executing static neural networks which assume a…

Programming Languages · Computer Science 2021-03-15 Haichen Shen , Jared Roesch , Zhi Chen , Wei Chen , Yong Wu , Mu Li , Vin Sharma , Zachary Tatlock , Yida Wang

In Markov decision processes (MDPs), quantile risk measures such as Value-at-Risk are a standard metric for modeling RL agents' preferences for certain outcomes. This paper proposes a new Q-learning algorithm for quantile optimization in…

Machine Learning · Computer Science 2024-11-01 Jia Lin Hau , Erick Delage , Esther Derman , Mohammad Ghavamzadeh , Marek Petrik

The computational discovery and design of zeolites is a crucial part of the chemical industry. Finding highly accurate while computationally feasible protocol for identification of hypothetical zeolites that could be targeted experimentally…

Materials Science · Physics 2022-08-22 Andreas Erlebach , Petr Nachtigall , Lukáš Grajciar

``$\Delta$-machine learning" refers to a machine learning approach to bring a property such as a potential energy surface (PES) based on low-level (LL) density functional theory (DFT) energies and gradients to close to a coupled cluster…

Chemical Physics · Physics 2021-05-21 Apurba Nandi , Chen Qu , Paul Houston , Riccardo Conte , Joel M. Bowman

Many applications, such as in physical simulation and engineering design, demand we estimate functions with high-dimensional outputs. The training examples can be collected with different fidelities to allow a cost/accuracy trade-off. In…

Machine Learning · Computer Science 2021-10-27 Shibo Li , Robert M. Kirby , Shandian Zhe

Machine learning potentials have emerged as a powerful tool to extend the time and length scales of first principles-quality simulations. Still, most machine learning potentials cannot distinguish different electronic spin orientations and…

Computational Physics · Physics 2022-01-25 Marco Eckhoff , Jörg Behler

Machine learning interatomic potentials (MLIPs) with broad chemical flexibility are important for atomistic simulations of compositionally complex materials such as high-entropy alloys. Here, we study two state-of-the-art MLIP frameworks,…

Materials Science · Physics 2026-04-06 Fei Shuang , Penghua Ying , Kai Liu , Zixiong Wei , Fengxian Liu , Zheyong Fan , Minqiang Jiang , Poulumi Dey

Crafting neural-network interatomic potentials (NNIPs) remains a complex task, demanding specialized expertise in both machine learning and electronic-structure calculations. Here, we introduce AiiDA-TrainsPot, an automated, open-source,…

Computational Physics · Physics 2026-05-08 Davide Bidoggia , Nataliia Manko , Maria Peressi , Antimo Marrazzo

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

Machine Learning · Computer Science 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Chemically accurate and comprehensive studies of the virtual space of all possible molecules are severely limited by the computational cost of quantum chemistry. We introduce a composite strategy that adds machine learning corrections to…

Chemical Physics · Physics 2023-04-14 Raghunathan Ramakrishnan , Pavlo O. Dral , Matthias Rupp , O. Anatole von Lilienfeld

Although deep learning (DL) has already become a state-of-the-art technology for various data processing tasks, data security and computational overload problems often arise due to their high data and computational power dependency. To…

Quantum Physics · Physics 2022-04-08 Yunseok Kwak , Won Joon Yun , Jae Pyoung Kim , Hyunhee Cho , Minseok Choi , Soyi Jung , Joongheon Kim

Molecular dynamics simulations are an important tool for describing the evolution of a chemical system with time. However, these simulations are inherently held back either by the prohibitive cost of accurate electronic structure theory…

Chemical Physics · Physics 2018-12-20 Michael Gastegger , Philipp Marquetand