Related papers: Extending the Accuracy of the SNAP Interatomic Pot…
We develop and compare four interatomic potentials for iron: a simple machine-learned embedded atom method (EAM) potential, a potential with machine-learned two- and three-body-dependent terms, a potential with machine-learned EAM and…
Recurrent neural networks (RNNs) are a class of neural networks that have emerged from the paradigm of artificial intelligence and has enabled lots of interesting advances in the field of natural language processing. Interestingly, these…
Non-negative signals form an important class of sparse signals. Many algorithms have already beenproposed to recover such non-negative representations, where greedy and convex relaxed algorithms are among the most popular methods. One fast…
Transformers have the representational capacity to simulate Massively Parallel Computation (MPC) algorithms, but they suffer from quadratic time complexity, which severely limits their scalability. We introduce an efficient attention…
While molecular dynamics (MD) is a very useful computational method for atomistic simulations, modeling the interatomic interactions for reliable MD simulations of real materials has been a long-standing challenge. In 2007, Behler and…
Attentive Neural Process (ANP) improves the fitting ability of Neural Process (NP) and improves its prediction accuracy, but the higher time complexity of the model imposes a limitation on the length of the input sequence. Inspired by…
Large-scale modern data often involves estimation and testing for high-dimensional unknown parameters. It is desirable to identify the sparse signals, ``the needles in the haystack'', with accuracy and false discovery control. However, the…
Large-scale computer simulations of chemical atoms are used in a wide range of applications, including batteries, drugs, and more. However, there is a problem with efficiency as it takes a long time due to the large amount of calculation.…
Traditional neuron models use analog values for information representation and computation, while all-or-nothing spikes are employed in the spiking ones. With a more brain-like processing paradigm, spiking neurons are more promising for…
Spiking neural networks (SNNs) have demonstrated significant potential in real-time multi-sensor perception tasks due to their event-driven and parameter-efficient characteristics. A key challenge is the timestep-wise iterative update of…
The superposition of atomic potentials (SAP) approach has recently been shown to be a simple and efficient way to initialize electronic structure calculations [S. Lehtola, J. Chem. Theory Comput. 15, 1593 (2019)]. Here, we study the…
Graph Neural Networks have achieved remarkable accuracy in semi-supervised node classification tasks. However, these results lack reliable uncertainty estimates. Conformal prediction methods provide a theoretical guarantee for node…
Large networks are becoming a widely used abstraction for studying complex systems in a broad set of disciplines, ranging from social network analysis to molecular biology and neuroscience. Despite an increasing need to analyze and…
Recently, deep learning has achieved huge successes in many important applications. In our previous studies, we proposed quadratic/second-order neurons and deep quadratic neural networks. In a quadratic neuron, the inner product of a vector…
Quantum Neural Networks (QNNs) offer a promising framework for integrating quantum computing principles into machine learning, yet their practical capabilities and limitations remain insufficiently studied. In this work, we systematically…
Neural network (NN) interatomic potentials provide fast prediction of potential energy surfaces, closely matching the accuracy of the electronic structure methods used to produce the training data. However, NN predictions are only reliable…
Interatomic potentials approximate the potential energy of atoms as a function of their coordinates. Their main application is the effective simulation of many-atom systems. Here, we review empirical interatomic potentials designed to…
The ability to learn continuously in artificial neural networks (ANNs) is often limited by catastrophic forgetting, a phenomenon in which new knowledge becomes dominant. By taking mechanisms of memory encoding in neuroscience (aka. engrams)…
A recently proposed technique is described that provides improved nearside-farside (NF) decompositions of elastic scattering amplitudes. The technique, involving a new resummation formula for Legendre partial wave series, reduces the…
A neural network is essentially a high-dimensional complex mapping model by adjusting network weights for feature fitting. However, the spectral bias in network training leads to unbearable training epochs for fitting the high-frequency…