Related papers: Neural density functionals: Local learning and pai…
This paper investigates the use of extended Kalman filtering to train recurrent neural networks with rather general convex loss functions and regularization terms on the network parameters, including $\ell_1$-regularization. We show that…
We present a new time-dependent Density Functional approach to study the relaxational dynamics of an assembly of interacting particles subject to thermal noise. Starting from the Langevin stochastic equations of motion for the velocities of…
Globally normalized neural sequence models are considered superior to their locally normalized equivalents because they may ameliorate the effects of label bias. However, when considering high-capacity neural parametrizations that condition…
Density functional theory is the workhorse of modern electronic structure calculations, with wide-ranging applications in chemistry, physics, materials science, and machine learning. At its heart lies the exchange-correlation functional, a…
Density functional theory is one of the most efficient and widely used computational methods of quantum mechanics, especially in fields such as solid state physics and quantum chemistry. From the theoretical perspecive, its central object…
We discuss methods used in mean-field theories to treat pairing correlations within the local density approximation. Pairing renormalization and regularization procedures are compared in spherical and deformed nuclei. Both prescriptions…
I describe the foundation of a Density Functional Theory approach to include pairing correlations, which was applied to a variety of systems ranging from dilute fermions, to neutron stars and finite nuclei. Ground state properties as well…
This paper explores the connection between two recently identified phenomena in deep learning: plasticity loss and neural collapse. We analyze their correlation in different scenarios, revealing a significant association during the initial…
This paper seeks to answer the question: as the (near-) orthogonality of weights is found to be a favorable property for training deep convolutional neural networks, how can we enforce it in more effective and easy-to-use ways? We develop…
The strong correlation between neurons or filters can significantly weaken the generalization ability of neural networks. Inspired by the well-known Tammes problem, we propose a novel diversity regularization method to address this issue,…
In representation learning (RL), how to make the learned representations easy to interpret and less overfitted to training data are two important but challenging issues. To address these problems, we study a new type of regulariza- tion…
The effectiveness of deep neural architectures has been widely supported in terms of both experimental and foundational principles. There is also clear evidence that the activation function (e.g. the rectifier and the LSTM units) plays a…
The formally exact framework of equilibrium Density Functional Theory (DFT) is capable of simultaneously and consistently describing thermodynamic and structural properties of interacting many-body systems in arbitrary external potentials.…
We study functional activity in the human brain using functional Magnetic Resonance Imaging and recently developed tools from network science. The data arise from the performance of a simple behavioural motor learning task. Unsupervised…
In this work, a new functional is introduced to treat pairing correlations in finite many-body systems. Guided by the projected BCS framework, the energy is written as a functional of occupation numbers. It is shown to generalize the BCS…
Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…
Accurate treatment of the electronic correlation in inhomogeneous electronic systems, combined with the ability to capture the correlation energy of the homogeneous electron gas, allows to reach high predictive power in the application of…
Learning from data has led to a paradigm shift in computational materials science. In particular, it has been shown that neural networks can learn the potential energy surface and interatomic forces through examples, thus bypassing the…
This paper proposes to study neural networks through neuronal correlation, a statistical measure of correlated neuronal activity on the penultimate layer. We show that neuronal correlation can be efficiently estimated via weight matrix, can…
We analyze the localization properties of two-body correlations induced by pairing in the framework of relativistic mean field (RMF) models. The spatial properties of two-body correlations are studied for the pairing tensor in coordinate…