English
Related papers

Related papers: Extensive deep neural networks for transferring sm…

200 papers

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

Machine Learning · Computer Science 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Deep neural networks (DNNs) are powerful tools for compressing and distilling information. Their scale and complexity, often involving billions of inter-dependent parameters, render direct microscopic analysis difficult. Under such…

Machine Learning · Statistics 2022-09-26 Inbar Seroussi , Gadi Naveh , Zohar Ringel

Graph neural networks (GNNs) are widely used for modelling graph-structured data in numerous applications. However, with their inherently finite aggregation layers, existing GNN models may not be able to effectively capture long-range…

Machine Learning · Computer Science 2022-02-23 Juncheng Liu , Kenji Kawaguchi , Bryan Hooi , Yiwei Wang , Xiaokui Xiao

The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Bichen Wu

Traditional textile factories consume substantial energy, making energy-efficient production optimization crucial for sustainability and cost reduction. Meanwhile, deep neural networks (DNNs), which are effective for factory output…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Yan-Chen Chen , Wei-Yu Chiu , Qun-Yu Wang , Jing-Wei Chen , Hao-Ting Zhao

A deep neural network (DNN) model consisting of two hidden layers was proposed for predicting the immediate environments of specific atoms based on X-ray absorption near-edge spectra (XANES). The output layer of the DNN can be adjusted to…

Computational Physics · Physics 2019-05-13 Liang Li , Mindren Lu , Maria K. Y. Chan

This work maps deep neural networks to classical Ising spin models, allowing them to be described using statistical thermodynamics. The density of states shows that structures emerge in the weights after they have been trained --…

Statistical Mechanics · Physics 2022-09-20 Dusan Stosic , Darko Stosic , Borko Stosic

Deep learning has delivered its powerfulness in many application domains, especially in image and speech recognition. As the backbone of deep learning, deep neural networks (DNNs) consist of multiple layers of various types with hundreds to…

Machine Learning · Computer Science 2017-12-14 Sheng Lin , Ning Liu , Mahdi Nazemi , Hongjia Li , Caiwen Ding , Yanzhi Wang , Massoud Pedram

Deep learning, as a highly efficient method for metasurface inverse design, commonly use simulation data to train deep neural networks (DNNs) that can map desired functionalities to proper metasurface designs. However, the assumptions and…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Jingxin Zhang , Jiawei Xi , Peixing Li , Ray C. C. Cheung , Alex M. H. Wong , Jensen Li

Graph neural networks (GNNs) have shown promise in learning the ground-state electronic properties of materials, subverting ab initio density functional theory (DFT) calculations when the underlying lattices can be represented as small…

Deep neural networks (DNNs) have been used to successfully predict molecular properties calculated based on the Kohn--Sham density functional theory (KS-DFT). Although this prediction is fast and accurate, we believe that a DNN model for…

Chemical Physics · Physics 2020-11-17 Masashi Tsubaki , Teruyasu Mizoguchi

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on…

The integration of density functional theory (DFT) with machine learning enables efficient \textit{ab initio} electronic structure calculations for ultra-large systems. In this work, we develop a transfer learning framework tailored for…

Materials Science · Physics 2025-01-23 Ting Bao , Ning Mao , Wenhui Duan , Yong Xu , Adrian Del Maestro , Yang Zhang

In this project, we present a deep neural network (DNN)-based biophysics model that uses multi-scale and uniform topological and electrostatic features to predict protein properties, such as Coulomb energies or solvation energies. The…

Machine Learning · Computer Science 2026-03-16 Elyssa Sliheet , Md Abu Talha , Weihua Geng

The presence of point defects such as vacancies plays an important role in material design. Here, we demonstrate that a graph neural network (GNN) model trained only on perfect materials can also be used to predict vacancy formation…

Materials Science · Physics 2024-02-19 Kamal Choudhary , Bobby G. Sumpter

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

We show that deep neural networks can be integrated into, or fully replace, the Kohn-Sham density functional theory scheme for multi-electron systems in simple harmonic oscillator and random external potentials with no feature engineering.…

Materials Science · Physics 2021-02-25 Kevin Ryczko , David Strubbe , Isaac Tamblyn

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Improving the predictive capability of molecular properties in ab initio simulations is essential for advanced material discovery. Despite recent progress making use of machine learning, utilizing deep neural networks to improve quantum…

Chemical Physics · Physics 2021-09-22 Muhammad F. Kasim , Sam M. Vinko