English
Related papers

Related papers: Parsimonious neural networks learn interpretable p…

200 papers

Recent research works for solving partial differential equations (PDEs) with deep neural networks (DNNs) have demonstrated that spatiotemporal function approximators defined by auto-differentiation are effective for approximating nonlinear…

Numerical Analysis · Mathematics 2021-09-21 Haoxiang Huang , Yingjie Liu , Vigor Yang

This short note describes the concept of guided training of deep neural networks (DNNs) to learn physically reasonable solutions. DNNs are being widely used to predict phenomena in physics and mechanics. One of the issues of DNNs is that…

Machine Learning · Computer Science 2023-04-25 Kazuo Yonekura

Tensor networks (TNs) and neural networks (NNs) are two fundamental data modeling approaches. TNs were introduced to solve the curse of dimensionality in large-scale tensors by converting an exponential number of dimensions to polynomial…

Machine Learning · Computer Science 2025-03-18 Maolin Wang , Yu Pan , Zenglin Xu , Guangxi Li , Xiangli Yang , Danilo Mandic , Andrzej Cichocki

We use machine learning (ML) to infer stress and plastic flow rules using data from repre- sentative polycrystalline simulations. In particular, we use so-called deep (multilayer) neural networks (NN) to represent the two response…

Computational Physics · Physics 2018-09-05 Reese E. Jones , Jeremy A. Templeton , Clay M. Sanders , Jakob T. Ostien

Modern sensing and metrology systems now stream terabytes of heterogeneous, high-dimensional (HD) data profiles, images, and dense point clouds, whose natural representation is multi-way tensors. Understanding such data requires regression…

Machine Learning · Computer Science 2025-10-08 Qian Wang , Mohammad N. Bisheh , Kamran Paynabar

Physics-Informed Neural Networks (PINNs) serve as a flexible alternative for tackling forward and inverse problems in differential equations, displaying impressive advancements in diverse areas of applied mathematics. Despite integrating…

Fluid Dynamics · Physics 2024-07-12 Shengfeng Xu , Chang Yan , Zhenxu Sun , Renfang Huang , Dilong Guo , Guowei Yang

Fast prediction of permeability directly from images enabled by image recognition neural networks is a novel pore-scale modeling method that has a great potential. This article presents a framework that includes (1) generation of porous…

Computational Physics · Physics 2018-09-11 Jin-Long Wu , Xiao-Long Yin , Heng Xiao

The rapidly increasing computational demands for artificial intelligence (AI) have spurred the exploration of computing principles beyond conventional digital computers. Physical neural networks (PNNs) offer efficient neuromorphic…

Quantum Neural Networks (QNNs), a prominent approach in Quantum Machine Learning (QML), are emerging as a powerful alternative to classical machine learning methods. Recent studies have focused on the applicability of QNNs to various tasks,…

Machine Learning · Computer Science 2025-07-01 Batuhan Hangun , Oguz Altun , Onder Eyecioglu

Feed-forward neural networks (FNNs) work as standard building blocks in applying artificial intelligence (AI) to the physical world. They allow learning the dynamics of unknown physical systems (e.g., biological and chemical) {to predict…

Machine Learning · Computer Science 2022-06-23 Yu Wang , Qitong Gao , Miroslav Pajic

We present an approach for using machine learning to automatically discover the governing equations and hidden properties of real physical systems from observations. We train a "graph neural network" to simulate the dynamics of our solar…

Earth and Planetary Astrophysics · Physics 2022-02-07 Pablo Lemos , Niall Jeffrey , Miles Cranmer , Shirley Ho , Peter Battaglia

Neural networks have provided powerful approaches to solve various scientific problems. Many of them are even difficult for human experts who are good at accessing the physical laws from experimental data. We investigate whether neural…

Earth and Planetary Astrophysics · Physics 2022-09-08 Jian Zhang , Yiming Liu , Z. C. Tu

Artificial neural networks (NNs) have become the de facto standard in machine learning. They allow learning highly nonlinear transformations in a plethora of applications. However, NNs usually only provide point estimates without…

Machine Learning · Statistics 2020-09-11 Marco F. Huber

The past few years have witnessed an increased interest in learning Hamiltonian dynamics in deep learning frameworks. As an inductive bias based on physical laws, Hamiltonian dynamics endow neural networks with accurate long-term…

Machine Learning · Computer Science 2022-03-02 Zhijie Chen , Mingquan Feng , Junchi Yan , Hongyuan Zha

Combining deep neural networks with structured logic rules is desirable to harness flexibility and reduce uninterpretability of the neural models. We propose a general framework capable of enhancing various types of neural networks (e.g.,…

Machine Learning · Computer Science 2020-08-11 Zhiting Hu , Xuezhe Ma , Zhengzhong Liu , Eduard Hovy , Eric Xing

In recent years, there have been a surge in applications of neural networks (NNs) in physical sciences. Although various algorithmic advances have been proposed, there are, thus far, limited number of studies that assess the…

Fluid Dynamics · Physics 2020-12-17 Kai Fukami , Romit Maulik , Nesar Ramachandra , Koji Fukagata , Kunihiko Taira

A neural network (NN) is a parameterised function that can be tuned via gradient descent to approximate a labelled collection of data with high precision. A Gaussian process (GP), on the other hand, is a probabilistic model that defines a…

Machine Learning · Computer Science 2018-07-05 Marta Garnelo , Jonathan Schwarz , Dan Rosenbaum , Fabio Viola , Danilo J. Rezende , S. M. Ali Eslami , Yee Whye Teh

Deep learning, computational neuroscience, and cognitive science have overlapping goals related to understanding intelligence such that perception and behaviour can be simulated in computational systems. In neuroimaging, machine learning…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Jessica A. F. Thompson , Yoshua Bengio , Elia Formisano , Marc Schönwiesner

Active learning, an iterative process of selecting the most informative data points for exploration, is crucial for efficient characterization of materials and chemicals property space. Neural networks excel at predicting these properties…

Disordered Systems and Neural Networks · Physics 2025-06-02 Sarah I. Allec , Maxim Ziatdinov

The spectacular results achieved in machine learning, including the recent advances in generative AI, rely on large data collections. On the opposite, intelligent processes in nature arises without the need for such collections, but simply…

Machine Learning · Computer Science 2024-02-12 Alessandro Betti , Marco Gori