English
Related papers

Related papers: Deep learning of thermodynamic laws from microscop…

200 papers

The characterization of dynamical processes in living systems provides important clues for their mechanistic interpretation and link to biological functions. Thanks to recent advances in microscopy techniques, it is now possible to…

Data Analysis, Statistics and Probability · Physics 2023-11-29 Jesús Pineda , Benjamin Midtvedt , Harshith Bachimanchi , Sergio Noé , Daniel Midtvedt , Giovanni Volpe , Carlo Manzo

In the design of tensegrity structures, traditional form-finding methods utilize kinematic and static approaches to identify geometric configurations that achieve equilibrium. However, these methods often fall short when applied to actual…

Computational Engineering, Finance, and Science · Computer Science 2024-07-18 Muhao Chen , Jing Qin

Deep Neural Networks (DNNs) are analyzed via the theoretical framework of the information bottleneck (IB) principle. We first show that any DNN can be quantified by the mutual information between the layers and the input and output…

Machine Learning · Computer Science 2015-03-10 Naftali Tishby , Noga Zaslavsky

Deep neural networks (DNNs) transform stimuli across multiple processing stages to produce representations that can be used to solve complex tasks, such as object recognition in images. However, a full understanding of how they achieve this…

Neurons and Cognition · Quantitative Biology 2018-11-01 David G. T. Barrett , Ari S. Morcos , Jakob H. Macke

Deep neural networks (DNN) have shown great capacity of modeling a dynamical system; nevertheless, they usually do not obey physics constraints such as conservation laws. This paper proposes a new learning framework named ConCerNet to…

Machine Learning · Computer Science 2023-07-20 Wang Zhang , Tsui-Wei Weng , Subhro Das , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Neural Networks (GNNs) have revolutionized the molecular discovery to understand patterns and identify unknown features that can aid in predicting biophysical properties and protein-ligand interactions. However, current models typically…

Machine Learning · Computer Science 2022-12-21 Carter Knutson , Gihan Panapitiya , Rohith Varikoti , Neeraj Kumar

Virtually every organism gathers information about its noisy environment and builds models from that data, mostly using neural networks. Here, we use stochastic thermodynamics to analyse the learning of a classification rule by a neural…

Statistical Mechanics · Physics 2017-01-31 Sebastian Goldt , Udo Seifert

A hybrid approach, incorporating concepts of nonlinear dynamics in artificial neural networks (ANN), is proposed to model time series generated by complex dynamic systems. We introduce well known features used in the study of dynamic…

comp-gas · Physics 2008-02-03 D. R. Kulkarni , A. S. Pandya , J. C. Parikh

A thermodynamically motivated neural network model is described that self-organizes to transport charge associated with internal and external potentials while in contact with a thermal reservoir. The model integrates techniques for rapid,…

Neurons and Cognition · Quantitative Biology 2020-04-22 Todd Hylton

Despite the fact that our physical observations can often be described by derived physical laws, such as the wave equation, in many cases, we observe data that do not match the laws or have not been described physically yet. Therefore…

Geophysics · Physics 2023-09-26 Shijun Cheng , Tariq Alkhalifah

Simulation of the dynamics of physical systems is essential to the development of both science and engineering. Recently there is an increasing interest in learning to simulate the dynamics of physical systems using neural networks.…

Machine Learning · Computer Science 2022-01-31 Ce Yang , Weihao Gao , Di Wu , Chong Wang

This short note describes the concept of guided training of deep neural networks (DNNs) to learn physically reasonable solutions. DNNs are being widely used to predict phenomena in physics and mechanics. One of the issues of DNNs is that…

Machine Learning · Computer Science 2023-04-25 Kazuo Yonekura

Recent studies have shown that deep neural networks (DNNs) perform significantly better than shallow networks and Gaussian mixture models (GMMs) on large vocabulary speech recognition tasks. In this paper, we argue that the improved…

Machine Learning · Computer Science 2018-12-06 Dong Yu , Michael L. Seltzer , Jinyu Li , Jui-Ting Huang , Frank Seide

Inferring parameters of macro-kinetic growth models, typically represented by Ordinary Differential Equations (ODE), from the experimental data is a crucial step in bioprocess engineering. Conventionally, estimates of the parameters are…

Machine Learning · Computer Science 2023-12-07 Maxim Borisyak , Stefan Born , Peter Neubauer , Mariano Nicolas Cruz-Bournazou

Deep artificial neural networks are powerful tools with many possible applications in nanophotonics. Here, we demonstrate how a deep neural network can be used as a fast, general purpose predictor of the full near-field and far-field…

Computational Physics · Physics 2020-01-28 Peter R. Wiecha , Otto L. Muskens

Feed-forward neural networks (FNNs) work as standard building blocks in applying artificial intelligence (AI) to the physical world. They allow learning the dynamics of unknown physical systems (e.g., biological and chemical) {to predict…

Machine Learning · Computer Science 2022-06-23 Yu Wang , Qitong Gao , Miroslav Pajic

In this paper, we propose a deep learning based approach to design online power control policies for large EH networks, which are often intractable stochastic control problems. In the proposed approach, for a given EH network, the optimal…

Signal Processing · Electrical Eng. & Systems 2019-03-12 Mohit K Sharma , Alessio Zappone , Merouane Debbah , Mohamad Assaad

Machine learning techniques not only offer efficient tools for modelling dynamical systems from data, but can also be employed as frontline investigative instruments for the underlying physics. Nontrivial information about the original…

Data Analysis, Statistics and Probability · Physics 2021-02-24 Francesco Borra , Marco Baldovin

In recent years, Dynamic Graph (DG) representations have been increasingly used for modeling dynamic systems due to their ability to integrate both topological and temporal information in a compact representation. Dynamic graphs allow to…

Machine Learning · Computer Science 2023-04-13 Leshanshui Yang , Sébastien Adam , Clément Chatelain

It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition by showing that the features extracted by DNN coincide with…

Information Theory · Computer Science 2019-05-17 Shao-Lun Huang , Xiangxiang Xu , Lizhong Zheng , Gregory W. Wornell