English
Related papers

Related papers: Physical networks become what they learn

200 papers

Network structure plays a critical role in functionality and performance of network systems. This paper examines structural adaptivity of diffusively coupled, directed multi-agent networks that are subject to diffusion performance. Inspired…

Systems and Control · Electrical Eng. & Systems 2022-08-30 Lulu Pan , Haibin Shao , Mehran Mesbahi , Dewei Li , Yugeng Xi

Learning network dynamics from the empirical structure and spatio-temporal observation data is crucial to revealing the interaction mechanisms of complex networks in a wide range of domains. However, most existing methods only aim at…

Machine Learning · Computer Science 2024-11-22 Jiaxu Cui , Bingyi Sun , Jiming Liu , Bo Yang

In machine learning, there is a fundamental trade-off between ease of optimization and expressive power. Neural Networks, in particular, have enormous expressive power and yet are notoriously challenging to train. The nature of that…

Machine Learning · Computer Science 2015-11-24 Diogo Almeida , Nate Sauder

Modeling the behavior of coupled networks is challenging due to their intricate dynamics. For example in neuroscience, it is of critical importance to understand the relationship between the functional neural processes and anatomical…

Machine Learning · Computer Science 2021-04-20 Hongyuan You , Sikun Lin , Ambuj K. Singh

This work introduces a methodology for studying synchronization in adaptive networks with heterogeneous plasticity (adaptation) rules. As a paradigmatic model, we consider a network of adaptively coupled phase oscillators with…

Dynamical Systems · Mathematics 2021-06-25 Rico Berner , Serhiy Yanchuk

We propose a hierarchically modular, dynamical neural network model whose architecture minimizes a specifically designed energy function and defines its temporal characteristics. The model has an internal and an external space that are…

Neurons and Cognition · Quantitative Biology 2026-04-16 Kazuyoshi Tsutsumi , Ernst Niebur

Active materials take advantage of their internal sources of energy to self-organize in an automated manner. This feature provides a novel opportunity to design micron-scale machines with minimal required control. However, self-organization…

Soft Condensed Matter · Physics 2021-01-22 Zijie Qu , Jialong Jiang , Heun Jin Lee , Rob Phillips , Shahriar Shadkhoo , Matt Thomson

We study the strategic formation of multi-layer networks, where each layer represents a different type of relationship between the nodes in the network and is designed to maximize some utility that depends on the topology of that layer and…

Computer Science and Game Theory · Computer Science 2015-10-29 Ebrahim Moradi Shahrivar , Shreyas Sundaram

The loss surface of deep neural networks has recently attracted interest in the optimization and machine learning communities as a prime example of high-dimensional non-convex problem. Some insights were recently gained using spin glass…

Machine Learning · Statistics 2017-06-05 C. Daniel Freeman , Joan Bruna

Brain network is remarkably cost-efficient while the fundamental physical and dynamical mechanisms underlying its economical optimization in network structure and activity are not clear. Here we study intricate cost-efficient interplay…

Biological Physics · Physics 2021-06-21 Junhao Liang , Sheng-Jun Wang , Changsong Zhou

We present results of numerical experiments for neural networks with stochastic gradient-based optimization with adaptive momentum. This widely applied optimization has proved convergence and practical efficiency, but for long-run training…

Machine Learning · Computer Science 2024-08-23 Igor V. Netay

In this paper, a new framework to study weighed networks is introduced. The idea behind this methodology is to consider that each node of the network is an agent that desires to satisfy his/her preferences in an economic sense. Moreover,…

Physics and Society · Physics 2009-11-11 Daniel O. Cajueiro

Elastic structures can be designed to exhibit precise, complex, and exotic functions. While recent work has focused on the quasistatic limit governed by force balance, the mechanics at a finite driving rate are governed by Newton's…

Soft Condensed Matter · Physics 2024-12-17 Marc Berneman , Daniel Hexner

The co-evolution of structure and dynamics, known as adaptivity, is a fundamental property in various systems and drives diverse emergent behaviors. However, the adaptivity in previous works is primarily stemmed from pairwise situations,…

Physics and Society · Physics 2025-08-22 Longzhao Liu , Hongwei Zheng , Zhihao Han , Xin Wang , Shaoting Tang

Neuroscience has focused on the detailed implementation of computation, studying neural codes, dynamics and circuits. In machine learning, however, artificial neural networks tend to eschew precisely designed codes, dynamics or circuits in…

Neurons and Cognition · Quantitative Biology 2020-02-04 Adam Marblestone , Greg Wayne , Konrad Kording

High connectivity and robustness are critical requirements in distributed networks, as they ensure resilience, efficient communication, and adaptability in dynamic environments. Additionally, optimizing energy consumption is also paramount…

Computational Physics · Physics 2024-12-09 Azra Seyyedi , Mahdi Bohlouli , SeyedEhsan Nedaaee Oskoee

We propose a scalable framework for the learning of high-dimensional parametric maps via adaptively constructed residual network (ResNet) maps between reduced bases of the inputs and outputs. When just few training data are available, it is…

Nematic polymeric networks are (heat and light) activable materials, which combine the features of rubber and nematic liquid crystals. When only the stretching energy of a thin sheet of nematic polymeric network is minimized, the intrinsic…

Soft Condensed Matter · Physics 2020-08-05 O. Ozenda , A. M. Sonnet , E. G. Virga

When learning to perform motor tasks in a simulated environment, neural networks must be allowed to explore their action space to discover new potentially viable solutions. However, in an online learning scenario with physical hardware,…

Machine Learning · Computer Science 2021-11-22 Cody Scharzenberger , Joe Hays

We propose a novel approach to model viscoelasticity materials using neural networks, which capture rate-dependent and nonlinear constitutive relations. However, inputs and outputs of the neural networks are not directly observable, and…

Numerical Analysis · Mathematics 2020-05-12 Kailai Xu , Alexandre M. Tartakovsky , Jeff Burghardt , Eric Darve