English
Related papers

Related papers: Learning Functions in Large Networks requires Modu…

200 papers

We characterize the connectivity structure of feed-forward, deep neural networks (DNNs) using network motif theory. To address whether a particular motif distribution is characteristic of the training task, or function of the DNN, we…

Machine Learning · Computer Science 2024-03-05 Olivia T. Zahn , Thomas L. Daniel , J. Nathan Kutz

Many networks are important because they are substrates for dynamical systems, and their pattern of functional connectivity can itself be dynamic -- they can functionally reorganize, even if their underlying anatomical structure remains…

Neurons and Cognition · Quantitative Biology 2010-04-21 Cosma Rohilla Shalizi , Marcelo F. Camperi , Kristina Lisa Klinkner

Studying the topology of so-called {\em real networks}, that is networks obtained from sociological or biological data for instance, has become a major field of interest in the last decade. One way to deal with it is to consider that…

Applications · Statistics 2010-11-23 Etienne Birmele

Topological features of gene regulatory networks can be successfully reproduced by a model population evolving under selection for short dynamical attractors. The evolved population of networks exhibit motif statistics, summarized by…

Molecular Networks · Quantitative Biology 2016-08-11 Burçin Danacı , Mehmet Ali Anıl , Ayşe Erzan

Spatio-temporal network dynamics is an emergent property of many complex systems which remains poorly understood. We suggest a new approach to its study based on the analysis of dynamical motifs -- small subnetworks with periodic and…

Disordered Systems and Neural Networks · Physics 2007-05-23 Valentin P. Zhigulin

Large Language Models (LLMs) have reshaped our world with significant advancements in science, engineering, and society through applications ranging from scientific discoveries and medical diagnostics to Chatbots. Despite their ubiquity and…

Artificial Intelligence · Computer Science 2025-08-26 Kushal Raj Bhandari , Pin-Yu Chen , Jianxi Gao

Detecting strong ties among users in social and information networks is a fundamental operation that can improve performance on a multitude of personalization and ranking tasks. Strong-tie edges are often readily obtained from the social…

Social and Information Networks · Computer Science 2017-03-28 Rahmtin Rotabi , Krishna Kamath , Jon Kleinberg , Aneesh Sharma

While advances in artificial intelligence and neuroscience have enabled the emergence of neural networks capable of learning a wide variety of tasks, our understanding of the temporal dynamics of these networks remains limited. Here, we…

Neurons and Cognition · Quantitative Biology 2023-11-13 Shi Gu , Marcelo G Mattar , Huajin Tang , Gang Pan

An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key factor to their superior empirical performance. To better…

Machine Learning · Computer Science 2022-06-06 Zhenmei Shi , Junyi Wei , Yingyu Liang

This paper presents the foundation for a decomposition theory for Boolean networks, a type of discrete dynamical system that has found a wide range of applications in the life sciences, engineering, and physics. Given a Boolean network…

Dynamical Systems · Mathematics 2022-06-10 Claus Kadelka , Reinhard Laubenbacher , David Murrugarra , Alan Veliz-Cuba , Matthew Wheeler

Studies in neuroscience have shown that biological synapses follow a log-normal distribution whose transitioning can be explained by noisy multiplicative dynamics. Biological networks can function stably even under dynamically fluctuating…

Machine Learning · Computer Science 2025-06-24 Keigo Nishida , Eren Mehmet Kıral , Kenichi Bannai , Mohammad Emtiyaz Khan , Thomas Möllenhoff

In the last decade, network science has shed new light both on the structural (anatomical) and on the functional (correlations in the activity) connectivity among the different areas of the human brain. The analysis of brain networks has…

Physics and Society · Physics 2017-04-18 Federico Battiston , Vincenzo Nicosia , Mario Chavez , Vito Latora

Signal processing in biological systems is delicately executed by specialised networks, which are modular assemblies of network motifs. The motifs are independently functional circuits found in enormous numbers in any living cell. A very…

Molecular Networks · Quantitative Biology 2016-12-08 Tarunendu Mapder

Interaction networks are of central importance in post-genomic molecular biology, with increasing amounts of data becoming available by high-throughput methods. Examples are gene regulatory networks or protein interaction maps. The main…

Statistical Mechanics · Physics 2009-11-10 Johannes Berg , Michael Lässig

The identification of community structure in a social network is an important problem tackled in the literature of network analysis. There are many solutions to this problem using a static scenario, when facing a dynamic scenario some…

Social and Information Networks · Computer Science 2021-12-01 Aurélio Ribeiro Costa

Modular structure is ubiquitous among real-world networks from related proteins to social groups. Here we analyze the modular organization of brain networks at a large-scale (voxel level) extracted from functional magnetic resonance imaging…

Data Analysis, Statistics and Probability · Physics 2009-04-16 M. Valencia , M. A. Pastor , MA. Fernandez-Seara , J. Artieda , J. Martinerie , M. Chavez

Many real-world phenomena are best represented as interaction networks with dynamic structures (e.g., transaction networks, social networks, traffic networks). Interaction networks capture flow of data which is transferred between their…

Social and Information Networks · Computer Science 2018-10-22 Chrysanthi Kosyfaki , Nikos Mamoulis , Evaggelia Pitoura , Panayiotis Tsaparas

Recurrent neural networks (RNNs) trained on compositional tasks can exhibit functional modularity, in which neurons can be clustered by activity similarity and participation in shared computational subtasks. Unlike brains, these RNNs do not…

Neurons and Cognition · Quantitative Biology 2023-10-12 Ziming Liu , Mikail Khona , Ila R. Fiete , Max Tegmark

Over the last two decades, network theory has shown to be a fruitful paradigm in understanding the organization and functioning of real-world complex systems. One technique helpful to this endeavor is identifying functionally influential…

Physics and Society · Physics 2022-01-24 Francesco Picciolo , Franco Ruzzenenti , Petter Holme , Rossana Mastrandrea

Though modern neural networks have achieved impressive performance in both vision and language tasks, we know little about the functions that they implement. One possibility is that neural networks implicitly break down complex tasks into…

Computation and Language · Computer Science 2023-11-08 Michael A. Lepori , Thomas Serre , Ellie Pavlick