English
Related papers

Related papers: Information and Topology in Attractor Neural Netwo…

200 papers

A small-world topology characterizes many complex systems including the structural and functional organization of brain networks. The topology allows simultaneously for local and global efficiency in the interaction of the system…

Physics and Society · Physics 2015-05-30 Sinisa Pajevic , Dietmar Plenz

Recent results from statistical physics show that large classes of complex networks, both man-made and of natural origin, are characterized by high clustering properties yet strikingly short path lengths between pairs of nodes. This class…

Information Theory · Computer Science 2016-11-17 Rui A. Costa , Joao Barros

We present results from numerical studies of supervised learning operations in recurrent networks considered as graphs, leading from a given set of input conditions to predetermined outputs. Graphs that have optimized their output for…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 H. Atmanspacher , T. Filk

Maxmin-$\omega$ is a new threshold model, where each node in a network waits for the arrival of states from a fraction $\omega$ of neighborhood nodes before processing its own state, and subsequently transmitting it to downstream nodes.…

Physics and Society · Physics 2021-09-24 Ebrahim L. Patel

Recent evidence indicates that the abundance of recurring elementary interaction patterns in complex networks, often called subgraphs or motifs, carry significant information about their function and overall organization. Yet, the…

Disordered Systems and Neural Networks · Physics 2009-11-10 A. Vazquez , R. Dobrin , D. Sergi , J. -P. Eckmann , Z. N. Oltvai , A. -L. Barabasi

A common feature of biological networks is the geometric property of self-similarity. Molecular regulatory networks through to circulatory systems, nervous systems, social systems and ecological trophic networks, show self-similar…

Molecular Networks · Quantitative Biology 2012-03-09 Simon DeDeo , David C. Krakauer

When training transformers on graph-structured data, incorporating information about the underlying topology is crucial for good performance. Topological masking, a type of relative position encoding, achieves this by upweighting or…

A variety of graph neural networks (GNNs) frameworks for representation learning on graphs have been recently developed. These frameworks rely on aggregation and iteration scheme to learn the representation of nodes. However, information…

Machine Learning · Computer Science 2020-03-25 Xinhan Di , Pengqian Yu , Rui Bu , Mingchao Sun

Natural, social, and artificial multi-agent systems usually operate in dynamic environments, where the ability to respond to changing circumstances is a crucial feature. An effective collective response requires suitable information…

Systems and Control · Computer Science 2022-09-29 David Mateo , Nikolaj Horsevad , Vahid Hassani , Mohammadreza Chamanbaz , Roland Bouffanais

In this paper, we study information transport in multiplex networks comprised of two coupled subnetworks. The upper subnetwork, called the logical layer, employs the shortest paths protocol to determine the logical paths for packets…

Physics and Society · Physics 2016-02-17 Cunlai Pu , Siyuan Li , Xianxia Yang , Jian Yang

This paper proposes a novel topological learning framework that integrates networks of different sizes and topology through persistent homology. Such challenging task is made possible through the introduction of a computationally efficient…

Neurons and Cognition · Quantitative Biology 2023-01-30 Tananun Songdechakraiwut , Moo K. Chung

Understanding the features of and mechanisms behind language learning can provide insights into the general process of knowledge acquisition. Recent methods from network science applied to language learning have advanced the field,…

Neurons and Cognition · Quantitative Biology 2017-09-04 Ann E. Sizemore , Elisabeth A. Karuza , Chad Giusti , Danielle S. Bassett

The problem of searchability in decentralized complex networks is of great importance in computer science, economy and sociology. We present a formalism that is able to cope simultaneously with the problem of search and the congestion…

Disordered Systems and Neural Networks · Physics 2009-11-07 R. Guimera , A. Arenas , A. Diaz-Guilera , F. Vega-Redondo , A. Cabrales

Representation learning on graphs is a fundamental problem that can be crucial in various tasks. Graph neural networks, the dominant approach for graph representation learning, are limited in their representation power. Therefore, it can be…

Machine Learning · Computer Science 2025-01-17 Zuoyu Yan , Qi Zhao , Ze Ye , Tengfei Ma , Liangcai Gao , Zhi Tang , Yusu Wang , Chao Chen

The key towards learning informative node representations in graphs lies in how to gain contextual information from the neighbourhood. In this work, we present a simple-yet-effective self-supervised node representation learning strategy via…

Machine Learning · Computer Science 2022-03-24 Wei Dong , Junsheng Wu , Yi Luo , Zongyuan Ge , Peng Wang

We study clustering properties of networks of single integrator nodes over a directed graph, in which the nodes converge to steady-state values. These values define clustering groups of nodes, which depend on interaction topology, edge…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Jeong-Min Ma , Hyung-Gon Lee , Kevin L. Moore , Hyo-Sung Ahn , Kwang-Kyo Oh

Most real-world networks are embedded in latent geometries. If a node in a network is found in the vicinity of another node in the latent geometry, the two nodes have a disproportionately high probability of being connected by a link. The…

Physics and Society · Physics 2024-06-19 Bukyoung Jhun

Asymptotic behaviors are often of particular interest when analyzing Boolean networks that represent biological systems such as signal trans- duction or gene regulatory networks. Methods based on a generalization of the steady state notion,…

Dynamical Systems · Mathematics 2015-09-30 Hannes Klarner , Alexander Bockmayr , Heike Siebert

In traditional topology optimization, the computing time required to iteratively update the material distribution within a design domain strongly depends on the complexity or size of the problem, limiting its application in real engineering…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Gabriel Garayalde , Matteo Torzoni , Matteo Bruggi , Alberto Corigliano

One of the paramount challenges in neuroscience is to understand the dynamics of individual neurons and how they give rise to network dynamics when interconnected. Historically, researchers have resorted to graph theory, statistics, and…

Neurons and Cognition · Quantitative Biology 2019-02-08 Jean-Baptiste Bardin , Gard Spreemann , Kathryn Hess