English
Related papers

Related papers: Less is different: why sparse networks with inhibi…

200 papers

Oscillatory phase pattern formation and amplitude control for a linearized stochastic neuron field model was investigated by simulating coupled stochastic processes defined by stochastic differential equations. It was found, for several…

Neurons and Cognition · Quantitative Biology 2021-03-24 Conor L. Morrison , Priscilla E. Greenwood , Lawrence M. Ward

Predicting how the brain can be driven to specific states by means of internal or external control requires a fundamental understanding of the relationship between neural connectivity and activity. Network control theory is a powerful tool…

Neurons and Cognition · Quantitative Biology 2019-08-12 Teresa M. Karrer , Jason Z. Kim , Jennifer Stiso , Ari E. Kahn , Fabio Pasqualetti , Ute Habel , Danielle S. Bassett

This paper concerns the adaptive control problem for a class of nonlinear stochastic systems in which the state update is given by a nonlinear function of linear dynamics plus additive stochastic noise. Such systems arise in a wide range of…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Lantian Zhang , Bo Wahlberg , Silun Zhang

Network inference has been extensively studied in several fields, such as systems biology and social sciences. Learning network topology and internal dynamics is essential to understand mechanisms of complex systems. In particular, sparse…

Machine Learning · Statistics 2022-06-13 Yasen Wang , Junyang Jin , Jorge Goncalves

Mechanisms underlying the emergence of orientation selectivity in the primary visual cortex are highly debated. Here we study the contribution of inhibition-dominated random recurrent networks to orientation selectivity, and more generally…

Neurons and Cognition · Quantitative Biology 2014-06-03 Sadra Sadeh , Stefano Cardanobile , Stefan Rotter

Many studies have shown that the excitation and inhibition received by cortical neurons remain roughly balanced across many conditions. A key question for understanding the dynamical regime of cortex is the nature of this balancing.…

Neurons and Cognition · Quantitative Biology 2019-08-29 Yashar Ahmadian , Kenneth D. Miller

Trophic coherence, a measure of the extent to which the nodes of a directed network are organised in levels, has recently been shown to be closely related to many structural and dynamical aspects of complex systems, including graph…

Physics and Society · Physics 2016-07-22 Janis Klaise , Samuel Johnson

Dynamic networks models describe a growing number of important scientific processes, from cell biology and epidemiology to sociology and finance. There are many aspects of dynamical networks that require statistical considerations. In this…

Methodology · Statistics 2012-05-15 E. C. Wit , A. Abbruzzo

The advent of sparsity inducing techniques in neural networks has been of a great help in the last few years. Indeed, those methods allowed to find lighter and faster networks, able to perform more efficiently in resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Nathan Hubens , Victor Delvigne , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

We study the dynamics of networks with inhibitory and excitatory leaky-integrate-and-fire neurons with short-term synaptic plasticity in the presence of depressive and facilitating mechanisms. The dynamics is analyzed by a Heterogeneous…

Disordered Systems and Neural Networks · Physics 2016-01-20 M. di Volo , R. Burioni , M. Casartelli , R. Livi , A. Vezzani

Sparse neural networks are often hypothesized to be more interpretable than dense models, motivated by findings that weight sparsity can produce compact circuits in language models. However, it remains unclear whether structural sparsity…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Siyu Zhang

Graphs are useful to interpret widely used image processing methods, e.g., bilateral filtering, or to develop new ones, e.g., kernel based techniques. However, simple graph constructions are often used, where edge weight and connectivity…

Image and Video Processing · Electrical Eng. & Systems 2020-06-02 Sarath Shekkizhar , Antonio Ortega

To accelerate the training of graph convolutional networks (GCNs) on real-world large-scale sparse graphs, downsampling methods are commonly employed as a preprocessing step. However, the effects of graph sparsity and topological structure…

Machine Learning · Computer Science 2024-09-10 Qinji Shu , Hang Sheng , Feng Ji , Hui Feng , Bo Hu

Sparse recovery can recover sparse signals from a set of underdetermined linear measurements. Motivated by the need to monitor large-scale networks from a limited number of measurements, this paper addresses the problem of recovering sparse…

Information Theory · Computer Science 2015-03-20 Meng Wang , Weiyu Xu , Enrique Mallada , Ao Tang

Graph Transformers typically rely on explicit positional or structural encodings and dense global attention to incorporate graph topology. In this work, we show that neither is essential. We introduce HopFormer, a graph Transformer that…

Machine Learning · Computer Science 2026-02-03 Sanggeon Yun , Raheeb Hassan , Ryozo Masukawa , Sungheon Jeong , Mohsen Imani

Why do brains have inhibitory connections? Why do deep networks have negative weights? We propose an answer from the perspective of representation capacity. We believe representing functions is the primary role of both (i) the brain in…

Machine Learning · Computer Science 2023-08-21 Qingyang Wang , Michael A. Powell , Ali Geisa , Eric Bridgeford , Carey E. Priebe , Joshua T. Vogelstein

Network (or graph) sparsification compresses a graph by removing inessential edges. By reducing the data volume, it accelerates or even facilitates many downstream analyses. Still, the accuracy of many sparsification methods, with…

Social and Information Networks · Computer Science 2023-09-28 Zhen Su , Jürgen Kurths , Henning Meyerhenke

We analyze transport on a graph with multiple constraints and where the weight of the edges connecting the nodes is a dynamical variable. The network dynamics results from the interplay between a nonlinear function of the flow, dissipation,…

Statistical Mechanics · Physics 2023-11-28 Frederic Folz , Kurt Mehlhorn , Giovanna Morigi

High-level brain function such as memory, classification or reasoning can be realized by means of recurrent networks of simplified model neurons. Analog neuromorphic hardware constitutes a fast and energy efficient substrate for the…

Neurons and Cognition · Quantitative Biology 2016-06-10 Thomas Pfeil , Jakob Jordan , Tom Tetzlaff , Andreas Grübl , Johannes Schemmel , Markus Diesmann , Karlheinz Meier

Network topology inference is a cornerstone problem in statistical analyses of complex systems. In this context, the fresh look advocated here permeates benefits from convex optimization and graph signal processing, to identify the…

Social and Information Networks · Computer Science 2016-04-12 Santiago Segarra , Antonio G. Marques , Gonzalo Mateos , Alejandro Ribeiro