English
Related papers

Related papers: Leveraging Low-Rank and Sparse Recurrent Connectiv…

200 papers

Modern network systems, such as transportation and communication systems, are prone to cyber-physical disruptions and thus suffer efficiency loss. This paper studies network resiliency, in terms of throughput, and develops resilient control…

Systems and Control · Electrical Eng. & Systems 2025-01-08 Yu Tang , Li Jin

To push forward the important emerging research field surrounding multi-area recurrent neural networks (RNNs), we expand theoretically and empirically on the provably stable RNNs of RNNs introduced by Kozachkov et al. in "RNNs of RNNs:…

Machine Learning · Computer Science 2025-08-27 Michaela Ennis , Leo Kozachkov , Jean-Jacques Slotine

This paper focuses on the identification of graphical autoregressive models with dynamical latent variables. The dynamical structure of latent variables is described by a matrix polynomial transfer function. Taking account of the sparse…

Methodology · Statistics 2023-07-24 Junyao You , Chengpu Yu

Factorization machines (FM) are a popular model class to learn pairwise interactions by a low-rank approximation. Different from existing FM-based approaches which use a fixed rank for all features, this paper proposes a Rank-Aware FM…

Machine Learning · Computer Science 2019-05-21 Xiaoshuang Chen , Yin Zheng , Jiaxing Wang , Wenye Ma , Junzhou Huang

Despite technological advancements, the significance of interdisciplinary subjects like complex networks has grown. Exploring communication within these networks is crucial, with traffic becoming a key concern due to the expanding…

Networking and Internet Architecture · Computer Science 2024-01-02 Seyed Hassan Yajadda , Farshad Safaei

Random networks are a powerful tool in the analytical modeling of complex networks as they allow us to write approximate mathematical models for diverse properties and behaviors of networks. One notable shortcoming of these models is that…

Physics and Society · Physics 2023-07-10 Laurent Hébert-Dufresne , Márton Pósfai , Antoine Allard

Networks of randomly connected neurons are among the most popular models in theoretical neuroscience. The connectivity between neurons in the cortex is however not fully random, the simplest and most prominent deviation from randomness…

Neurons and Cognition · Quantitative Biology 2018-07-09 Daniel Martí , Nicolas Brunel , Srdjan Ostojic

Learning in neural systems arises from synaptic changes that reshape the representations underlying behavior. While low-rank recurrent neural networks (RNNs) have emerged as a powerful framework for linking connectivity to function, a…

Machine Learning · Computer Science 2026-05-07 Yoav Ger , Omri Barak

In this work, we attempt to ameliorate the impact of data sparsity in the context of session-based recommendation. Specifically, we seek to devise a machine learning mechanism capable of extracting subtle and complex underlying temporal…

Information Retrieval · Computer Science 2017-06-14 Sotirios Chatzis , Panayiotis Christodoulou , Andreas S. Andreou

Continual learning algorithms strive to acquire new knowledge while preserving prior information. Often, these algorithms emphasise stability and restrict network updates upon learning new tasks. In many cases, such restrictions come at a…

Machine Learning · Computer Science 2024-06-21 Daniel Anthes , Sushrut Thorat , Peter König , Tim C. Kietzmann

Studies of human decision-making demonstrate that environmental regularities, such as natural image statistics or intentionally nonuniform stimulus probabilities, can be exploited to improve efficiency (termed `efficient-coding').…

Neurons and Cognition · Quantitative Biology 2025-09-30 Holly Kular , Robert Kim , John Serences , Nuttida Rungratsameetaweemana

In this article, we propose a backpropagation-free approach to robotic control through the neuro-cognitive computational framework of neural generative coding (NGC), designing an agent built completely from powerful predictive…

Robotics · Computer Science 2022-09-20 Alexander Ororbia , Ankur Mali

In specific motifs of three recurrently connected neurons with probabilistic response, the spontaneous information flux, defined as the mutual information between subsequent states, has been shown to increase by adding ongoing white noise…

Neurons and Cognition · Quantitative Biology 2024-08-13 Claus Metzner , Achim Schilling , Andreas Maier , Patrick Krauss

In cognitive network neuroscience, the connectivity and community structure of the brain network is related to cognition. Much of this research has focused on two measures of connectivity - modularity and flexibility - which frequently have…

Neurons and Cognition · Quantitative Biology 2017-11-28 Aurora I. Ramos-Nuñez , Simon Fischer-Baum , Randi Martin , Qiuhai Yue , Fengdan Ye , Michael W. Deem

This work proposes a two-layered control scheme for constrained nonlinear systems represented by a class of recurrent neural networks and affected by additive disturbances. In particular, a base controller ensures global or regional…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Daniele Ravasio , Danilo Saccani , Marcello Farina , Giancarlo Ferrari-Trecate

Mobility-on-demand (MoD) systems represent a rapidly developing mode of transportation wherein travel requests are dynamically handled by a coordinated fleet of vehicles. Crucially, the efficiency of an MoD system highly depends on how well…

Machine Learning · Statistics 2022-05-05 Daniele Gammelli , Filipe Rodrigues

We consider the problem of unveiling the implicit network structure of node interactions (such as user interactions in a social network), based only on high-frequency timestamps. Our inference is based on the minimization of the…

Machine Learning · Statistics 2020-02-25 Emmanuel Bacry , Martin Bompaire , Stéphane Gaïffas , Jean-François Muzy

Neural networks are known to be highly sensitive to adversarial examples. These may arise due to different factors, such as random initialization, or spurious correlations in the learning problem. To better understand these factors, we…

Machine Learning · Statistics 2022-07-05 Elvis Dohmatob , Alberto Bietti

Management of communication by on-line routing in new FPGAs with a large amount of logic resources and partial reconfigurability is a new challenging problem. A Network-on-Chip (NoC) typically uses packet routing mechanism, which has often…

Hardware Architecture · Computer Science 2016-08-31 Ali Ahmadinia , Christophe Bobda , Ji Ding , Mateusz Majer , Juergen Teich , Sandor P. Fekete , Jan van der Veen

Recurrent Neural Networks (RNN) are widely used to solve a variety of problems and as the quantity of data and the amount of available compute have increased, so have model sizes. The number of parameters in recent state-of-the-art networks…

Machine Learning · Computer Science 2017-11-08 Sharan Narang , Erich Elsen , Gregory Diamos , Shubho Sengupta