English
Related papers

Related papers: Self-control in Sparsely Coded Networks

200 papers

For the retrieval dynamics of sparsely coded attractor associative memory models with synaptic noise the inclusion of a macroscopic time-dependent threshold is studied. It is shown that if the threshold is chosen appropriately as a function…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Bolle' , R. Heylen

A self-control mechanism for the dynamics of a three-state fully-connected neural network is studied through the introduction of a time-dependent threshold. The self-adapting threshold is a function of both the neural and the pattern…

Disordered Systems and Neural Networks · Physics 2009-10-31 D. Bolle' , D. Dominguez Carreta

It is well known that a sparsely coded network in which the activity level is extremely low has intriguing equilibrium properties. In the present work, we study the dynamical properties of a neural network designed to store sparsely coded…

Disordered Systems and Neural Networks · Physics 2009-10-31 Katsunori Kitano , Toshio Aoyagi

The performance of trained neural networks is robust to harsh levels of pruning. Coupled with the ever-growing size of deep learning models, this observation has motivated extensive research on learning sparse models. In this work, we focus…

Machine Learning · Computer Science 2022-11-29 Jose Gallego-Posada , Juan Ramirez , Akram Erraqabi , Yoshua Bengio , Simon Lacoste-Julien

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule,…

Machine Learning · Computer Science 2011-02-22 Vincent Gripon , Claude Berrou

In this presentation, we introduce sparsity methods for networked control systems and show the effectiveness of sparse control. In networked control, efficient data transmission is important since transmission delay and error can critically…

Systems and Control · Computer Science 2014-10-21 Masaaki Nagahara

We propose a self-triggered control algorithm to reduce onboard processor usage, communication bandwidth, and energy consumption across a linear time-invariant networked control system. We formulate an optimal control problem by penalizing…

Systems and Control · Computer Science 2018-12-24 MirSaleh Bahavarnia , Hossein K. Mousavi , Nader Motee

Previous work showed that the collective activity of large neuronal networks can be tamed to remain near its critical point by a feedback control that maximizes the temporal correlations of the mean-field fluctuations. Since such…

Neurons and Cognition · Quantitative Biology 2023-03-29 Juliane T. Moraes , Eyisto J. Aguilar Trejo , Sabrina Camargo , Silvio C. Ferreira , Dante R. Chialvo

A mechanism for self-organization of the degree of connectivity in model neural networks is studied. Network connectivity is regulated locally on the basis of an order parameter of the global dynamics which is estimated from an observable…

Statistical Mechanics · Physics 2009-11-07 Stefan Bornholdt , Torsten Roehl

This paper introduces a framework for quantitative characterization of the controllability of time-varying linear systems (or networks) in terms of input novelty. The motivation for such an approach comes from the study of biophysical…

Optimization and Control · Mathematics 2014-11-24 Gautam Kumar , Delsin Menolascino , ShiNung Ching

The inclusion of a macroscopic adaptive threshold is studied for the retrieval dynamics of both layered feedforward and fully connected neural network models with synaptic noise. These two types of architectures require a different method…

Disordered Systems and Neural Networks · Physics 2007-08-03 D. Bolle , R. Heylen

We present a structured neural network architecture that is inspired by linear time-varying dynamical systems. The network is designed to mimic the properties of linear dynamical systems which makes analysis and control simple. The…

Robotics · Computer Science 2018-08-06 Alexander Broad , Ian Abraham , Todd Murphey , Brenna Argall

A fundamental concept in control theory is that of controllability, where any system state can be reached through an appropriate choice of control inputs. Indeed, a large body of classical and modern approaches are designed for controllable…

Optimization and Control · Mathematics 2022-06-13 Yonathan Efroni , Sham Kakade , Akshay Krishnamurthy , Cyril Zhang

The inclusion of a macroscopic adaptive threshold is studied for the retrieval dynamics of layered feedforward neural network models with synaptic noise. It is shown that if the threshold is chosen appropriately as a function of the…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Bolle , R. Heylen

Sparse codes in neuroscience have been suggested to offer certain computational advantages over other neural representations of sensory data. To explore this viewpoint, a sparse code is used to represent natural images in an optimal control…

Machine Learning · Computer Science 2021-01-08 Peter N. Loxley

The control of complex systems is an ongoing challenge of complexity research. Recent advances using concepts of structural control deduce a wide range of control related properties from the network representation of complex systems. Here,…

Statistical Mechanics · Physics 2013-12-31 Márton Pósfai , Philipp Hövel

This paper investigates coordination problems over packet-based communication channels. We consider the scenario in which the communication between network nodes is corrupted by unknown-but-bounded noise. We introduce a novel coordination…

Systems and Control · Computer Science 2018-08-14 Mingming Shi , Pietro Tesi , Claudio De Persis

Our ability to control network dynamical systems is often hindered by constraints on the number and nature of the available control actions, which make controlling the whole network unfeasible. In this manuscript, we focus on the case where…

Optimization and Control · Mathematics 2022-02-14 Camilla Ancona , Francesco Lo Iudice , Antonio Coppola , Pietro De Lellis , Franco Garofalo

From a mathematical point of view self-organization can be described as patterns to which certain dynamical systems modeling social dynamics tend spontaneously to be attracted. In this paper we explore situations beyond self-organization,…

Optimization and Control · Mathematics 2014-03-24 Marco Caponigro , Massimo Fornasier , Benedetto Piccoli , Emmanuel Trélat

In this work, we consider the controllability of a discrete-time linear dynamical system with sparse control inputs. Sparsity constraints on the input arises naturally in networked systems, where activating each input variable adds to the…

Systems and Control · Electrical Eng. & Systems 2020-05-14 Geethu Joseph , Chandra R. Murthy
‹ Prev 1 2 3 10 Next ›