English
Related papers

Related papers: When Neurons Fail

200 papers

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

Machine Learning · Computer Science 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

We consider artificial neurons which will update their weight coefficients with an internal rule based on backpropagation, rather than using it as an external training procedure. To achieve this we include the backpropagation error estimate…

Neural and Evolutionary Computing · Computer Science 2018-08-07 M. N. Nazarov

In many cases of attacks or failures, memory effects play a significant role. Therefore, we present a model that not only considers the dependencies between nodes but also incorporates the memory effects of attacks. Our research…

Physics and Society · Physics 2023-06-21 Yanpeng Zhu , Lei Chen , Fanyuan Meng , Chun-Xiao Jia , Run-Ran Liu

The approximation power of general feedforward neural networks with piecewise linear activation functions is investigated. First, lower bounds on the size of a network are established in terms of the approximation error and network depth…

Machine Learning · Computer Science 2018-07-02 Mohammad Mehrabi , Aslan Tchamkerten , Mansoor I. Yousefi

In practice, since many communication networks are huge in scale, or complicated in structure, or even dynamic, the predesigned linear network codes based on the network topology is impossible even if the topological structure is known.…

Information Theory · Computer Science 2013-02-26 Xuan Guang , Fang-Wei Fu

Power-law networks such as the Internet, terrorist cells, species relationships, and cellular metabolic interactions are susceptible to node failures, yet maintaining network connectivity is essential for network functionality.…

Physics and Society · Physics 2015-05-08 Sarah LaRocca , Seth Guikema

The rapid advancement of technology underscores the critical importance of robustness in complex network systems. This paper presents a framework for investigating the structural robustness of interconnected network models. This paper…

Physics and Society · Physics 2023-11-01 Dong Gaogao , Sun Nannan , Wang Fan

Despite considerable theoretical progress in the training of neural networks viewed as a multi-agent system of neurons, particularly concerning biological plausibility and decentralized training, their applicability to real-world problems…

Neural and Evolutionary Computing · Computer Science 2023-10-17 Arshia Soltani Moakhar , Mohammad Azizmalayeri , Hossein Mirzaei , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

The problem of neural network association is to retrieve a previously memorized pattern from its noisy version using a network of neurons. An ideal neural network should include three components simultaneously: a learning algorithm, a large…

Neural and Evolutionary Computing · Computer Science 2012-06-22 Amir Hesam Salavati , Amin Karbasi

The learned weights of a neural network have often been considered devoid of scrutable internal structure. In this paper, however, we look for structure in the form of clusterability: how well a network can be divided into groups of neurons…

Neural and Evolutionary Computing · Computer Science 2021-03-08 Daniel Filan , Stephen Casper , Shlomi Hod , Cody Wild , Andrew Critch , Stuart Russell

Deep Networks have been shown to provide state-of-the-art performance in many machine learning challenges. Unfortunately, they are susceptible to various types of noise, including adversarial attacks and corrupted inputs. In this work we…

Machine Learning · Computer Science 2019-09-12 Carlos Lassance , Vincent Gripon , Jian Tang , Antonio Ortega

We study the learning of an external signal by a neural network and the time to forget it when this network is submitted to noise. The presentation of an external stimulus to the recurrent network of binary neurons may change the state of…

Probability · Mathematics 2020-06-11 Pascal Helson

The neural network is a powerful computing framework that has been exploited by biological evolution and by humans for solving diverse problems. Although the computational capabilities of neural networks are determined by their structure,…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Nathaniel Rodriguez , Eduardo Izquierdo , Yong-Yeol Ahn

We propose a dynamical model for cascading failures in single-commodity network flows. In the proposed model, the network state consists of flows and activation status of the links. Network dynamics is determined by a, possibly…

Systems and Control · Computer Science 2014-07-15 Ketan Savla , Giacomo Como , Munther A. Dahleh

Cascading failures and epidemic dynamics, as two successful application realms of network science, are usually investigated separately. How do they affect each other is still one open, interesting problem. In this letter, we couple both…

Social and Information Networks · Computer Science 2016-11-23 Dawei Zhao , Zhen Wang , Gaoxi Xiao , Bo Gao , Lianhai Wang

With the rise of smartphones and the internet-of-things, data is increasingly getting generated at the edge on local, personal devices. For privacy, latency and energy saving reasons, this shift is causing machine learning algorithms to…

Machine Learning · Computer Science 2021-04-29 Jiaqi Li , Ross Drummond , Stephen R. Duncan

Neural-network models of high-level brain functions such as memory recall and reasoning often rely on the presence of stochasticity. The majority of these models assumes that each neuron in the functional network is equipped with its own…

Neurons and Cognition · Quantitative Biology 2022-05-17 Jakob Jordan , Mihai A. Petrovici , Oliver Breitwieser , Johannes Schemmel , Karlheinz Meier , Markus Diesmann , Tom Tetzlaff

The stunning empirical successes of neural networks currently lack rigorous theoretical explanation. What form would such an explanation take, in the face of existing complexity-theoretic lower bounds? A first step might be to show that…

Machine Learning · Computer Science 2017-07-18 Le Song , Santosh Vempala , John Wilmes , Bo Xie

How does the size of a neural circuit influence its learning performance? Intuitively, we expect the learning capacity of a neural circuit to grow with the number of neurons and synapses. Larger brains tend to be found in species with…

Neurons and Cognition · Quantitative Biology 2019-05-09 Dhruva V Raman , Timothy O'Leary

With the increasing complexity of computing systems, complete hardware reliability can no longer be guaranteed. We need, however, to ensure overall system reliability. One of the most important features of artificial neural networks is…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Anton Kulakov , Mark Zwolinski , Jeff Reeve