English
Related papers

Related papers: Redundancy and error resilience in Boolean Network…

200 papers

We study classes of dynamical systems that can be obtained by constructing recursive networks with monotone Boolean functions. Stack filters in nonlinear signal processing are special cases of such systems. We show an analytical connection…

Disordered Systems and Neural Networks · Physics 2009-07-28 Matti Nykter , Juha Kesseli , Ilya Shmulevich

Varied sensory systems use noise in order to enhance detection of weak signals. It has been conjectured in the literature that this effect, known as stochastic resonance, may take place in central cognitive processes such as the memory…

Neurons and Cognition · Quantitative Biology 2007-05-23 Julien Mayor , Wulfram Gerstner

Random Threshold Networks with sparse, asymmetric connections show complex dynamical behavior similar to Random Boolean Networks, with a transition from ordered to chaotic dynamics at a critical average connectivity $K_c$. In this type of…

Statistical Mechanics · Physics 2009-11-07 Thimo Rohlf , Stefan Bornholdt

Resistive memory is a promising alternative to SRAM, but is also an inherently unstable device that requires substantial effort to ensure correct read and write operations. To avoid the associated costs in terms of area, time and energy,…

Machine Learning · Computer Science 2024-01-12 Yannick Emonds , Kai Xi , Holger Fröning

We analyze the input-output behavior of residual networks from a dynamical system point of view by disentangling the residual dynamics from the output activities before the classification stage. For a network with simple skip connections…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Fereshteh Lagzi

Ordinary stochastic neural networks mostly rely on the expected values of their weights to make predictions, whereas the induced noise is mostly used to capture the uncertainty, prevent overfitting and slightly boost the performance through…

Machine Learning · Statistics 2019-02-19 Kirill Neklyudov , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

Resilient algorithms in high-performance computing are subject to rigorous non-functional constraints. Resiliency must not increase the runtime, memory footprint or I/O demands too significantly. We propose a task-based soft error detection…

Software Engineering · Computer Science 2021-11-01 Philipp Samfass , Tobias Weinzierl , Anne Reinarz , Michael Bader

We study the impact of noise on a neural population rate model of up and down states. Up and down states are typically observed in neuronal networks as a slow oscillation, where the population switches between high and low firing rates…

Neurons and Cognition · Quantitative Biology 2015-04-24 Zachary McCleney , Zachary P. Kilpatrick

Resilience is a system's ability to maintain its function when perturbations and errors occur. Whilst we understand low-dimensional networked systems' behavior well, our understanding of systems consisting of a large number of components is…

Systems and Control · Electrical Eng. & Systems 2021-09-08 Giannis Moutsinas , Mengbang Zou , Weisi Guo

Numerous empirical evidence has corroborated that the noise plays a crucial rule in effective and efficient training of neural networks. The theory behind, however, is still largely unknown. This paper studies this fundamental problem…

Machine Learning · Computer Science 2019-09-10 Mo Zhou , Tianyi Liu , Yan Li , Dachao Lin , Enlu Zhou , Tuo Zhao

Behavior can be described as a temporal sequence of actions driven by neural activity. To learn complex sequential patterns in neural networks, memories of past activities need to persist on significantly longer timescales than the…

Neurons and Cognition · Quantitative Biology 2024-09-30 Laura Kriener , Kristin Völk , Ben von Hünerbein , Federico Benitez , Walter Senn , Mihai A. Petrovici

The performance of attractor neural networks has been shown to depend crucially on the heterogeneity of the underlying topology. We take this analysis a step further by examining the effect of degree-degree correlations -- or assortativity…

Disordered Systems and Neural Networks · Physics 2015-05-20 Sebastiano de Franciscis , Samuel Johnson , Joaquín J. Torres

Noise is a fundamental problem in learning theory with huge effects in the application of Machine Learning (ML) methods, due to real world data tendency to be noisy. Additionally, introduction of malicious noise can make ML methods fail…

Machine Learning · Computer Science 2024-06-13 Alfredo Ibias , Karol Capala , Varun Ravi Varma , Anna Drozdz , Jose Sousa

The notion of incremental learning is to train an ANN algorithm in stages, as and when newer training data arrives. Incremental learning is becoming widespread in recent times with the advent of deep learning. Noise in the training data…

Machine Learning · Computer Science 2020-05-08 Shovik Ganguly , Atrayee Chatterjee , Debasmita Bhoumik , Ritajit Majumdar

This paper is concerned with the study of scalability in nonlinear heterogeneous networks affected by communication delays and disturbances. After formalizing the notion of scalability, we give two sufficient conditions to assess this…

Systems and Control · Electrical Eng. & Systems 2022-07-15 Shihao Xie , Giovanni Russo , Richard Middleton

From spiking activity in neuronal networks to force chains in granular materials, the behavior of many real-world systems depends on a network of both strong and weak interactions. These interactions give rise to complex and higher-order…

Quantitative Methods · Quantitative Biology 2021-01-12 Ann S. Blevins , Jason Z. Kim , Danielle S. Bassett

First spike latency following stimulus onset is of significant physiological relevance. Neurons transmit information about their inputs by transforming them into spike trains, and the timing of these spike trains is in turn crucial for…

Biological Physics · Physics 2014-03-27 Rukiye Uzun , Mahmut Ozer , Matjaz Perc

Synchronization in neural networks is strongly tied to the implementation of cognitive processes, but abnormal neuronal synchronization has been linked to a number of brain disorders such as epilepsy and schizophrenia. Here we examine the…

Neurons and Cognition · Quantitative Biology 2020-02-27 Brenton Maisel , Katja Lindenberg

The combination of bistability and noise is ubiquitous in complex systems, from biological to social interactions, and has important implications for their functioning and resilience. We analyze a simple three-state model for bistability in…

Adaptation and Self-Organizing Systems · Physics 2017-04-19 Jan O. Haerter , Albert Díaz-Guilera , M. Ángeles Serrano

As sensing and instrumentation play an increasingly important role in systems controlled over wired and wireless networks, the need to better understand delay-sensitive communication becomes a prime issue. Along these lines, this article…

Information Theory · Computer Science 2021-03-26 Anoosheh Heidarzadeh , Jean-Francois Chamberland , Parimal Parag , Richard D. Wesel