English
Related papers

Related papers: Interacting neural networks and cryptography

200 papers

Knowledge embedded in the weights of the artificial neural network can be used to improve the network structure, such as in network compression. However, the knowledge is set up by hand, which may not be very accurate, and relevant…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Mengqiao Han , Xiabi Liu , Zhaoyang Hai , Xin Duan

We review the main tools which allow for the statistical characterization of weighted networks. We then present two case studies, the airline connection network and the scientific collaboration network, which are representative of critical…

Statistical Mechanics · Physics 2009-11-10 Marc Barthelemy , Alain Barrat , Romualdo Pastor-Satorras , Alessandro Vespignani

We consider artificial neurons which will update their weight coefficients with an internal rule based on backpropagation, rather than using it as an external training procedure. To achieve this we include the backpropagation error estimate…

Neural and Evolutionary Computing · Computer Science 2018-08-07 M. N. Nazarov

Interpreting the learning dynamics of neural networks can provide useful insights into how networks learn and the development of better training and design approaches. We present an approach to interpret learning in neural networks by…

Machine Learning · Computer Science 2022-03-29 Ayush Manish Agrawal , Atharva Tendle , Harshvardhan Sikka , Sahib Singh

Transferability of learned features between tasks can massively reduce the cost of training a neural network on a novel task. We investigate the effect of network width on learned features using activation atlases --- a visualization…

Machine Learning · Computer Science 2019-09-26 Dar Gilboa , Guy Gur-Ari

We introduce an algorithm where the individual bits representing the weights of a neural network are learned. This method allows training weights with integer values on arbitrary bit-depths and naturally uncovers sparse networks, without…

Machine Learning · Computer Science 2022-02-22 Cristian Ivan

We explore the interplay of network structure, topology, and dynamic interactions between nodes using the paradigm of distributed synchronization in a network of coupled oscillators. As the network evolves to a global steady state,…

Disordered Systems and Neural Networks · Physics 2015-06-04 Kristina Lerman , Rumi Ghosh

Understanding how neural networks learn remains one of the central challenges in machine learning research. From random at the start of training, the weights of a neural network evolve in such a way as to be able to perform a variety of…

Machine Learning · Computer Science 2020-10-28 Maxime Gabella

Despite the tremendous advancements in the field of network theory, very few studies have taken weights in the interactions into consideration that emerge naturally in all real world systems. Using random matrix analysis of a weighted…

Physics and Society · Physics 2016-02-25 Camellia Sarkar , Sarika Jalan

As deep neural networks grow in size, from thousands to millions to billions of weights, the performance of those networks becomes limited by our ability to accurately train them. A common naive question arises: if we have a system with…

Machine Learning · Computer Science 2018-05-29 Nathan O. Hodas , Panos Stinis

We present a key-exchange protocol that comprises two parties with chaotic dynamics that are mutually coupled and undergo a synchronization process, at the end of which they can use their identical dynamical state as an encryption key. The…

Other Condensed Matter · Physics 2009-11-10 Einat Klein , Rachel Mislovaty , Ido Kanter , Wolfgang Kinzel

The understanding of synchronization ranging from natural to social systems has driven the interests of scientists from different disciplines. Here, we have investigated the synchronization dynamics of the Kuramoto dynamics departing from…

Disordered Systems and Neural Networks · Physics 2009-09-29 Jie Ren , Huijie Yang

When neural networks are trained to classify a dataset, one finds a set of weights from which the network produces a label for each data point. We study the algorithmic complexity of finding a collision in a single-layer neural net, where a…

Networked structures arise in a wide array of different contexts such as technological and transportation infrastructures, social phenomena, and biological systems. These highly interconnected systems have recently been the focus of a great…

Statistical Mechanics · Physics 2009-11-10 Alain Barrat , Marc Barthelemy , Romualdo Pastor-Satorras , Alessandro Vespignani

One of the most important challenges in network science is to quantify the information encoded in complex network structures. Disentangling randomness from organizational principles is even more demanding when networks have a multiplex…

We propose a synthetical weights' dynamic mechanism for weighted networks which takes into account the influences of strengths of nodes, weights of links and incoming new vertices. Strength/Weight preferential strategies are used in these…

Physics and Society · Physics 2007-09-10 Lujun Fang , Zhongzhi Zhang , Shuigeng Zhou , Jihong Guan

Neural network binarization accelerates deep models by quantizing their weights and activations into 1-bit. However, there is still a huge performance gap between Binary Neural Networks (BNNs) and their full-precision (FP) counterparts. As…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Yuzhang Shang , Dan Xu , Ziliang Zong , Liqiang Nie , Yan Yan

We study a class models of correlated random networks in which vertices are characterized by \textit{hidden variables} controlling the establishment of edges between pairs of vertices. We find analytical expressions for the main topological…

Disordered Systems and Neural Networks · Physics 2009-11-10 Marian Boguna , Romualdo Pastor-Satorras

The connections in many networks are not merely binary entities, either present or not, but have associated weights that record their strengths relative to one another. Recent studies of networks have, by and large, steered clear of such…

Statistical Mechanics · Physics 2009-11-10 M. E. J. Newman

In computer vision and machine learning, a crucial challenge is to lower the computation and memory demands for neural network inference. A commonplace solution to address this challenge is through the use of binarization. By binarizing the…

Machine Learning · Computer Science 2023-07-06 Guy Berger , Aviv Navon , Ethan Fetaya