English
Related papers

Related papers: Interacting neural networks and cryptography

200 papers

In a complex system, the interactions between individual agents often lead to emergent collective behavior like spontaneous synchronization, swarming, and pattern formation. The topology of the network of interactions can have a dramatic…

Adaptation and Self-Organizing Systems · Physics 2022-07-25 Mark J Panaggio , Maria-Veronica Ciocanel , Lauren Lazarus , Chad M Topaz , Bin Xu

The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This…

Disordered Systems and Neural Networks · Physics 2017-02-08 Wolfgang Kinzel

In order to take the weight of connection into consideration and to find a natural measurement of weight, we have collected papers in Econophysics and constructed a network of scientific communication to integrate idea transportation among…

Other Condensed Matter · Physics 2007-05-23 Menghui Li , Ying Fan , Jiawei Chen , Liang Gao , Zengru Di , Jinshan Wu

Most nervous systems encode information about stimuli in the responding activity of large neuronal networks. This activity often manifests itself as dynamically coordinated sequences of action potentials. Since multiple electrode recordings…

Neurons and Cognition · Quantitative Biology 2011-11-09 Kristina Lisa Klinkner , Cosma Rohilla Shalizi , Marcelo F. Camperi

The ability of humans and animals to quickly adapt to novel tasks is difficult to reconcile with the standard paradigm of learning by slow synaptic weight modification. Here we show that fixed-weight neural networks can learn to generate…

Neurons and Cognition · Quantitative Biology 2020-08-26 Christian Klos , Yaroslav Felipe Kalle Kossio , Sven Goedeke , Aditya Gilra , Raoul-Martin Memmesheimer

Incorporation of a new knowledge into neural networks with simultaneous preservation of the previous one is known to be a nontrivial problem. This problem becomes even more complex when new knowledge is contained not in new training…

Machine Learning · Computer Science 2019-09-10 Mikhail Iu. Leontev , Viktoriia Islenteva , Sergey V. Sukhov

We demonstrate, both analytically and numerically, that learning dynamics of neural networks is generically attracted towards a self-organized critical state. The effect can be modeled with quartic interactions between non-trainable…

Statistical Mechanics · Physics 2021-07-09 Mikhail I. Katsnelson , Vitaly Vanchurin , Tom Westerhout

Topology and weights are closely related in weighted complex networks and this is reflected in their modular structure. We present a simple network model where the weights are generated dynamically and they shape the developing topology. By…

Physics and Society · Physics 2008-01-30 J. M. Kumpula , J. -P. Onnela , J. Saramaki , K. Kaski , J. Kertesz

We introduce a flexible setup allowing for a neural network to learn both its size and topology during the course of a standard gradient-based training. The resulting network has the structure of a graph tailored to the particular learning…

Machine Learning · Computer Science 2020-07-16 Romuald A. Janik , Aleksandra Nowak

We propose an empirical approach centered on the spectral dynamics of weights -- the behavior of singular values and vectors during optimization -- to unify and clarify several phenomena in deep learning. We identify a consistent bias in…

The information processing abilities of a multilayer neural network with a number of hidden units scaling as the input dimension are studied using statistical mechanics methods. The mapping from the input layer to the hidden units is…

Statistical Mechanics · Physics 2009-11-07 Michal Rosen-Zvi , Andreas Engel , Ido Kanter

We examine a class of deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) We show how entropies and mutual informations can be derived from heuristic statistical…

Machine Learning · Computer Science 2020-01-22 Marylou Gabrié , Andre Manoel , Clément Luneau , Jean Barbier , Nicolas Macris , Florent Krzakala , Lenka Zdeborová

In contrast to traditional weight optimization in a continuous space, we demonstrate the existence of effective random networks whose weights are never updated. By selecting a weight among a fixed set of random values for each individual…

Machine Learning · Computer Science 2021-06-09 Maxwell Mbabilla Aladago , Lorenzo Torresani

Networks effectively capture interactions among components of complex systems, and have thus become a mainstay in many scientific disciplines. Growing evidence, especially from biology, suggest that networks undergo changes over time, and…

Methodology · Statistics 2020-03-10 Ali Shojaie

This paper explores neural network-based approaches for algorithmic trading in cryptocurrency markets. Our approach combines multi-timeframe trend analysis with high-frequency direction prediction networks, achieving positive risk-adjusted…

Computational Finance · Quantitative Finance 2025-08-05 Wěi Zhāng

Synchronous firing of neurons is thought to play important functional roles such as feature binding and switching of cognitive states. Although synchronization has mainly been investigated using model neurons with simple connection topology…

Neurons and Cognition · Quantitative Biology 2024-11-26 Naoki Masuda , Kazuyuki Aihara

Randomly evolving systems composed by elements which interact among each other have always been of great interest in several scientific fields. This work deals with the synchronization phenomenon, that could be roughly defined as the…

Probability · Mathematics 2017-12-18 Giacomo Aletti , Irene Crimaldi , Andrea Ghiglietti

Training a neural network is synonymous with learning the values of the weights. By contrast, we demonstrate that randomly weighted neural networks contain subnetworks which achieve impressive performance without ever training the weight…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Vivek Ramanujan , Mitchell Wortsman , Aniruddha Kembhavi , Ali Farhadi , Mohammad Rastegari

Over the last decade, an enormous interest and activity in complex networks have been witnessed within the physics community. On the other hand, diffusion and its theory, have equipped the toolbox of the physicist for decades. In this…

Statistical Mechanics · Physics 2010-05-04 Ingve Simonsen

Whether deep neural networks can exhibit emergent behaviour is not only relevant for understanding how deep learning works, it is also pivotal for estimating potential security risks of increasingly capable artificial intelligence systems.…

Machine Learning · Computer Science 2025-04-11 Pascal de Jong , Felix Meigel , Steffen Rulands