Related papers: Generalized cable theory for neurons in complex an…
Neural networks leverage robust internal representations in order to generalise. Learning them is difficult, and often requires a large training set that covers the data distribution densely. We study a common setting where our task is not…
A network representation is useful for describing the structure of a large variety of complex systems. However, most real and engineered systems have multiple subsystems and layers of connectivity, and the data produced by such systems is…
Ab initio calculation of dielectric response with high-accuracy electronic structure methods is a long-standing problem, for which mean-field approaches are widely used and electron correlations are mostly treated via approximated…
The transport of particles in cells is influenced by the properties of intracellular networks they traverse while searching for localized target regions or reaction partners. Moreover, given the rapid turnover in many intracellular…
Much information about a graph can be obtained by studying its spanning trees. On the other hand, a graph can be regarded as a 1-dimensional cell complex, raising the question of developing a theory of trees in higher dimension. As observed…
Protrusions at the leading-edge of a cell play an important role in sensing the extracellular cues, during cellular spreading and motility. Recent studies provided indications that these protrusions wrap (coil) around the extra-cellular…
A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…
Dynamical mean-field theory is a powerful physics tool used to analyze the typical behavior of neural networks, where neurons can be recurrently connected, or multiple layers of neurons can be stacked. However, it is not easy for beginners…
We generalize the predictions for attractions between over-all neutral surfaces induced by charge fluctuations/correlations to non-uniform systems that include dielectric discontinuities, as is the case for mixed charged lipid membranes in…
We discuss the effects of common synaptic inputs in a recurrent neural network. Because of the effects of these common synaptic inputs, the correlation between neural inputs cannot be ignored, and thus the network exhibits sample…
In the work, a modified effective medium theory is constructed for calculating the effective properties of thermoelectric composites with different values of percolation thresholds. It is shown that even at concentrations beyond the…
We consider a sub-wavelength periodic layered medium whose slabs are filled by arbitrary linear metamaterials and standard nonlinear Kerr media and we show that the homogenized medium behaves as a Kerr medium whose parameters can assume…
This paper challenges the prevailing view that convolutional neural network (CNN) filters become increasingly specialized in deeper layers. Motivated by recent observations of clusterable repeating patterns in depthwise separable CNNs…
The crucial role played by the underlying symmetries of high energy physics and lattice field theories calls for the implementation of such symmetries in the neural network architectures that are applied to the physical system under…
We study the effect that the heterogeneity present among the elements of an ensemble of coupled excitable neurons have on the collective response of the system to an external signal. We have considered two different interaction scenarios,…
Generalization of deep neural networks remains one of the main open problems in machine learning. Previous theoretical works focused on deriving tight bounds of model complexity, while empirical works revealed that neural networks exhibit…
Properties such as composability and automatic differentiation made artificial neural networks a pervasive tool in applications. Tackling more challenging problems caused neural networks to progressively become more complex and thus…
We revisit the classical problem of diffusion-limited ion transport to a membrane (or electrode) by considering the effects of charged side walls. Using simple mathematical models and numerical simulations, we identify three basic…
The effectiveness and performance of artificial neural networks, particularly for visual tasks, depends in crucial ways on the receptive field of neurons. The receptive field itself depends on the interplay between several architectural…
In recent years, the buffer layer ablation failures of high voltage cables are frequently reported by the power systems. Previous studies have dominantly regarded the buffer layer as the continuous homogeneous medium, whereas neglects its…