中文
相关论文

相关论文: On Characterizing the Capacity of Neural Networks …

200 篇论文

This paper proposes a novel topological learning framework that integrates networks of different sizes and topology through persistent homology. Such challenging task is made possible through the introduction of a computationally efficient…

神经元与认知 · 定量生物学 2023-01-30 Tananun Songdechakraiwut , Moo K. Chung

Deep neural networks proved to be a very useful and powerful tool with many practical applications. They especially excel at learning from large data sets with labeled samples. However, in order to achieve good learning results, the network…

神经与进化计算 · 计算机科学 2018-01-03 Włodzimierz Funika , Paweł Koperek

In traditional machine learning, models are defined by a set of parameters, which are optimized to perform specific tasks. In neural networks, these parameters correspond to the synaptic weights. However, in reality, it is often infeasible…

机器学习 · 计算机科学 2025-02-11 Ofir Schlisselberg , Ran Darshan

Graphs can model real-world, complex systems by representing entities and their interactions in terms of nodes and edges. To better exploit the graph structure, graph neural networks have been developed, which learn entity and edge…

机器学习 · 计算机科学 2022-06-06 Tong Liu , Yushan Liu , Marcel Hildebrandt , Mitchell Joblin , Hang Li , Volker Tresp

This thesis is a compendium of research which brings together ideas from the fields of Complex Networks and Computational Neuroscience to address two questions regarding neural systems: 1) How the activity of neurons, via synaptic changes,…

神经元与认知 · 定量生物学 2013-02-19 Samuel Johnson

A wide range of networks, including small-world topology, can be modelled by the connectivity $\gamma$, and randomness $\omega$ of the links. Both learning and attractor abilities of a neural network can be measured by the mutual…

无序系统与神经网络 · 物理学 2007-05-23 D. Dominguez , K. Koroutchev , E. Serrano , F. B. Rodriguez

A central issue of the science of complex systems is the quantitative characterization of complexity. In the present work we address this issue by resorting to information geometry. Actually we propose a constructive way to associate to a -…

数学物理 · 物理学 2017-12-19 Roberto Franzosi , Domenico Felice , Stefano Mancini , Marco Pettini

Network or graph structures are ubiquitous in the study of complex systems. Often, we are interested in complexity trends of these system as it evolves under some dynamic. An example might be looking at the complexity of a food web as…

信息论 · 计算机科学 2007-07-16 Russell K. Standish

As a general type of machine learning approach, artificial neural networks have established state-of-art benchmarks in many pattern recognition and data analysis tasks. Among various kinds of neural networks architectures, polynomial neural…

机器学习 · 计算机科学 2022-09-07 Chao Pan , Chuanyi Zhang

Understanding the origins of complexity is a fundamental challenge with implications for biological and technological systems. Network theory emerges as a powerful tool to model complex systems. Networks are an intuitive framework to…

无序系统与神经网络 · 物理学 2024-10-22 Blai Vidiella , Salva Duran-Nebreda , Sergi Valverde

Neural networks can be thought of as applying a transformation to an input dataset. The way in which they change the topology of such a dataset often holds practical significance for many tasks, particularly those demanding non-homeomorphic…

机器学习 · 计算机科学 2024-06-05 Kosio Beshkov , Gaute T. Einevoll

Deep neural networks often contain far more parameters than training examples, yet they still manage to generalize well in practice. Classical complexity measures such as VC-dimension or PAC-Bayes bounds usually become vacuous in this…

机器学习 · 计算机科学 2025-08-26 Aviral Dhingra

Networks are mathematical structures that are universally used to describe a large variety of complex systems such as the brain or the Internet. Characterizing the geometrical properties of these networks has become increasingly relevant…

物理与社会 · 物理学 2015-05-26 Zhihao Wu , Giulia Menichetti , Christoph Rahmede , Ginestra Bianconi

In this paper we presented a novel constructive approach for training deep neural networks using geometric approaches. We show that a topological covering can be used to define a class of distributed linear matrix inequalities, which in…

机器学习 · 计算机科学 2019-01-10 W. Brent Daniel , Enoch Yeung

It is well-known that randomly initialized, push-forward, fully-connected neural networks weakly converge to isotropic Gaussian processes, in the limit where the width of all layers goes to infinity. In this paper, we propose to use the…

机器学习 · 统计学 2025-05-20 Simmaco Di Lillo , Domenico Marinucci , Michele Salvi , Stefano Vigogna

We suggest analyzing neural networks through the prism of space constraints. We observe that most training algorithms applied in practice use bounded memory, which enables us to use a new notion introduced in the study of space-time…

机器学习 · 计算机科学 2017-03-03 Michal Moshkovitz , Naftali Tishby

Graph neural networks have become a staple in problems addressing learning and analysis of data defined over graphs. However, several results suggest an inherent difficulty in extracting better performance by increasing the number of…

机器学习 · 计算机科学 2021-03-30 Diego Valsesia , Giulia Fracastoro , Enrico Magli

We specialize techniques from topological data analysis to the problem of characterizing the topological complexity (as defined in the body of the paper) of a multi-class data set. As a by-product, a topological classifier is defined that…

机器学习 · 计算机科学 2024-06-10 Christopher Griffin , Trevor Karn , Benjamin Apple

The control of complex systems is an ongoing challenge of complexity research. Recent advances using concepts of structural control deduce a wide range of control related properties from the network representation of complex systems. Here,…

统计力学 · 物理学 2013-12-31 Márton Pósfai , Philipp Hövel

Recently, different approaches have been proposed for studying basic properties of time series from a complex network perspective. In this work, the corresponding potentials and limitations of networks based on recurrences in phase space…

混沌动力学 · 物理学 2010-01-27 Reik V. Donner , Yong Zou , Jonathan F. Donges , Norbert Marwan , Juergen Kurths