English
Related papers

Related papers: Limitless stability for Graph Convolutional Networ…

200 papers

It is by now a well known fact in the graph learning community that the presence of bottlenecks severely limits the ability of graph neural networks to propagate information over long distances. What so far has not been appreciated is that,…

Machine Learning · Computer Science 2023-10-31 Christian Koke , Abhishek Saroha , Yuesong Shen , Marvin Eisenberger , Daniel Cremers

A stable population network is hard to interrupt without any ecological consequences. A communication blockage between patches may destabilize the populations in the ecological network. This work deals with the construction of a safe cut…

Dynamical Systems · Mathematics 2018-04-25 Dinesh Kumar , Jatin Gupta , Soumyendu Raha

Let G be a finite graph with the non-k-order property (essentially, a uniform finite bound on the size of an induced sub-half-graph). A major result of the paper applies model-theoretic arguments to obtain a stronger version of…

Logic · Mathematics 2015-08-20 M. Malliaris , S. Shelah

Continuous graph neural models based on differential equations have expanded the architecture of graph neural networks (GNNs). Due to the connection between graph diffusion and message passing, diffusion-based models have been widely…

Machine Learning · Computer Science 2024-04-01 Kaiyuan Cui , Xinyan Wang , Zicheng Zhang , Weichen Zhao

Many interesting problems in machine learning are being revisited with new deep learning tools. For graph-based semisupervised learning, a recent important development is graph convolutional networks (GCNs), which nicely integrate local…

Machine Learning · Computer Science 2018-01-24 Qimai Li , Zhichao Han , Xiao-Ming Wu

The goal of this work is to identify steady-state solutions to dynamical systems defined on large, random families of networks. We do so by passing to a continuum limit where the adjacency matrix is replaced by a non-local operator with…

Dynamical Systems · Mathematics 2026-02-26 Jason J. Bramburger , Matt Holzer , Jackson Williams

We study symmetric queuing networks with moving servers and FIFO service discipline. The mean-field limit dynamics demonstrates unexpected behavior which we attribute to the meta-stability phenomenon. Large enough finite symmetric networks…

Probability · Mathematics 2018-12-05 F. Baccelli , A. Rybko , S. Shlosman , A. Vladimirov

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Since the control of the Lipschitz constant has a great impact on the training stability, generalization, and robustness of neural networks, the estimation of this value is nowadays a real scientific challenge. In this paper we introduce a…

Machine Learning · Computer Science 2023-06-21 Blaise Delattre , Quentin Barthélemy , Alexandre Araujo , Alexandre Allauzen

We present a method which provides a unified framework for most stability theorems that have been proved in graph and hypergraph theory. Our main result reduces stability for a large class of hypergraph problems to the simpler question of…

Combinatorics · Mathematics 2022-11-15 Xizhi Liu , Dhruv Mubayi , Christian Reiher

Existing analyses of neural network training often operate under the unrealistic assumption of an extremely small learning rate. This lies in stark contrast to practical wisdom and empirical studies, such as the work of J. Cohen et al.…

Machine Learning · Computer Science 2023-10-20 Kwangjun Ahn , Sébastien Bubeck , Sinho Chewi , Yin Tat Lee , Felipe Suarez , Yi Zhang

Semi-supervised learning on graph structured data has received significant attention with the recent introduction of Graph Convolution Networks (GCN). While traditional methods have focused on optimizing a loss augmented with Laplacian…

Machine Learning · Computer Science 2019-01-04 Prateek Yadav , Madhav Nimishakavi , Naganand Yadati , Shikhar Vashishth , Arun Rajkumar , Partha Talukdar

In many network problems, graphs may change by the addition of nodes, or the same problem may need to be solved in multiple similar graphs. This generates inefficiency, as analyses and systems that are not transferable have to be…

Signal Processing · Electrical Eng. & Systems 2019-11-11 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations have been offered for this generalization performance, a…

Machine Learning · Computer Science 2021-02-11 Yikai Zhang , Wenjia Zhang , Sammy Bald , Vamsi Pingali , Chao Chen , Mayank Goswami

This paper aims at studying the sample complexity of graph convolutional networks (GCNs), by providing tight upper bounds of Rademacher complexity for GCN models with a single hidden layer. Under regularity conditions, theses derived…

Machine Learning · Statistics 2021-02-23 Shaogao Lv

Geometric variations like rotation, scaling, and viewpoint changes pose a significant challenge to visual understanding. One common solution is to directly model certain intrinsic structures, e.g., using landmarks. However, it then becomes…

Machine Learning · Statistics 2020-10-13 Xiuyuan Cheng , Zichen Miao , Qiang Qiu

We consider the problem of learning a graph from a finite set of noisy graph signal observations, the goal of which is to find a smooth representation of the graph signal. Such a problem is motivated by the desire to infer relational…

Machine Learning · Computer Science 2023-02-08 Xiaolu Wang , Yuen-Man Pun , Anthony Man-Cho So

Stabilization of graphs has received substantial attention in recent years due to its connection to game theory. Stable graphs are exactly the graphs inducing a matching game with non-empty core. They are also the graphs that induce a…

Discrete Mathematics · Computer Science 2016-08-25 Karthekeyan Chandrasekaran , Corinna Gottschalk , Jochen Könemann , Britta Peis , Daniel Schmand , Andreas Wierz

A central question of network science is how functional properties of systems arise from their structure. For networked dynamical systems, structure is typically quantified with network measures. A functional property that is of theoretical…

Adaptation and Self-Organizing Systems · Physics 2024-02-28 Christian Nauck , Michael Lindner , Nora Molkenthin , Jürgen Kurths , Eckehard Schöll , Jörg Raisch , Frank Hellmann

Defining a sound shift operator for signals existing on a certain graph structure, similar to the well-defined shift operator in classical signal processing, is a crucial problem in graph signal processing, since almost all operations, such…

Spectral Theory · Mathematics 2017-09-07 Adnan Gavili , Xiao-Ping Zhang