中文
相关论文

相关论文: Universality of Group Convolutional Neural Network…

200 篇论文

Deep Convolutional Neural Networks (CNNs) are capable of learning unprecedentedly effective features from images. Some researchers have struggled to enhance the parameters' efficiency using grouped convolution. However, the relation between…

计算机视觉与模式识别 · 计算机科学 2017-06-22 Yujia Chen , Ce Li

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

机器学习 · 计算机科学 2021-06-08 Waïss Azizian , Marc Lelarge

Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimensional disentangled…

机器学习 · 计算机科学 2021-03-23 Erik J Bekkers

Convolutional neural networks or standard CNNs (StdCNNs) are translation-equivariant models that achieve translation invariance when trained on data augmented with sufficient translations. Recent work on equivariant models for a given group…

机器学习 · 计算机科学 2020-06-09 Sandesh Kamath , Amit Deshpande , K V Subrahmanyam

The mining and exploitation of graph structural information have been the focal points in the study of complex networks. Traditional structural measures in Network Science focus on the analysis and modelling of complex networks from the…

社会与信息网络 · 计算机科学 2023-06-21 Mingshan Jia , Bogdan Gabrys , Katarzyna Musial

We identify hidden layers inside a deep neural network (DNN) with group actions on the data domain, and formulate a formal deep network as a dual voice transform with respect to the Koopman operator, a linear representation of the group…

机器学习 · 计算机科学 2023-11-14 Sho Sonoda , Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda

We analyse the power of graph neural networks (GNNs) in terms of Boolean circuit complexity and descriptive complexity. We prove that the graph queries that can be computed by a polynomial-size bounded-depth family of GNNs are exactly those…

计算机科学中的逻辑 · 计算机科学 2024-12-11 Martin Grohe

Graph Neural Networks (GNNs) extend convolutional neural networks to operate on graphs. Despite their impressive performances in various graph learning tasks, the theoretical understanding of their generalization capability is still…

机器学习 · 计算机科学 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

We analyze the universality and generalization of graph neural networks (GNNs) on attributed graphs, i.e., with node attributes. To this end, we propose pseudometrics over the space of all attributed graphs that describe the fine-grained…

机器学习 · 计算机科学 2025-08-27 Levi Rauchwerger , Stefanie Jegelka , Ron Levie

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

机器学习 · 计算机科学 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Interest has been rising lately towards methods representing data in non-Euclidean spaces, e.g. hyperbolic or spherical, that provide specific inductive biases useful for certain real-world data properties, e.g. scale-free, hierarchical or…

机器学习 · 计算机科学 2020-05-20 Gregor Bachmann , Gary Bécigneul , Octavian-Eugen Ganea

Graph Neural Networks (GNNs) have shown remarkable performance in structured data modeling tasks such as node classification. However, mainstream approaches generally rely on a large number of trainable parameters and fixed aggregation…

机器学习 · 计算机科学 2026-02-17 Mingyue Kong , Yinglong Zhang , Chengda Xu , Xuewen Xia , Xing Xu

Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN…

计算机视觉与模式识别 · 计算机科学 2023-04-18 David M. Knigge , David W. Romero , Albert Gu , Efstratios Gavves , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn , Jan-Jakob Sonke

Capturing feature information effectively is of great importance in vision tasks. With the development of convolutional neural networks (CNNs), concepts like residual connection and multiple scales promote continual performance gains on…

计算机视觉与模式识别 · 计算机科学 2023-01-03 Yuanpeng He

The Convolutional Neural Network (CNN) is one of the most prominent neural network architectures in deep learning. Despite its widespread adoption, our understanding of its universal approximation properties has been limited due to its…

神经与进化计算 · 计算机科学 2023-12-05 Geonho Hwang , Myungjoo Kang

Devising and analyzing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an…

机器学习 · 计算机科学 2022-07-01 Mohammad Sabbaqi , Elvin Isufi

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

机器学习 · 计算机科学 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

We investigate the expressive power of depth-2 bandlimited random neural networks. A random net is a neural network where the hidden layer parameters are frozen with random assignment, and only the output layer parameters are trained by…

机器学习 · 计算机科学 2023-06-01 Ming Li , Sho Sonoda , Feilong Cao , Yu Guang Wang , Jiye Liang

In this work, we are interested in generalizing convolutional neural networks (CNNs) from low-dimensional regular grids, where image, video and speech are represented, to high-dimensional irregular domains, such as social networks, brain…

机器学习 · 计算机科学 2017-02-07 Michaël Defferrard , Xavier Bresson , Pierre Vandergheynst