English
Related papers

Related papers: Geometry of Linear Convolutional Networks

200 papers

Deep Learning (DL) has attracted a lot of attention for its ability to reach state-of-the-art performance in many machine learning tasks. The core principle of DL methods consists in training composite architectures in an end-to-end…

Machine Learning · Computer Science 2020-11-17 Carlos Lassance , Vincent Gripon , Antonio Ortega

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo

Following the traditional paradigm of convolutional neural networks (CNNs), modern CNNs manage to keep pace with more recent, for example transformer-based, models by not only increasing model depth and width but also the kernel size. This…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Paul Gavrikov , Janis Keuper

Graph Neural Networks (GNNs), especially message-passing neural networks (MPNNs), have emerged as powerful architectures for learning on graphs in diverse applications. However, MPNNs face challenges when modeling non-local interactions in…

Machine Learning · Statistics 2024-01-31 Ilyes Batatia , Lars L. Schaaf , Huajie Chen , Gábor Csányi , Christoph Ortner , Felix A. Faber

We introduce a family of multilayer graph kernels and establish new links between graph convolutional neural networks and kernel methods. Our approach generalizes convolutional kernel networks to graph-structured data, by representing…

Machine Learning · Statistics 2020-06-30 Dexiong Chen , Laurent Jacob , Julien Mairal

Graph Convolutional Networks (GCNs) have shown to be effective in handling unordered data like point clouds and meshes. In this work we propose novel approaches for graph convolution, pooling and unpooling, inspired from finite differences…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Moshe Eliasof , Eran Treister

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Superior performance and ease of implementation have fostered the adoption of Convolutional Neural Networks (CNNs) for a wide array of inference and reconstruction tasks. CNNs implement three basic blocks: convolution, pooling and pointwise…

Machine Learning · Computer Science 2018-03-07 Fernando Gama , Antonio G. Marques , Alejandro Ribeiro , Geert Leus

This work is concerned with a representation of shapes that disentangles fine, local and possibly repeating geometry, from global, coarse structures. Achieving such disentanglement leads to two unrelated advantages: i) a significant…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Luca Morreale , Noam Aigerman , Paul Guerrero , Vladimir G. Kim , Niloy J. Mitra

Surface meshes are widely used shape representations and capture finer geometry data than point clouds or volumetric grids, but are challenging to apply CNNs directly due to their non-Euclidean structure. We use parallel frames on surface…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Yuqi Yang , Shilin Liu , Hao Pan , Yang Liu , Xin Tong

Graph convolutional networks (GCNs) have achieved great success on graph-structured data. Many graph convolutional networks can be thought of as low-pass filters for graph signals. In this paper, we propose a more powerful graph…

Machine Learning · Computer Science 2023-06-22 Zhixian Chen , Tengfei Ma , Zhihua Jin , Yangqiu Song , Yang Wang

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vision tasks, mainly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Boris Knyazev , Xiao Lin , Mohamed R. Amer , Graham W. Taylor

Graph Neural Networks (GNNs) are a class of neural networks designed to extract information from the graphical structure of data. Graph Convolutional Networks (GCNs) are a widely used type of GNN for transductive graph learning problems…

Machine Learning · Computer Science 2022-12-05 Matthew Adiletta , David Brooks , Gu-Yeon Wei

Normalization layers have been shown to improve convergence in deep neural networks, and even add useful inductive biases. In many vision applications the local spatial context of the features is important, but most common normalization…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Anthony Ortiz , Caleb Robinson , Dan Morris , Olac Fuentes , Christopher Kiekintveld , Md Mahmudulla Hassan , Nebojsa Jojic

Successful training of convolutional neural networks is often associated with sufficiently deep architectures composed of high amounts of features. These networks typically rely on a variety of regularization and pruning techniques to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Martin Mundt , Tobias Weis , Kishore Konda , Visvanathan Ramesh

While initially devised for image categorization, convolutional neural networks (CNNs) are being increasingly used for the pixelwise semantic labeling of images. However, the proper nature of the most common CNN architectures makes them…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Emmanuel Maggiori , Guillaume Charpiat , Yuliya Tarabalka , Pierre Alliez

We present a novel approach to modelling and learning vector fields from physical systems using neural networks that explicitly satisfy known linear operator constraints. To achieve this, the target function is modelled as a linear…

Machine Learning · Statistics 2021-04-29 Johannes Hendriks , Carl Jidling , Adrian Wills , Thomas Schön

This paper is concerned with a fundamental problem in geometric deep learning that arises in the construction of convolutional neural networks on surfaces. Due to curvature, the transport of filter kernels on surfaces results in a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Ruben Wiersma , Elmar Eisemann , Klaus Hildebrandt

Current research in Computer Vision has shown that Convolutional Neural Networks (CNN) give state-of-the-art performance in many classification tasks and Computer Vision problems. The embedding of CNN, which is the internal representation…

Computer Vision and Pattern Recognition · Computer Science 2015-08-04 Axel Angel

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on visual object classification tasks. In addition, it is a useful model for predication of neuronal responses recorded in visual system. However, there is…

Machine Learning · Statistics 2017-11-15 Qi Yan , Zhaofei Yu , Feng Chen , Jian K. Liu