English
Related papers

Related papers: Algebraic Convolutional Filters on Lie Group Algeb…

200 papers

This paper reviews graph convolutional neural networks (GCNNs) through the lens of edge-variant graph filters. The edge-variant graph filter is a finite order, linear, and local recursion that allows each node, in each iteration, to weigh…

Machine Learning · Computer Science 2019-03-05 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Deep convolutional networks (convnets) show a remarkable ability to learn disentangled representations. In recent years, the generalization of deep learning to Lie groups beyond rigid motion in $\mathbb{R}^n$ has allowed to build convnets…

Machine Learning · Computer Science 2020-11-13 Christopher Ick , Vincent Lostanlen

Graph Signal Processing deals with the problem of analyzing and processing signals defined on graphs. In this paper, we introduce a novel filtering method for graph-based signals by employing ideas from topological data analysis. We begin…

Signal Processing · Electrical Eng. & Systems 2024-08-27 Matias de Jong van Lier , Sebastián Elías Graiff Zurita , Shizuo Kaji

Algebraic neural networks (AlgNNs) are composed of a cascade of layers each one associated to and algebraic signal model, and information is mapped between layers by means of a nonlinearity function. AlgNNs provide a generalization of…

Machine Learning · Computer Science 2020-10-23 Alejandro Parada-Mayorga , Alejandro Ribeiro

Convolutional neural networks have achieved great success in various vision tasks; however, they incur heavy resource costs. By using deeper and wider networks, network accuracy can be improved rapidly. However, in an environment with…

Computer Vision and Pattern Recognition · Computer Science 2018-11-01 Yunho Jeon , Junmo Kim

We introduce group crosscoders, an extension of crosscoders that systematically discover and analyse symmetrical features in neural networks. While neural networks often develop equivariant representations without explicit architectural…

Machine Learning · Computer Science 2024-11-04 Liv Gorton

While convolutional neural networks (CNNs) have recently made great strides in supervised classification of data structured on a grid (e.g. images composed of pixel grids), in several interesting datasets, the relations between features can…

Machine Learning · Computer Science 2018-11-02 Shrey Gadiya , Deepak Anand , Amit Sethi

This paper presents an algebraic theory of linear signal processing. At the core of algebraic signal processing is the concept of a linear signal model defined as a triple (A, M, phi), where familiar concepts like the filter space and the…

Information Theory · Computer Science 2021-05-11 Markus Püschel , José M. F. Moura

We study a blind deconvolution problem on graphs, which arises in the context of localizing a few sources that diffuse over networks. While the observations are bilinear functions of the unknown graph filter coefficients and sparse input…

Signal Processing · Electrical Eng. & Systems 2024-09-19 Chang Ye , Gonzalo Mateos

Network processes are often represented as signals defined on the vertices of a graph. To untangle the latent structure of such signals, one can view them as outputs of linear graph filters modeling underlying network dynamics. This paper…

Information Theory · Computer Science 2017-08-23 Santiago Segarra , Gonzalo Mateos , Antonio G. Marques , Alejandro Ribeiro

In this paper, we present a novel convolution theorem which encompasses the well known convolution theorem in (graph) signal processing as well as the one related to time-varying filters. Specifically, we show how a node-wise convolution…

Signal Processing · Electrical Eng. & Systems 2023-12-29 Alberto Natali , Geert Leus

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

In a deep neural network (DNN), the number of the parameters is usually huge to get high learning performances. For that reason, it costs a lot of memory and substantial computational resources, and also causes overfitting. It is known that…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Kakeru Mitsuno , Junichi Miyao , Takio Kurita

Convolutional neural networks revolutionized computer vision and natrual language processing. Their efficiency, as compared to fully connected neural networks, has its origin in the architecture, where convolutions reflect the translation…

Machine Learning · Computer Science 2023-01-10 Patrick Krüger , Hanno Gottschalk

The success of convolutional networks in learning problems involving planar signals such as images is due to their ability to exploit the translation symmetry of the data distribution through weight sharing. Many areas of science and…

Machine Learning · Computer Science 2019-04-23 Taco Cohen , Mario Geiger , Jonas Köhler , Max Welling

Although provably robust to translational perturbations, convolutional neural networks (CNNs) are known to suffer from extreme performance degradation when presented at test time with more general geometric transformations of inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Lachlan Ewen MacDonald , Sameera Ramasinghe , Simon Lucey

We introduce a convolutional neural network that operates directly on graphs. These networks allow end-to-end learning of prediction pipelines whose inputs are graphs of arbitrary size and shape. The architecture we present generalizes…

Two Lie algebroids are presented that are linked to the construction of the linearizing output of an affine in the input nonlinear system. The algorithmic construction of the linearizing output proceeds inductively, and each stage has two…

Optimization and Control · Mathematics 2019-01-29 Müllhaupt , Philippe

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro