English
Related papers

Related papers: Sign and Basis Invariant Networks for Spectral Gra…

200 papers

This paper studies learning the representations of whole graphs in both unsupervised and semi-supervised scenarios. Graph-level representations are critical in a variety of real-world applications such as predicting the properties of…

Machine Learning · Computer Science 2020-01-20 Fan-Yun Sun , Jordan Hoffmann , Vikas Verma , Jian Tang

Due to the fact much of today's data can be represented as graphs, there has been a demand for generalizing neural network models for graph data. One recent direction that has shown fruitful results, and therefore growing interest, is the…

Social and Information Networks · Computer Science 2018-08-21 Tyler Derr , Yao Ma , Jiliang Tang

The fast development of self-supervised learning lowers the bar learning feature representation from massive unlabeled data and has triggered a series of research on change detection of remote sensing images. Challenges in adapting…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Meiqi Hu , Chen Wu , Liangpei Zhang

Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to specific symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they…

Self-supervised learning methods overcome the key bottleneck for building more capable AI: limited availability of labeled data. However, one of the drawbacks of self-supervised architectures is that the representations that they learn are…

Machine Learning · Computer Science 2022-07-08 Avi Ziskind , Sujeong Kim , Giedrius T. Burachas

We propose a metric learning framework for the construction of invariant geometric functions of planar curves for the Eucledian and Similarity group of transformations. We leverage on the representational power of convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Gautam Pai , Aaron Wetzler , Ron Kimmel

We show that standard Transformers without graph-specific modifications can lead to promising results in graph learning both in theory and practice. Given a graph, we simply treat all nodes and edges as independent tokens, augment them with…

Machine Learning · Computer Science 2022-10-25 Jinwoo Kim , Tien Dat Nguyen , Seonwoo Min , Sungjun Cho , Moontae Lee , Honglak Lee , Seunghoon Hong

Recent works on representation learning for graph structured data predominantly focus on learning distributed representations of graph substructures such as nodes and subgraphs. However, many graph analytics tasks such as graph…

Artificial Intelligence · Computer Science 2017-07-18 Annamalai Narayanan , Mahinthan Chandramohan , Rajasekar Venkatesan , Lihui Chen , Yang Liu , Shantanu Jaiswal

Just like weights, bias terms are the learnable parameters of many popular machine learning models, including neural networks. Biases are thought to enhance the representational power of neural networks, enabling them to solve a variety of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Chuqin Geng , Xiaojie Xu , Haolin Ye , Xujie Si

We put forth a principled design of a neural architecture to learn nodal Adjacency Spectral Embeddings (ASE) from graph inputs. By bringing to bear the gradient descent (GD) method and leveraging the principle of algorithm unrolling, we…

Machine Learning · Computer Science 2025-08-29 Sofía Pérez Casulo , Marcelo Fiori , Federico Larroca , Gonzalo Mateos

Laplacian eigenvectors capture natural community structures on graphs and are widely used in spectral clustering and manifold learning. The use of Laplacian eigenvectors as embeddings for the purpose of multiscale graph comparison has…

Machine Learning · Statistics 2023-02-07 Edric Tam , David Dunson

Wave-like images--from attosecond streaking spectrograms to optical spectra, audio mel-spectrograms and periodic video frames--encode critical harmonic structures that elude conventional feature extractors. We propose a unified,…

Machine Learning · Computer Science 2026-01-06 Yuzhou Zhu , Zheng Zhang , Ruyi Zhang , Liang Zhou

In this paper, we study the entries of the principal eigenvector of the signless Laplacian matrix of a hypergraph. More precisely, we obtain bounds for this entries. These bounds are computed trough other important parameters, such as…

Combinatorics · Mathematics 2020-05-01 Kauê Cardoso

Graph is a highly generic and diverse representation, suitable for almost any data processing problem. Spectral graph theory has been shown to provide powerful algorithms, backed by solid linear algebra theory. It thus can be extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Or Streicher , Ido Cohen , Guy Gilboa

Representing a graph as a vector is a challenging task; ideally, the representation should be easily computable and conducive to efficient comparisons among graphs, tailored to the particular data and analytical task at hand. Unfortunately,…

Social and Information Networks · Computer Science 2018-11-16 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Alex Bronstein , Emmanuel Müller

Extracting robust and general 3D local features is key to downstream tasks such as point cloud registration and reconstruction. Existing learning-based local descriptors are either sensitive to rotation transformations, or rely on classical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Sheng Ao , Qingyong Hu , Bo Yang , Andrew Markham , Yulan Guo

Spectral-based graph neural networks (SGNNs) have been attracting increasing attention in graph representation learning. However, existing SGNNs are limited in implementing graph filters with rigid transforms (e.g., graph Fourier or…

Machine Learning · Computer Science 2022-01-05 Mingxing Xu , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong , Pascal Frossard

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

Machine Learning · Computer Science 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

The development of self-supervised graph pre-training methods is a crucial ingredient in recent efforts to design robust graph foundation models (GFMs). Structure-based pre-training methods are under-explored yet crucial for downstream…

Machine Learning · Computer Science 2025-11-11 Howard Dai , Nyambura Njenga , Hiren Madhu , Siddharth Viswanath , Ryan Pellico , Ian Adelstein , Smita Krishnaswamy

In this paper we define signless Laplacian matrix of a hypergraph and obtain structural properties from its eigenvalues. We generalize several known results for graphs, relating the spectrum of this matrix with structural parameters of the…

Spectral Theory · Mathematics 2024-08-12 Kauê Cardoso , Vilmar Trevisan