English
Related papers

Related papers: Improving Expressive Power of Spectral Graph Neura…

200 papers

We precisely characterize the expressivity of computable Recurrent Graph Neural Networks (recurrent GNNs). We prove that recurrent GNNs with finite-precision parameters, sum aggregation, and ReLU activation, can compute any graph algorithm…

Machine Learning · Computer Science 2026-03-17 Eran Rosenbluth , Martin Grohe

Geometric variations like rotation, scaling, and viewpoint changes pose a significant challenge to visual understanding. One common solution is to directly model certain intrinsic structures, e.g., using landmarks. However, it then becomes…

Machine Learning · Statistics 2020-10-13 Xiuyuan Cheng , Zichen Miao , Qiang Qiu

Graph neural networks (GNNs) hold the promise of learning efficient representations of graph-structured data, and one of its most important applications is semi-supervised node classification. However, in this application, GNN frameworks…

Machine Learning · Computer Science 2023-05-04 Jiaqi Sun , Lin Zhang , Shenglin Zhao , Yujiu Yang

Spectral Graph Neural Networks (GNNs) are gaining attention for their ability to surpass the limitations of message-passing GNNs. They rely on supervision from downstream tasks to learn spectral filters that capture the graph signal's…

Machine Learning · Computer Science 2024-05-24 Junjie Xu , Enyan Dai , Dongsheng Luo , Xiang Zhang , Suhang Wang

Message-Passing Graph Neural Networks (GNNs) are known to have limited expressive power, due to their message passing structure. One mechanism for circumventing this limitation is to add unique node identifiers (IDs), which break the…

Machine Learning · Computer Science 2025-02-20 Maya Bechler-Speicher , Moshe Eliasof , Carola-Bibiane Schonlieb , Ran Gilad-Bachrach , Amir Globerson

Collaborative Filtering (CF) is a pivotal research area in recommender systems that capitalizes on collaborative similarities between users and items to provide personalized recommendations. With the remarkable achievements of node…

Information Retrieval · Computer Science 2024-01-30 Yifang Qin , Wei Ju , Xiao Luo , Yiyang Gu , Zhiping Xiao , Ming Zhang

The use of graph convolution in the development of recommender system algorithms has recently achieved state-of-the-art results in the collaborative filtering task (CF). While it has been demonstrated that the graph convolution operation is…

Information Retrieval · Computer Science 2023-05-31 Edoardo D'Amico , Aonghus Lawlor , Neil Hurley

It has been recently shown that general policies for many classical planning domains can be expressed and learned in terms of a pool of features defined from the domain predicates using a description logic grammar. At the same time, most…

Artificial Intelligence · Computer Science 2022-05-09 Simon Ståhlberg , Blai Bonet , Hector Geffner

Despite recent advances in representation learning in hypercomplex (HC) space, this subject is still vastly unexplored in the context of graphs. Motivated by the complex and quaternion algebras, which have been found in several contexts to…

Machine Learning · Computer Science 2022-02-22 Tuan Le , Marco Bertolini , Frank Noé , Djork-Arné Clevert

Graph Neural Networks (GNNs) exhibit excellent performance when graphs have strong homophily property, i.e. connected nodes have the same labels. However, they perform poorly on heterophilic graphs. Several approaches address the issue of…

Machine Learning · Computer Science 2021-07-29 Vijay Lingam , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

The core operation of current Graph Neural Networks (GNNs) is the aggregation enabled by the graph Laplacian or message passing, which filters the neighborhood information of nodes. Though effective for various tasks, in this paper, we show…

Machine Learning · Computer Science 2022-12-22 Sitao Luan , Mingde Zhao , Chenqing Hua , Xiao-Wen Chang , Doina Precup

Spectral Graph Neural Networks (SGNNs) have achieved remarkable performance in tasks such as node classification due to their ability to learn flexible filters. Typically, these filters are learned under the supervision of downstream tasks,…

Machine Learning · Computer Science 2025-08-06 Kangkang Lu , Yanhua Yu , Zhiyong Huang , Tat-Seng Chua

The spectrum of the normalized graph Laplacian yields a very comprehensive set of invariants of a graph. In order to understand the information contained in those invariants better, we systematically investigate the behavior of this…

Combinatorics · Mathematics 2012-10-19 Anirban Banerjee , Jürgen Jost

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.e., manually…

Machine Learning · Computer Science 2024-05-08 Mingguo He , Zhewei Wei , Shikun Feng , Zhengjie Huang , Weibin Li , Yu Sun , Dianhai Yu

Learning a graph with a specific structure is essential for interpretability and identification of the relationships among data. It is well known that structured graph learning from observed samples is an NP-hard combinatorial problem. In…

Machine Learning · Statistics 2019-09-26 Sandeep Kumar , Jiaxi Ying , Jos'e Vin'icius de M. Cardoso , Daniel P. Palomar

Polynomial filters, a kind of Graph Neural Networks, typically use a predetermined polynomial basis and learn the coefficients from the training data. It has been observed that the effectiveness of the model is highly dependent on the…

Machine Learning · Computer Science 2023-07-04 Yuhe Guo , Zhewei Wei

We study deep neural networks with polynomial activations, particularly their expressive power. For a fixed architecture and activation degree, a polynomial neural network defines an algebraic map from weights to polynomials. The image of…

Machine Learning · Computer Science 2019-05-30 Joe Kileel , Matthew Trager , Joan Bruna

Deep neural networks can be trained in reciprocal space, by acting on the eigenvalues and eigenvectors of suitable transfer operators in direct space. Adjusting the eigenvalues, while freezing the eigenvectors, yields a substantial…

Machine Learning · Computer Science 2021-12-08 Lorenzo Chicchi , Lorenzo Giambagli , Lorenzo Buffoni , Timoteo Carletti , Marco Ciavarella , Duccio Fanelli

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Designing spectral convolutional networks is a formidable task in graph learning. In traditional spectral graph neural networks (GNNs), polynomial-based methods are commonly used to design filters via the Laplacian matrix. In practical…

Machine Learning · Computer Science 2024-08-19 Gongpei Zhao , Tao Wang , Yi Jin , Congyan Lang , Yidong Li , Haibin Ling