English
Related papers

Related papers: Mamba-Based Graph Convolutional Networks: Tackling…

200 papers

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features…

Machine Learning · Computer Science 2024-07-30 Dongzhuoran Zhou , Hui Yang , Bo Xiong , Yue Ma , Evgeny Kharlamov

In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependencies due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ionuţ Grigore , Călin-Adrian Popa

Graph data, also known as complex network data, is omnipresent across various domains and applications. Prior graph neural network models primarily focused on extracting task-specific structural features through supervised learning…

Machine Learning · Computer Science 2024-03-26 Hongyin Zhu

GNNs are widely used to solve various tasks including node classification and link prediction. Most of the GNN architectures assume the initial embedding to be random or generated from popular distributions. These initial embeddings require…

Machine Learning · Computer Science 2024-01-31 Shraban Kumar Chatterjee , Suman Kundu

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

Machine Learning · Computer Science 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

Accurate detection of cardiac abnormalities from electrocardiogram recordings is regarded as essential for clinical diagnostics and decision support. Traditional deep learning models such as residual networks and transformer architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huawei Jiang , Husna Mutahira , Gan Huang , Mannan Saeed Muhammad

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Graph convolution networks, like message passing graph convolution networks (MPGCNs), have been a powerful tool in representation learning of networked data. However, when data is heterogeneous, most architectures are limited as they employ…

Machine Learning · Computer Science 2021-06-21 Xing Gao , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong , Pascal Frossard

One main challenge in imbalanced graph classification is to learn expressive representations of the graphs in under-represented (minority) classes. Existing generic imbalanced learning methods, such as oversampling and imbalanced learning…

Machine Learning · Computer Science 2024-05-20 Rongrong Ma , Guansong Pang , Ling Chen

Recommender models aimed at mining users' behavioral patterns have raised great attention as one of the essential applications in daily life. Recent work on graph neural networks (GNNs) or debiasing methods has attained remarkable gains.…

Information Retrieval · Computer Science 2024-09-05 Xinfeng Wang , Fumiyo Fukumoto , Jin Cui , Yoshimi Suzuki , Jiyi Li , Dongjin Yu

Graph representation learning resurges as a trending research subject owing to the widespread use of deep learning for Euclidean data, which inspire various creative designs of neural networks in the non-Euclidean domain, particularly…

Graph Convolutional Networks (GCNs) are widely used in graph-based applications, such as social networks and recommendation systems. Nevertheless, large-scale graphs or deep aggregation layers in full-batch GCNs consume significant GPU…

Machine Learning · Computer Science 2024-10-15 Shengwei Ji , Yujie Tian , Fei Liu , Xinlu Li , Le Wu

Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or…

Machine Learning · Computer Science 2022-04-01 Li Zhang , Heda Song , Nikolaos Aletras , Haiping Lu

Graph Neural Networks (GNNs) are a framework for graph representation learning, where a model learns to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an…

Machine Learning · Computer Science 2020-12-15 Davide Buffelli , Fabio Vandin

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

Graph Convolutional Networks (GCNs) suffer from severe performance degradation in deep architectures due to over-smoothing. While existing studies primarily attribute the over-smoothing to repeated applications of graph Laplacian operators,…

Machine Learning · Computer Science 2025-07-23 Furong Peng , Jinzhen Gao , Xuan Lu , Kang Liu , Yifan Huo , Sheng Wang

With the tremendous success of Graph Convolutional Networks (GCNs), they have been widely applied to recommender systems and have shown promising performance. However, most GCN-based methods rigorously stick to a common GCN learning…

Information Retrieval · Computer Science 2022-09-07 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

As a special field in deep learning, Graph Neural Networks (GNNs) focus on extracting intrinsic network features and have drawn unprecedented popularity in both academia and industry. Most of the state-of-the-art GNN models offer…

Machine Learning · Computer Science 2021-08-17 Qinyi Zhu , Yiou Xiao

Within the family of convolutional neural networks, InceptionNeXt has shown excellent competitiveness in image classification and a number of downstream tasks. Built on parallel one-dimensional strip convolutions, however, it suffers from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuhang Wang , Jun Li , Zhijian Wu , Jifeng Shen , Jianhua Xu , Wankou Yang

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao