English
Related papers

Related papers: On the Global Self-attention Mechanism for Graph C…

200 papers

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Graph Convolutional Networks (GCNs) have become a pivotal method in machine learning for modeling functions over graphs. Despite their widespread success across various applications, their statistical properties (e.g., consistency,…

Machine Learning · Computer Science 2025-04-17 Juntong Chen , Johannes Schmidt-Hieber , Claire Donnat , Olga Klopp

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a…

Machine Learning · Computer Science 2021-10-29 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Contextually Guided Convolutional Neural Networks (CG-CNNs) employ self-supervision and contextual information to develop transferable features across diverse domains, including visual, tactile, temporal, and textual data. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Olcay Kursun , Ahmad Patooghy , Peyman Poursani , Oleg V. Favorov

Answer selection (answer ranking) is one of the key steps in many kinds of question answering (QA) applications, where deep models have achieved state-of-the-art performance. Among these deep models, recurrent neural network (RNN) based…

Computation and Language · Computer Science 2019-05-28 Dong Xu , Jianhui Ji , Haikuan Huang , Hongbo Deng , Wu-Jun Li

Recommendation models utilizing Graph Convolutional Networks (GCNs) have achieved state-of-the-art performance, as they can integrate both the node information and the topological structure of the user-item interaction graph. However, these…

Information Retrieval · Computer Science 2022-11-28 Xin Zhou , Donghui Lin , Yong Liu , Chunyan Miao

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

Graph convolutional networks (GCNs) have been proved to be very practical to handle various graph-related tasks. It has attracted considerable research interest to study deep GCNs, due to their potential superior performance compared with…

Machine Learning · Computer Science 2023-02-13 Lei Zhang , Xiaodong Yan , Jianshan He , Ruopeng Li , Wei Chu

We present an attention-based spatial graph convolution (AGC) for graph neural networks (GNNs). Existing AGCs focus on only using node-wise features and utilizing one type of attention function when calculating attention weights. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Li , Yuichi Tanaka

With the tremendous success of Graph Convolutional Networks (GCNs), they have been widely applied to recommender systems and have shown promising performance. However, most GCN-based methods rigorously stick to a common GCN learning…

Information Retrieval · Computer Science 2022-09-07 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

Gait emotion recognition plays a crucial role in the intelligent system. Most of the existing methods recognize emotions by focusing on local actions over time. However, they ignore that the effective distances of different emotions in the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yunfei Yin , Li Jing , Faliang Huang , Guangchao Yang , Zhuowei Wang

Recently, graph convolutional networks (GCNs) have been developed to explore spatial relationship between pixels, achieving better classification performance of hyperspectral images (HSIs). However, these methods fail to sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jin-Yu Yang , Heng-Chao Li , Wen-Shuai Hu , Lei Pan , Qian Du

When the trained physician interprets medical images, they understand the clinical importance of visual features. By applying cognitive attention, they apply greater focus onto clinically relevant regions while disregarding unnecessary…

Image and Video Processing · Electrical Eng. & Systems 2021-09-06 Adrit Rao , Jongchan Park , Sanghyun Woo , Joon-Young Lee , Oliver Aalami

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Learning graph convolutional networks (GCNs) is an emerging field which aims at generalizing convolutional operations to arbitrary non-regular domains. In particular, GCNs operating on spatial domains show superior performances compared to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Hichem Sahbi

Traditional graph neural networks (GNNs) lack scalability and lose individual node characteristics due to over-smoothing, especially in the case of deeper networks. This results in sub-optimal feature representation, affecting the model's…

Machine Learning · Computer Science 2025-12-09 Shikhar Vashistha , Neetesh Kumar

Graph Neural Networks (GNNs) have shown great success in various graph-based learning tasks. However, it often faces the issue of over-smoothing as the model depth increases, which causes all node representations to converge to a single…

Machine Learning · Computer Science 2026-04-13 Xin He , Yili Wang , Wenqi Fan , Xu Shen , Xin Juan , Rui Miao , Xin Wang

Graph Convolution Networks (GCN) are widely used in learning graph representations due to their effectiveness and efficiency. However, they suffer from the notorious over-smoothing problem, in which the learned representations of densely…

Machine Learning · Computer Science 2020-04-10 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

We introduce a novel self-attention mechanism, which we call CSA (Chromatic Self-Attention), which extends the notion of attention scores to attention _filters_, independently modulating the feature channels. We showcase CSA in a…

Machine Learning · Computer Science 2023-04-24 Romain Menegaux , Emmanuel Jehanno , Margot Selosse , Julien Mairal