English
Related papers

Related papers: On the Global Self-attention Mechanism for Graph C…

200 papers

Self-supervised learning of graph neural networks (GNNs) aims to learn an accurate representation of the graphs in an unsupervised manner, to obtain transferable representations of them for diverse downstream tasks. Predictive learning and…

Machine Learning · Computer Science 2022-10-11 Dongki Kim , Jinheon Baek , Sung Ju Hwang

The Graph Convolutional Networks (GCN) proposed by Kipf and Welling is an effective model for semi-supervised learning, but faces the obstacle of over-smoothing, which will weaken the representation ability of GCN. Recently some works are…

Machine Learning · Computer Science 2022-05-20 Xue Liu , Dan Sun , Wei Wei

Many real-world applications involve multivariate, geo-tagged time series data: at each location, multiple sensors record corresponding measurements. For example, air quality monitoring system records PM2.5, CO, etc. The resulting…

Machine Learning · Computer Science 2019-08-06 Jiawei Ma , Zheng Shou , Alireza Zareian , Hassan Mansour , Anthony Vetro , Shih-Fu Chang

Over the last few years, we have witnessed the availability of an increasing data generated from non-Euclidean domains, which are usually represented as graphs with complex relationships, and Graph Neural Networks (GNN) have gained a high…

Machine Learning · Computer Science 2023-08-15 Andrea Apicella , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

The shared topology of human skeletons motivated the recent investigation of graph convolutional network (GCN) solutions for action recognition. However, most of the existing GCNs rely on the binary connection of two neighboring vertices…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Youwei Zhou , Tianyang Xu , Cong Wu , Xiaojun Wu , Josef Kittler

Various approaches have been proposed for providing efficient computational approaches for abstract argumentation. Among them, neural networks have permitted to solve various decision problems, notably related to arguments (credulous or…

Artificial Intelligence · Computer Science 2024-09-26 Paul Cibier , Jean-Guy Mailly

Graph neural networks (GNNs) learn the representation of graph-structured data, and their expressiveness can be further enhanced by inferring node relations for propagation. Attention-based GNNs infer neighbor importance to manipulate the…

Machine Learning · Computer Science 2023-06-06 Soo Yong Lee , Fanchen Bu , Jaemin Yoo , Kijung Shin

Graph Neural Networks (GNNs) are increasingly becoming the favorite method for graph learning. They exploit the semi-supervised nature of deep learning, and they bypass computational bottlenecks associated with traditional graph learning…

Machine Learning · Computer Science 2023-11-08 Mashaan Alshammari , John Stavrakakis , Adel F. Ahmed , Masahiro Takatsuka

Due to their inherent capability in semantic alignment of aspects and their context words, attention mechanism and Convolutional Neural Networks (CNNs) are widely applied for aspect-based sentiment classification. However, these models lack…

Computation and Language · Computer Science 2019-10-15 Chen Zhang , Qiuchi Li , Dawei Song

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

Machine Learning · Computer Science 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf

Graphs are useful for representing various realworld objects. However, graph neural networks (GNNs) tend to suffer from over-smoothing, where the representations of nodes of different classes become similar as the number of layers…

Machine Learning · Computer Science 2024-10-22 Jun Kato , Airi Mita , Keita Gobara , Akihiro Inokuchi

In representation learning on the graph-structured data, under heterophily (or low homophily), many popular GNNs may fail to capture long-range dependencies, which leads to their performance degradation. To solve the above-mentioned issue,…

Machine Learning · Computer Science 2021-06-29 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

Important advances have been made using convolutional neural network (CNN) approaches to solve complicated problems in areas that rely on grid structured data such as image processing and object classification. Recently, research on graph…

Machine Learning · Statistics 2018-08-24 Matthew Baron

Transformer attention architectures, similar to those developed for natural language processing, have recently proved efficient also in vision, either in conjunction with or as a replacement for convolutional layers. Typically, visual…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Rufin VanRullen , Andrea Alamia

Real world data is mostly unlabeled or only few instances are labeled. Manually labeling data is a very expensive and daunting task. This calls for unsupervised learning techniques that are powerful enough to achieve comparable results as…

Machine Learning · Computer Science 2021-05-21 Zekarias T. Kefato , Sarunas Girdzijauskas

In this paper, we propose Global Context Convolutional Network (GCCN) for visual recognition. GCCN computes global features representing contextual information across image patches. These global contextual features are defined as local…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Ali Hamdi , Flora Salim , Du Yong Kim

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. We investigate the power of GCNs, as a function of their number of layers, to distinguish between different random graph models on the basis of…

Machine Learning · Statistics 2020-02-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

Convolution neural networks (CNNs) based methods have dominated the low-light image enhancement tasks due to their outstanding performance. However, the convolution operation is based on a local sliding window mechanism, which is difficult…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Keqi Wang , Ziteng Cui , Jieru Jia , Hao Xu , Ge Wu , Yin Zhuang , Lu Chen , Zhiguo Hu , Yuhua Qian

We define a novel type of ensemble Graph Convolutional Network (GCN) model. Using optimized linear projection operators to map between spatial scales of graph, this ensemble model learns to aggregate information from each scale for its…

Machine Learning · Computer Science 2020-04-08 C. B. Scott , Eric Mjolsness

Although hypergraph neural networks (HGNNs) have emerged as a powerful framework for analyzing complex datasets, their practical performance often remains limited. On one hand, existing networks typically employ a single type of attention…

Machine Learning · Computer Science 2025-11-14 Murong Yang , Shihui Ying , Yue Gao , Xin-Jian Xu