English
Related papers

Related papers: Cluster-wise Graph Transformer with Dual-granulari…

200 papers

How can we find meaningful clusters in a graph robustly against noise edges? Graph clustering (i.e., dividing nodes into groups of similar ones) is a fundamental problem in graph analysis with applications in various fields. Recent studies…

Machine Learning · Computer Science 2023-11-09 Hyeonsoo Jo , Fanchen Bu , Kijung Shin

Deep self-expressiveness-based subspace clustering methods have demonstrated effectiveness. However, existing works only consider the attribute information to conduct the self-expressiveness, which may limit the clustering performance. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

We study the problem of clustering nodes in a dynamic graph, where the connections between nodes and nodes' cluster memberships may change over time, e.g., due to community migration. We first propose a dynamic stochastic block model that…

Machine Learning · Computer Science 2021-06-24 Yuhang Yao , Carlee Joe-Wong

Graph neural networks (GNNs) have become increasingly popular in modeling graph-structured data due to their ability to learn node representations by aggregating local structure information. However, it is widely acknowledged that the test…

Machine Learning · Computer Science 2024-03-07 Donglin Xia , Xiao Wang , Nian Liu , Chuan Shi

Neural machine translation (NMT) usually works in a seq2seq learning way by viewing either source or target sentence as a linear sequence of words, which can be regarded as a special case of graph, taking words in the sequence as nodes and…

Computation and Language · Computer Science 2020-09-17 Sufeng Duan , Hai Zhao , Rui Wang

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural inductive biases and…

Machine Learning · Statistics 2022-06-14 Dexiong Chen , Leslie O'Bray , Karsten Borgwardt

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò

Recent works on representation learning for graph structured data predominantly focus on learning distributed representations of graph substructures such as nodes and subgraphs. However, many graph analytics tasks such as graph…

Artificial Intelligence · Computer Science 2017-07-18 Annamalai Narayanan , Mahinthan Chandramohan , Rajasekar Venkatesan , Lihui Chen , Yang Liu , Shantanu Jaiswal

Graph-based clustering plays an important role in the clustering area. Recent studies about graph convolution neural networks have achieved impressive success on graph type data. However, in general clustering tasks, the graph structure of…

Machine Learning · Computer Science 2024-04-23 Xuelong Li , Hongyuan Zhang , Rui Zhang

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

The structure of many complex networks includes edge directionality and weights on top of their topology. Network analysis that can seamlessly consider combination of these properties are desirable. In this paper, we study two important…

Social and Information Networks · Computer Science 2021-11-24 Frederique Oggier , Silivanxay Phetsouvanh , Anwitaman Datta

Graph Neural Networks (GNNs) with attention have been successfully applied for learning visual feature matching. However, current methods learn with complete graphs, resulting in a quadratic complexity in the number of features. Motivated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yan Shi , Jun-Xiong Cai , Yoli Shavit , Tai-Jiang Mu , Wensen Feng , Kai Zhang

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformer and graph attention network (GAT), are widely utilized…

Machine Learning · Computer Science 2021-03-02 Kyungwoo Song , Yohan Jung , Dongjun Kim , Il-Chul Moon

Graph Convolutional Network (GCN) has been widely used in graph learning tasks. However, GCN-based models (GCNs) is an inherently coupled training framework repetitively conducting the complex neighboring aggregation, which leads to the…

Machine Learning · Computer Science 2020-07-23 Dalong Yang , Chuan Chen , Youhao Zheng , Zibin Zheng , Shih-wei Liao

The emerging graph Transformers have achieved impressive performance for graph representation learning over graph neural networks (GNNs). In this work, we regard the self-attention mechanism, the core module of graph Transformers, as a…

Machine Learning · Computer Science 2023-10-18 Jinsong Chen , Gaichao Li , John E. Hopcroft , Kun He

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation. To this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

In recent years, models based on Graph Convolutional Networks (GCN) have made significant strides in the field of graph data analysis. However, challenges such as over-smoothing and over-compression remain when handling large-scale and…

Machine Learning · Computer Science 2025-07-23 Binxiong Li , Xu Xiang , Xue Li , Binyu Zhao , Heyang Gao , Qinyu Zhao

Online continual learning for image classification is crucial for models to adapt to new data while retaining knowledge of previously learned tasks. This capability is essential to address real-world challenges involving dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Adjovi Sim , Zhengkui Wang , Aik Beng Ng , Shalini De Mello , Simon See , Wonmin Byeon

Graph-based clustering methods have demonstrated the effectiveness in various applications. Generally, existing graph-based clustering methods first construct a graph to represent the input data and then partition it to generate the…

Machine Learning · Computer Science 2019-12-17 Yuheng Jia , Hui Liu , Junhui Hou , Sam Kwong

Transformers have demonstrated success in graph learning, particularly for node-level tasks. However, existing methods encounter an information bottleneck when generating graph-level representations. The prevalent single token paradigm…

Machine Learning · Computer Science 2026-02-11 Ruixiang Wang , Yuyang Hong , Shiming Xiang , Chunhong Pan