English
Related papers

Related papers: SCE: Scalable Network Embedding from Sparsest Cut

200 papers

Graph representation learning has long been an important yet challenging task for various real-world applications. However, their downstream tasks are mainly performed in the settings of supervised or semi-supervised learning. Inspired by…

Machine Learning · Computer Science 2021-04-14 Shiyi Chen , Ziao Wang , Xinni Zhang , Xiaofeng Zhang , Dan Peng

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

In this paper, we study the problem of unsupervised graph representation learning by harnessing the control properties of dynamical networks defined on graphs. Our approach introduces a novel framework for contrastive learning, a widely…

Machine Learning · Computer Science 2024-04-19 Obaid Ullah Ahmad , Anwar Said , Mudassir Shabbir , Waseem Abbas , Xenofon Koutsoukos

In this paper, we are interested in learning the underlying graph structure behind training data. Solving this basic problem is essential to carry out any graph signal processing or machine learning task. To realize this, we assume that the…

Machine Learning · Computer Science 2018-05-08 Sundeep Prabhakar Chepuri , Sijia Liu , Geert Leus , Alfred O. Hero

Attributed graph clustering, which aims to group the nodes of an attributed graph into disjoint clusters, has made promising advancements in recent years. However, most existing methods face challenges when applied to large graphs due to…

Machine Learning · Computer Science 2024-08-13 Yunhui Liu , Tieke He , Qing Wu , Tao Zheng , Jianhua Zhao

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji

Graph Convolutional Networks (GCNs) have become a crucial tool on learning representations of graph vertices. The main challenge of adapting GCNs on large-scale graphs is the scalability issue that it incurs heavy cost both in computation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Wenbing Huang , Tong Zhang , Yu Rong , Junzhou Huang

Identifying influential nodes in complex networks is a fundamental task in network analysis with wide-ranging applications across domains. While deep learning has advanced node influence detection, existing supervised approaches remain…

Social and Information Networks · Computer Science 2025-09-04 Yanmei Hu , Yihang Wu , Bing Sun , Xue Yue , Biao Cai , Xiangtao Li , Yang Chen

We introduce a nonlinear method for directly embedding large, sparse, stochastic graphs into low-dimensional spaces, without requiring vertex features to reside in, or be transformed into, a metric space. Graph data and models are prevalent…

Machine Learning · Computer Science 2019-06-14 Nikos Pitsianis , Alexandros-Stavros Iliopoulos , Dimitris Floros , Xiaobai Sun

Contrastive learning has emerged as a premier method for learning representations with or without supervision. Recent studies have shown its utility in graph representation learning for pre-training. Despite successes, the understanding of…

Machine Learning · Computer Science 2023-02-07 Amur Ghose , Yingxue Zhang , Jianye Hao , Mark Coates

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional…

Machine Learning · Statistics 2017-05-10 Yuting Ma , Tian Zheng

Negative sampling, which samples negative triplets from non-observed ones in knowledge graph (KG), is an essential step in KG embedding. Recently, generative adversarial network (GAN), has been introduced in negative sampling. By sampling…

Machine Learning · Computer Science 2021-07-15 Yongqi Zhang , Quanming Yao , Lei Chen

Minimizing cross-entropy over the softmax scores of a linear map composed with a high-capacity encoder is arguably the most popular choice for training neural networks on supervised learning tasks. However, recent works show that one can…

Machine Learning · Statistics 2023-03-03 Florian Graf , Christoph D. Hofer , Marc Niethammer , Roland Kwitt

Attributed graph embedding, which learns vector representations from graph topology and node features, is a challenging task for graph analysis. Recently, methods based on graph convolutional networks (GCNs) have made great progress on this…

Machine Learning · Computer Science 2020-07-06 Ganqu Cui , Jie Zhou , Cheng Yang , Zhiyuan Liu

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

A graph convolutional network (GCN) employs a graph filtering kernel tailored for data with irregular structures. However, simply stacking more GCN layers does not improve performance; instead, the output converges to an uninformative…

Machine Learning · Computer Science 2022-11-04 Jin Zeng , Yang Liu , Gene Cheung , Wei Hu

Embedding a web-scale information network into a low-dimensional vector space facilitates tasks such as link prediction, classification, and visualization. Past research has addressed the problem of extracting such embeddings by adopting…

Social and Information Networks · Computer Science 2018-03-14 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Emmanuel Müller

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Network representation learning seeks to embed networks into a low-dimensional space while preserving the structural and semantic properties, thereby facilitating downstream tasks such as classification, trait prediction, edge…

Machine Learning · Statistics 2025-09-16 Zihan Dong , Xin Zhou , Ryumei Nakada , Lexin Li , Linjun Zhang