English
Related papers

Related papers: Large-Scale Network Embedding in Apache Spark

200 papers

Edge-centric distributed computations have appeared as a recent technique to improve the shortcomings of think-like-a-vertex algorithms on large scale-free networks. In order to increase parallelism on this model, edge partitioning -…

Data Structures and Algorithms · Computer Science 2018-10-12 Sebastian Schlag , Christian Schulz , Daniel Seemaier , Darren Strash

Networks are ubiquitous in the real world. Link prediction, as one of the key problems for network-structured data, aims to predict whether there exists a link between two nodes. The traditional approaches are based on the explicit…

Machine Learning · Computer Science 2021-06-01 Wei Wu , Bin Li , Chuan Luo , Wolfgang Nejdl

A class of random graph models is considered, combining features of exponential-family models and latent structure models, with the goal of retaining the strengths of both of them while reducing the weaknesses of each of them. An open…

Computation · Statistics 2020-07-21 Sergii Babkin , Jonathan Stewart , Xiaochen Long , Michael Schweinberger

Graph embedding is a fundamental problem of mapping nodes of a guest graph into a host graph while minimizing the distance distortion, with broad applications, including virtual network embeddings into physical topologies, VLSI design, or…

Data Structures and Algorithms · Computer Science 2026-05-19 Julien Dallot , Darya Melnyk , Maciej Pacut , Stefan Schmid

With the advent of extremely high dimensional datasets, dimensionality reduction techniques are becoming mandatory. Among many techniques, feature selection has been growing in interest as an important tool to identify relevant features on…

Low-dimensional embeddings of nodes in large graphs have proved extremely useful in a variety of prediction tasks, from content recommendation to identifying protein functions. However, most existing approaches require that all nodes in the…

Social and Information Networks · Computer Science 2018-09-11 William L. Hamilton , Rex Ying , Jure Leskovec

In machine learning, graph embedding algorithms seek low-dimensional representations of the input network data, thereby allowing for downstream tasks on compressed encodings. Recently, within the framework of network renormalization,…

Physics and Society · Physics 2025-08-29 Riccardo Milocco , Fabian Jansen , Diego Garlaschelli

In this paper, we propose an efficient numerical implementation of Network Embedding based on commute times, using sparse approximation of a diffusion process on the network obtained by a modified version of the diffusion wavelet algorithm.…

Machine Learning · Computer Science 2023-08-29 Paula Mercurio , Di Liu

Multilayer network analysis has become a vital tool for understanding different relationships and their interactions in a complex system, where each layer in a multilayer network depicts the topological structure of a group of nodes…

Social and Information Networks · Computer Science 2017-09-18 Weiyi Liu , Pin-Yu Chen , Sailung Yeung , Toyotaro Suzumura , Lingli Chen

Graph-based methods are known to be successful in many machine learning and pattern classification tasks. These methods consider semi-structured data as graphs where nodes correspond to primitives (parts, interest points, segments, etc.)…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Anjan Dutta , Hichem Sahbi

Dynamic graph representation learning is a task to learn node embeddings over dynamic networks, and has many important applications, including knowledge graphs, citation networks to social networks. Graphs of this type are usually…

Social and Information Networks · Computer Science 2021-06-04 Xingzhi Guo , Baojian Zhou , Steven Skiena

We present network embedding algorithms that capture information about a node from the local distribution over node attributes around it, as observed over random walks following an approach similar to Skip-gram. Observations from…

Machine Learning · Computer Science 2021-03-23 Benedek Rozemberczki , Carl Allen , Rik Sarkar

Many machine learning tasks can benefit from external knowledge. Large knowledge graphs store such knowledge, and embedding methods can be used to distill it into ready-to-use vector representations for downstream applications. For this…

Machine Learning · Computer Science 2026-03-18 Félix Lefebvre , Gaël Varoquaux

Graph embedding aims to transfer a graph into vectors to facilitate subsequent graph analytics tasks like link prediction and graph clustering. Most approaches on graph embedding focus on preserving the graph structure or minimizing the…

Machine Learning · Computer Science 2020-03-04 Shirui Pan , Ruiqi Hu , Sai-fu Fung , Guodong Long , Jing Jiang , Chengqi Zhang

Network embedding has recently emerged as a promising technique to embed nodes of a network into low-dimensional vectors. While fairly successful, most existing works focus on the embedding techniques for static networks. But in practice,…

Social and Information Networks · Computer Science 2020-10-28 Zenan Xu , Zijing Ou , Qinliang Su , Jianxing Yu , Xiaojun Quan , Zhenkun Lin

Network datasets appear across a wide range of scientific fields, including biology, physics, and the social sciences. To enable data-driven discoveries from these networks, statistical inference techniques like estimation and hypothesis…

Methodology · Statistics 2026-02-19 Arpan Kumar , Minh Tang , Srijan Sengupta

We propose LIGHTNE 2.0, a cost-effective, scalable, automated, and high-quality network embedding system that scales to graphs with hundreds of billions of edges on a single machine. In contrast to the mainstream belief that distributed…

Social and Information Networks · Computer Science 2023-02-15 Yuyang Xie , Jiezhong Qiu , Laxman Dhulipala , Wenjian Yu , Jie Tang , Richard Peng , Chi Wang

Graph embedding learns low-dimensional representations for nodes in a graph and effectively preserves the graph structure. Recently, a significant amount of progress has been made toward this emerging research area. However, there are…

Machine Learning · Computer Science 2019-05-20 Yuan Yin , Zhewei Wei

Graph partitioning (GP), a.k.a. community detection, is a classic problem that divides the node set of a graph into densely-connected blocks. Following prior work on the IEEE HPEC Graph Challenge benchmark and recent advances in graph…

Social and Information Networks · Computer Science 2023-12-05 Yu Gao , Meng Qin , Yibin Ding , Li Zeng , Chaorui Zhang , Weixi Zhang , Wei Han , Rongqian Zhao , Bo Bai

Limited by the time complexity of querying k-hop neighbors in a graph database, most graph algorithms cannot be deployed online and execute millisecond-level inference. This problem dramatically limits the potential of applying graph…

Artificial Intelligence · Computer Science 2021-07-06 Xuhong Wang , Ding Lyu , Mengjian Li , Yang Xia , Qi Yang , Xinwen Wang , Xinguang Wang , Ping Cui , Yupu Yang , Bowen Sun , Zhenyu Guo