English
Related papers

Related papers: Large-Scale Network Embedding in Apache Spark

200 papers

Most real-world graphs are dynamic in nature, with continuous and rapid updates to the graph topology, and vertex and edge properties. Such frequent updates pose significant challenges for inferencing over Graph Neural Networks (GNNs).…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-09 Pranjal Naman , Yogesh Simmhan

Graph Neural Network (GNN) on streaming graphs has gained increasing popularity. However, its practical deployment remains challenging, as the inference process relies on Runtime Embedding Computation (RTEC) to capture recent graph changes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Qiange Wang , Haoran Lv , Yanfeng Zhang , Weng-Fai Wong , Bingsheng He

Network embedding has attracted an increasing attention over the past few years. As an effective approach to solve graph mining problems, network embedding aims to learn a low-dimensional feature vector representation for each node of a…

Social and Information Networks · Computer Science 2020-08-10 Xiao Shen , Fu-Lai Chung

Graph embedding provides an efficient solution for graph analysis by converting the graph into a low-dimensional space which preserves the structure information. In contrast to the graph structure data, the i.i.d. node embedding can be…

Machine Learning · Computer Science 2017-05-16 Hongyun Cai , Vincent W. Zheng , Kevin Chen-Chuan Chang

Real-world data from diverse domains require real-time scalable analysis. Large-scale data processing frameworks or engines such as Hadoop fall short when results are needed on-the-fly. Apache Spark's streaming library is increasingly…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-02 Janak Dahal , Elias Ioup , Shaikh Arifuzzaman , Mahdi Abdelguerfi

As networks continue to increase in size, current methods must be capable of handling large numbers of nodes and edges in order to be practically relevant. Instead of working directly with the entire (large) network, analyzing sub-networks…

Social and Information Networks · Computer Science 2025-04-03 Eric Yanchenko

The importance of the use of networks to model and analyse biological data and the interplay of bio-molecules is widely recognised. Consequently, many algorithms for the analysis and the comparison of networks (such as alignment algorithms)…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-12 Pietro H Guzzi , Marianna Milano , Pierangelo Veltri , Mario Cannataro

Graph embedding, representing local and global neighborhood information by numerical vectors, is a crucial part of the mathematical modeling of a wide range of real-world systems. Among the embedding algorithms, random walk-based algorithms…

Social and Information Networks · Computer Science 2022-07-06 Sarmad N. Mohammed , Semra Gündüç

The proliferation of mobile devices, such as smartphones and Internet of Things (IoT) gadgets, results in the recent mobile big data (MBD) era. Collecting MBD is unprofitable unless suitable analytics and learning methods are utilized for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Dusit Niyato , Shaowei Lin , Hwee-Pink Tan , Zhu Han

Problems in scientific computing, such as distributing large sparse matrix operations, have analogous formulations as hypergraph partitioning problems. A hypergraph is a generalization of a traditional graph wherein "hyperedges" may connect…

Data Structures and Algorithms · Computer Science 2022-06-16 Justin Sybrandt , Ruslan Shaydulin , Ilya Safro

Successful machine learning on graphs or networks requires embeddings that not only represent nodes and edges as low-dimensional vectors but also preserve the graph structure. Established methods for generating embeddings require flexible…

Machine Learning · Computer Science 2026-04-13 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

Combinatorial optimizations are usually complex and inefficient, which limits their applications in large-scale networks with billions of links. We introduce a distributed computational method for solving a node-covering problem at the…

Social and Information Networks · Computer Science 2022-11-17 Qiang Liu

As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 William Marfo , Enrique A. Rico , Deepak K. Tosh , Shirley V. Moore

Embedding large graphs in low dimensional spaces has recently attracted significant interest due to its wide applications such as graph visualization, link prediction and node classification. Existing methods focus on computing the…

Social and Information Networks · Computer Science 2018-05-30 Palash Goyal , Nitin Kamra , Xinran He , Yan Liu

Graph Neural Networks (GNNs) are widely used for learning on graph-structured data, but scaling GNN training to massive graphs remains challenging. To enable scalable distributed training, graphs are divided into smaller partitions that are…

Machine Learning · Computer Science 2026-04-02 Nikolai Merkel , Ruben Mayer , Volker Markl , Hans-Arno Jacobsen

Many successful methods have been proposed for learning low dimensional representations on large-scale networks, while almost all existing methods are designed in inseparable processes, learning embeddings for entire networks even when only…

Machine Learning · Computer Science 2019-02-27 Ziyao Li , Liang Zhang , Guojie Song

Learning embeddings from large-scale networks is an open challenge. Despite the overwhelming number of existing methods, is is unclear how to exploit network structure in a way that generalizes easily to unseen nodes, edges or graphs. In…

Machine Learning · Computer Science 2020-09-29 Nurudin Alvarez-Gonzalez , Andreas Kaltenbrunner , Vicenç Gómez

Graph embedding is the task of representing nodes of a graph in a low-dimensional space and its applications for graph tasks have gained significant traction in academia and industry. The primary difference among the many recently proposed…

Social and Information Networks · Computer Science 2019-08-28 Palash Goyal , Di Huang , Ankita Goswami , Sujit Rokka Chhetri , Arquimedes Canedo , Emilio Ferrara

In recent years, network embedding methods have garnered increasing attention because of their effectiveness in various information retrieval tasks. The goal is to learn low-dimensional representations of vertexes in an information network…

Social and Information Networks · Computer Science 2017-11-02 Chih-Ming Chen , Yi-Hsuan Yang , Yian Chen , Ming-Feng Tsai