中文
相关论文

相关论文: Scalable Deep Generative Modeling for Sparse Graph…

200 篇论文

While network science has become an indispensable tool for studying complex systems, the conventional use of pairwise links often shows limitations in describing high-order interactions properly. Hypergraphs, where each edge can connect…

物理与社会 · 物理学 2024-12-20 Zhao Li , Jing Zhang , Jiqiang Zhang , Guozhong Zheng , Weiran Cai , Li Chen

Graph neural networks (GNNs) are powerful tools for exploring and learning from graph structures and features. As such, achieving high-performance execution for GNNs becomes crucially important. Prior works have proposed to explore the…

分布式、并行与集群计算 · 计算机科学 2023-05-30 Yangjie Zhou , Yaoxu Song , Jingwen Leng , Zihan Liu , Weihao Cui , Zhendong Zhang , Cong Guo , Quan Chen , Li Li , Minyi Guo

Graph embedding is essential for graph mining tasks. With the prevalence of graph data in real-world applications, many methods have been proposed in recent years to learn high-quality graph embedding vectors various types of graphs.…

机器学习 · 计算机科学 2021-05-25 Jianxin Li , Xingcheng Fu , Hao Peng , Senzhang Wang , Shijie Zhu , Qingyun Sun , Philip S. Yu , Lifang He

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

This paper presents a general graph representation learning framework called DeepGL for learning deep node and edge representations from large (attributed) graphs. In particular, DeepGL begins by deriving a set of base features (e.g.,…

机器学习 · 统计学 2017-10-17 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

The MIT/IEEE/Amazon GraphChallenge.org encourages community approaches to developing new solutions for analyzing graphs and sparse data. Sparse AI analytics present unique scalability difficulties. The proposed Sparse Deep Neural Network…

计算机视觉与模式识别 · 计算机科学 2019-12-03 Jeremy Kepner , Simon Alford , Vijay Gadepally , Michael Jones , Lauren Milechin , Ryan Robinett , Sid Samsi

Multi-relational temporal graphs are powerful tools for modeling real-world data, capturing the evolving and interconnected nature of entities over time. Recently, many novel models are proposed for ML on such graphs intensifying the need…

Discrete graph generation has emerged as a powerful paradigm for modeling graph data, often relying on highly expressive neural backbones such as transformers or higher-order architectures. We revisit this design choice by introducing…

机器学习 · 计算机科学 2026-03-11 Jay Revolinsky , Harry Shomer , Jiliang Tang

Data generation is a fundamental research problem in data management due to its diverse use cases, ranging from testing database engines to data-specific applications. However, real-world entities often involve complex interactions that…

数据库 · 计算机科学 2024-12-13 Fan Li , Xiaoyang Wang , Dawei Cheng , Cong Chen , Ying Zhang , Xuemin Lin

Graph neural networks (GNNs) have emerged as a powerful approach for solving many network mining tasks. However, learning on large graphs remains a challenge - many recently proposed scalable GNN approaches rely on an expensive…

Deep generative modeling has led to new and state of the art approaches for enforcing structural priors in a variety of inverse problems. In contrast to priors given by sparsity, deep models can provide direct low-dimensional…

最优化与控制 · 数学 2018-12-12 Wen Huang , Paul Hand , Reinhard Heckel , Vladislav Voroninski

Training Graph Neural Networks, on graphs containing billions of vertices and edges, at scale using minibatch sampling poses a key challenge: strong-scaling graphs and training examples results in lower compute and higher communication…

机器学习 · 计算机科学 2022-11-14 Md Vasimuddin , Ramanarayan Mohanty , Sanchit Misra , Sasikanth Avancha

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

机器学习 · 计算机科学 2021-04-13 Yang Ye , Shihao Ji

Despite the strong abilities, large language models (LLMs) still suffer from hallucinations and reliance on outdated knowledge, raising concerns in knowledge-intensive tasks. Graph-based retrieval-augmented generation (GRAG) enriches LLMs…

Deep learning can help uncover patterns in resting-state functional Magnetic Resonance Imaging (rs-fMRI) associated with psychiatric disorders and personal traits. Yet the problem of interpreting deep learning findings is rarely more…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Camila González , Yanis Miraoui , Yiran Fan , Ehsan Adeli , Kilian M. Pohl

Spectral graph sparsification aims to find ultra-sparse subgraphs whose Laplacian matrix can well approximate the original Laplacian eigenvalues and eigenvectors. In recent years, spectral sparsification techniques have been extensively…

数据结构与算法 · 计算机科学 2020-04-30 Zhuo Feng

Training neural network models with discrete (categorical or structured) latent variables can be computationally challenging, due to the need for marginalization over large or combinatorial sets. To circumvent this issue, one typically…

机器学习 · 计算机科学 2020-12-29 Gonçalo M. Correia , Vlad Niculae , Wilker Aziz , André F. T. Martins

It is still a challenging task to learn a neural text generation model under the framework of generative adversarial networks (GANs) since the entire training process is not differentiable. The existing training strategies either suffer…

计算与语言 · 计算机科学 2023-07-25 Liping Yuan , Jiehang Zeng , Xiaoqing Zheng

Graph Neural Networks (GNNs) are powerful and flexible neural networks that use the naturally sparse connectivity information of the data. GNNs represent this connectivity as sparse matrices, which have lower arithmetic intensity and thus…

机器学习 · 计算机科学 2020-09-04 Alok Tripathy , Katherine Yelick , Aydin Buluc

Graph representation learning is a fundamental problem for modeling relational data and benefits a number of downstream applications. Traditional Bayesian-based graph models and recent deep learning based GNN either suffer from…

机器学习 · 计算机科学 2024-03-27 Hanxuan Yang , Qingchao Kong , Wenji Mao