English
Related papers

Related papers: Revisiting Embeddings for Graph Neural Networks

200 papers

Neural embeddings have been used with great success in Natural Language Processing (NLP). They provide compact representations that encapsulate word similarity and attain state-of-the-art performance in a range of linguistic tasks. The…

Machine Learning · Statistics 2018-09-20 Benjamin Paul Chamberlain , James Clough , Marc Peter Deisenroth

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

Machine Learning · Computer Science 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang

Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by…

Machine Learning · Computer Science 2023-12-19 Jun Zhuang , Mohammad Al Hasan

Embedding graph nodes into a vector space can allow the use of machine learning to e.g. predict node classes, but the study of node embedding algorithms is immature compared to the natural language processing field because of a diverse…

Machine Learning · Computer Science 2018-02-20 Kento Nozawa , Masanari Kimura , Atsunori Kanemura

Graph neural network (GNN) is a deep model for graph representation learning. One advantage of graph neural network is its ability to incorporate node features into the learning process. However, this prevents graph neural network from…

Machine Learning · Computer Science 2019-11-21 Chi Thang Duong , Thanh Dat Hoang , Ha The Hien Dang , Quoc Viet Hung Nguyen , Karl Aberer

Graph neural networks (GNNs) have attracted considerable attention from the research community. It is well established that GNNs are usually roughly divided into spatial and spectral methods. Despite that spectral GNNs play an important…

Machine Learning · Computer Science 2023-02-14 Deyu Bo , Xiao Wang , Yang Liu , Yuan Fang , Yawen Li , Chuan Shi

Graph Neural Networks (GNNs) have significant advantages in handling non-Euclidean data and have been widely applied across various areas, thus receiving increasing attention in recent years. The framework of GNN models mainly includes the…

Machine Learning · Computer Science 2025-02-05 Shengda Zhuo , Jiwang Fang , Hongguang Lin , Yin Tang , Min Chen , Changdong Wang , Shuqiang Huang

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting…

Machine Learning · Computer Science 2024-09-23 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

Graphs are a powerful data structure to represent relational data and are widely used to describe complex real-world data structures. Probabilistic Graphical Models (PGMs) have been well-developed in the past years to mathematically model…

Artificial Intelligence · Computer Science 2023-01-31 Chenqing Hua , Sitao Luan , Qian Zhang , Jie Fu

A key performance bottleneck when training graph neural network (GNN) models on large, real-world graphs is loading node features onto a GPU. Due to limited GPU memory, expensive data movement is necessary to facilitate the storage of these…

Machine Learning · Computer Science 2024-03-26 Kezhao Huang , Haitian Jiang , Minjie Wang , Guangxuan Xiao , David Wipf , Xiang Song , Quan Gan , Zengfeng Huang , Jidong Zhai , Zheng Zhang

The recent proliferation of publicly available graph-structured data has sparked an interest in machine learning algorithms for graph data. Since most traditional machine learning algorithms assume data to be tabular, embedding algorithms…

Machine Learning · Computer Science 2019-08-09 Sourav Mukherjee , Tim Oates , Ryan Wright

Representation learning in dynamic graphs is a challenging problem because the topology of graph and node features vary at different time. This requires the model to be able to effectively capture both graph topology information and…

Machine Learning · Computer Science 2021-11-16 Xintao Xiang , Tiancheng Huang , Donglin Wang

In recent years, Large Language Models (LLMs) gain considerable attention for their potential to enhance personalized experiences in virtual assistants and chatbots. A key area of interest is the integration of personas into LLMs to improve…

Computation and Language · Computer Science 2024-12-19 Konstantin Zaitsev

Today we have a good theoretical understanding of the representational power of Graph Neural Networks (GNNs). For example, their limitations have been characterized in relation to a hierarchy of Weisfeiler-Lehman (WL) isomorphism tests.…

Machine Learning · Computer Science 2023-03-08 Mohammad Sadegh Akhondzadeh , Vijay Lingam , Aleksandar Bojchevski

Graph neural networks (GNNs) have recently grown in popularity in the field of artificial intelligence (AI) due to their unique ability to ingest relatively unstructured data types as input data. Although some elements of the GNN…

Machine Learning · Computer Science 2021-12-28 Isaac Ronald Ward , Jack Joyner , Casey Lickfold , Yulan Guo , Mohammed Bennamoun

Currently, most speaker recognition backends, such as cosine, linear discriminant analysis (LDA), or probabilistic linear discriminant analysis (PLDA), make decisions by calculating similarity or distance between enrollment and test…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Liang He , Ruida Li , Mengqi Niu

Data in Knowledge Graphs often represents part of the current state of the real world. Thus, to stay up-to-date the graph data needs to be updated frequently. To utilize information from Knowledge Graphs, many state-of-the-art machine…

Machine Learning · Computer Science 2021-09-23 Christopher Wewer , Florian Lemmerich , Michael Cochez

Proteins perform much of the work in living organisms, and consequently the development of efficient computational methods for protein representation is essential for advancing large-scale biological research. Most current approaches…

Quantitative Methods · Quantitative Biology 2023-06-09 Francesco Ceccarelli , Lorenzo Giusti , Sean B. Holden , Pietro Liò

The ability to compute similarity scores between graphs based on metrics such as Graph Edit Distance (GED) is important in many real-world applications. Computing exact GED values is typically an NP-hard problem and traditional algorithms…

Machine Learning · Computer Science 2022-08-18 Haoyan Xu , Runjian Chen , Yueyang Wang , Ziheng Duan , Jie Feng