English
Related papers

Related papers: LGESQL: Line Graph Enhanced Text-to-SQL Model with…

200 papers

Large language models (LLMs) are being increasingly explored for graph tasks. Despite their remarkable success in text-based tasks, LLMs' capabilities in understanding explicit graph structures remain limited, particularly with large…

Machine Learning · Computer Science 2024-10-31 Sambhav Khurana , Xiner Li , Shurui Gui , Shuiwang Ji

Graph transformers need strong inductive biases to derive meaningful attention scores. Yet, current methods often fall short in capturing longer ranges, hierarchical structures, or community structures, which are common in various graphs…

Machine Learning · Computer Science 2024-05-28 Yuankai Luo , Hongkang Li , Lei Shi , Xiao-Ming Wu

Relational Deep Learning (RDL) is a promising approach for building state-of-the-art predictive models on multi-table relational data by representing it as a heterogeneous temporal graph. However, commonly used Graph Neural Network models…

We propose an extension of the Contextual Graph Markov Model, a deep and probabilistic machine learning model for graphs, to model the distribution of edge features. Our approach is architectural, as we introduce an additional Bayesian…

Machine Learning · Computer Science 2023-08-21 Daniele Atzeni , Federico Errica , Davide Bacciu , Alessio Micheli

Graphs are a widely used paradigm for representing non-Euclidean data, with applications ranging from social network analysis to biomolecular prediction. While graph learning has achieved remarkable progress, real-world graph data presents…

How can we best encode structured data into sequential form for use in large language models (LLMs)? In this work, we introduce a parameter-efficient method to explicitly represent structured data for LLMs. Our method, GraphToken, learns an…

Machine Learning · Computer Science 2024-02-09 Bryan Perozzi , Bahare Fatemi , Dustin Zelle , Anton Tsitsulin , Mehran Kazemi , Rami Al-Rfou , Jonathan Halcrow

Recent text-to-SQL models have achieved strong performance, but their effectiveness remains largely confined to SQLite due to dataset limitations. However, real-world applications require SQL generation across multiple dialects with varying…

Computation and Language · Computer Science 2025-05-26 Jipeng Zhang , Haolin Yang , Kehao Miao , Ruiyuan Zhang , Renjie Pi , Jiahui Gao , Xiaofang Zhou

We investigate the problem of multiplex graph embedding, that is, graphs in which nodes interact through multiple types of relations (dimensions). In recent years, several methods have been developed to address this problem. However, the…

Machine Learning · Computer Science 2023-12-29 Kamel Abdous , Nairouz Mrabah , Mohamed Bouguessa

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

Graph neural networks have become an important tool for modeling structured data. In many real-world systems, intricate hidden information may exist, e.g., heterogeneity in nodes/edges, static node/edge attributes, and spatiotemporal…

Machine Learning · Computer Science 2020-10-12 Yucheng Lin , Huiting Hong , Xiaoqing Yang , Xiaodi Yang , Pinghua Gong , Jieping Ye

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

In federated graph learning (FGL), a complete graph is divided into multiple subgraphs stored in each client due to privacy concerns, and all clients jointly train a global graph model by only transmitting model parameters. A pain point of…

Machine Learning · Computer Science 2025-03-26 Bo Yan , Zhongjian Zhang , Huabin Sun , Mengmei Zhang , Yang Cao , Chuan Shi

Network representation learning has traditionally been used to find lower dimensional vector representations of the nodes in a network. However, there are very important edge driven mining tasks of interest to the classical network analysis…

Social and Information Networks · Computer Science 2019-12-12 Sambaran Bandyopadhyay , Anirban Biswas , M. N. Murty , Ramasuri Narayanam

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang

Graph neural networks (GNNs) have demonstrated success in modeling relational data primarily under the assumption of homophily. However, many real-world graphs exhibit heterophily, where linked nodes belong to different categories or…

Computation and Language · Computer Science 2025-03-10 Shujie Li , Yuxia Wu , Chuan Shi , Yuan Fang

We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed…

Machine Learning · Computer Science 2024-05-03 Nurudin Alvarez-Gonzalez , Andreas Kaltenbrunner , Vicenç Gómez

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

In this study, we focus on the graph representation learning (a.k.a. network embedding) in attributed graphs. Different from existing embedding methods that treat the incorporation of graph structure and semantic as the simple combination…

Social and Information Networks · Computer Science 2023-05-12 Meng Qin

Many real-world graphs (networks) are heterogeneous with different types of nodes and edges. Heterogeneous graph embedding, aiming at learning the low-dimensional node representations of a heterogeneous graph, is vital for various…

Social and Information Networks · Computer Science 2021-12-15 Wentao Xu , Yingce Xia , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

In the last few decades, Database Management Systems (DBMSs) became powerful tools for storing large amount of data and executing complex queries over them. In the recent years, the growing amount of unstructured or semi-structured data has…

Social and Information Networks · Computer Science 2022-10-31 Andi Ferhati