English
Related papers

Related papers: Graph Machine Learning in the Era of Large Languag…

200 papers

Recent efforts leverage Large Language Models (LLMs) for modeling text-attributed graph structures in node classification tasks. These approaches describe graph structures for LLMs to understand or aggregate LLM-generated textual attribute…

Computation and Language · Computer Science 2025-05-27 Huachi Zhou , Jiahe Du , Chuang Zhou , Chang Yang , Yilin Xiao , Yuxuan Xie , Xiao Huang

Graph neural networks (GNN) have shown outstanding applications in many fields where data is fundamentally represented as graphs (e.g., chemistry, biology, recommendation systems). In this vein, communication networks comprise many…

Graphs are a powerful data structure to represent relational data and are widely used to describe complex real-world data structures. Probabilistic Graphical Models (PGMs) have been well-developed in the past years to mathematically model…

Artificial Intelligence · Computer Science 2023-01-31 Chenqing Hua , Sitao Luan , Qian Zhang , Jie Fu

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen

Large models have emerged as the most recent groundbreaking achievements in artificial intelligence, and particularly machine learning. However, when it comes to graphs, large models have not achieved the same level of success as in other…

Machine Learning · Computer Science 2023-11-14 Ziwei Zhang , Haoyang Li , Zeyang Zhang , Yijian Qin , Xin Wang , Wenwu Zhu

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

The emergence of large-scale pre-trained language models has revolutionized various AI research domains. Transformers-based Large Language Models (LLMs) have gradually replaced CNNs and RNNs to unify fields of computer vision and natural…

Computation and Language · Computer Science 2024-02-07 Ruosong Ye , Caiqi Zhang , Runhui Wang , Shuyuan Xu , Yongfeng Zhang

Benchmarking the capabilities and limitations of large language models (LLMs) in graph-related tasks is becoming an increasingly popular and crucial area of research. Recent studies have shown that LLMs exhibit a preliminary ability to…

Machine Learning · Computer Science 2025-04-22 Xinnan Dai , Haohao Qu , Yifen Shen , Bohang Zhang , Qihao Wen , Wenqi Fan , Dongsheng Li , Jiliang Tang , Caihua Shan

In recent years, Natural Language Processing (NLP) has played a significant role in various Artificial Intelligence (AI) applications such as chatbots, text generation, and language translation. The emergence of large language models (LLMs)…

Computation and Language · Computer Science 2024-07-10 Amanda Kau , Xuzeng He , Aishwarya Nambissan , Aland Astudillo , Hui Yin , Amir Aryani

Large Language Models (LLMs) have achieved impressive performance in text understanding and have become an essential tool for building smart assistants. Originally focusing on text, they have been enhanced with multimodal capabilities in…

Software Engineering · Computer Science 2024-10-24 Aaron Haag , Vlad Argatu , Oliver Lohse

Large language models (LLMs), such as GPT4 and LLaMA, are creating significant advancements in natural language processing, due to their strong text encoding/decoding ability and newly found emergent capability (e.g., reasoning). While LLMs…

Computation and Language · Computer Science 2024-11-22 Bowen Jin , Gang Liu , Chi Han , Meng Jiang , Heng Ji , Jiawei Han

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

With the rapid advancement of large language models (LLMs), classic graph learning tasks have greatly benefited from LLMs, including improved encoding of textual features, more efficient construction of graphs from text, and enhanced…

Artificial Intelligence · Computer Science 2026-05-05 Xiyuan Wang , Yi Hu , Yanbo Wang , Chuan Shi , Muhan Zhang

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks…

Machine Learning · Computer Science 2021-09-09 Lilapati Waikhom , Ripon Patgiri

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

Graph Neural Networks (GNN) have shown a strong potential to be integrated into commercial products for network control and management. Early works using GNN have demonstrated an unprecedented capability to learn from different network…

Networking and Internet Architecture · Computer Science 2021-10-05 Miquel Ferriol-Galmés , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

The adoption of Large Language Models (LLMs) is rapidly expanding across various tasks that involve inherent graphical structures. Graphs are integral to a wide range of applications, including motion planning for autonomous vehicles,…

Artificial Intelligence · Computer Science 2025-03-17 Piyush Gupta , Sangjae Bae , David Isele