English
Related papers

Related papers: <SOG_k>: One LLM Token for Explicit Graph Structur…

200 papers

Large Language Models (LLMs) show remarkable semantic understanding but often struggle with structural understanding when processing graph topologies in a serialized format. Existing solutions rely on training external graph-based adapters…

Artificial Intelligence · Computer Science 2026-05-19 Yiming Liu , Bin Lu , Xinbing Wang , Chenghu Zhou , Meng Jin

Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment instruction tuning has become a mainstream paradigm for constructing Graph Language…

Machine Learning · Computer Science 2026-05-13 Haibo Chen , Xin Wang , Jiaheng Chao , Ling Feng , Wenwu Zhu

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

Multimodal reasoning in Large Language Models (LLMs) struggles with incomplete knowledge and hallucination artifacts, challenges that textual Knowledge Graphs (KGs) only partially mitigate due to their modality isolation. While Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Junming Liu , Siyuan Meng , Yanting Gao , Song Mao , Pinlong Cai , Guohang Yan , Yirong Chen , Zilin Bian , Ding Wang , Botian Shi

Recent advances in Vision-Language Models (VLMs) have shown promising capabilities in interpreting visualized graph data, offering a new perspective for graph-structured reasoning beyond traditional Graph Neural Networks (GNNs). However,…

Artificial Intelligence · Computer Science 2026-04-27 Qihang Ai , Ruizhou Li , Menghui Wang , Haiyun Jiang

Text-Attributed Graphs (TAGs), where each node is associated with text descriptions, are ubiquitous in real-world scenarios. They typically exhibit distinctive structure and domain-specific knowledge, motivating the development of a Graph…

Machine Learning · Computer Science 2025-10-21 Xi Zhu , Haochen Xue , Ziwei Zhao , Wujiang Xu , Jingyuan Huang , Minghao Guo , Qifan Wang , Kaixiong Zhou , Imran Razzak , Yongfeng Zhang

Recent research on integrating Large Language Models (LLMs) with Graph Neural Networks (GNNs) typically follows two approaches: LLM-centered models, which convert graph data into tokens for LLM processing, and GNN-centered models, which use…

Machine Learning · Computer Science 2024-12-11 Haotong Yang , Xiyuan Wang , Qian Tao , Shuxian Hu , Zhouchen Lin , Muhan Zhang

Data representation remains a fundamental challenge in machine learning, particularly when adapting sequence-based architectures like Transformers and Large Language Models (LLMs) for structured tabular data. Existing methods often fail to…

Machine Learning · Computer Science 2025-08-05 Kayvan Karim , Hani Ragab Hassen. Hadj Batatia

Large Language Models (LLMs) offer significant promise for intelligent traffic management; however, current chain-based systems like TrafficGPT are hindered by sequential task execution, high token usage, and poor scalability, making them…

Artificial Intelligence · Computer Science 2025-07-21 Nabil Abdelaziz Ferhat Taleb , Abdolazim Rezaei , Raj Atulkumar Patel , Mehdi Sookhak

By taking the semantic object parsing task as an exemplar application scenario, we propose the Graph Long Short-Term Memory (Graph LSTM) network, which is the generalization of LSTM from sequential data or multi-dimensional data to general…

Computer Vision and Pattern Recognition · Computer Science 2016-03-24 Xiaodan Liang , Xiaohui Shen , Jiashi Feng , Liang Lin , Shuicheng Yan

Constructing domain-specific knowledge graphs from unstructured text remains challenging due to heterogeneous entity mentions, long-tail relation distributions, and the absence of standardized schemas. We present LEC-KG, a bidirectional…

Computation and Language · Computer Science 2026-03-02 Yikai Zeng , Yingchao Piao , Changhua Pei , Jianhui Li

Attention mechanisms are critical to the success of large language models (LLMs), driving significant advancements in multiple fields. However, for graph-structured data, which requires emphasis on topological connections, they fall short…

Artificial Intelligence · Computer Science 2025-05-06 Zhong Guan , Likang Wu , Hongke Zhao , Ming He , Jianpin Fan

Extracting relevant and structured knowledge from large, complex technical documents within the Reliability and Maintainability (RAM) domain is labor-intensive and prone to errors. Our work addresses this challenge by presenting OntoKGen, a…

Artificial Intelligence · Computer Science 2024-12-11 Mohammad Sadeq Abolhasani , Rong Pan

Large language models (LLMs) have recently shown strong potential in modeling relational structures. However, existing approaches remain fundamentally graph-centric: they focus on processing pairwise graph structures into tokens that LLMs…

Computation and Language · Computer Science 2026-05-22 Mengqi Lei , Guohuan Xie , Shihui Ying , Shaoyi Du , Jun-Hai Yong , Siqi Li , Yue Gao

The emergence of large-scale pre-trained language models has revolutionized various AI research domains. Transformers-based Large Language Models (LLMs) have gradually replaced CNNs and RNNs to unify fields of computer vision and natural…

Computation and Language · Computer Science 2024-02-07 Ruosong Ye , Caiqi Zhang , Runhui Wang , Shuyuan Xu , Yongfeng Zhang

While LLMs have emerged as performant architectures for reasoning tasks, their compositional generalization capabilities have been questioned. In this work, we introduce a Compositional Generalization Challenge for Graph-based Commonsense…

Computation and Language · Computer Science 2024-10-10 Xiyan Fu , Anette Frank

Although Large Language Models (LLMs) have demonstrated potential in processing graphs, they struggle with comprehending graphical structure information through prompts of graph description sequences, especially as the graph size increases.…

Computation and Language · Computer Science 2024-12-17 Yukun Cao , Shuo Han , Zengyi Gao , Zezhong Ding , Xike Xie , S. Kevin Zhou

In real-world scientific discovery, human beings always make use of the accumulated prior knowledge with imagination pick select one or a few most promising hypotheses from large and noisy data analysis results. In this study, we introduce…

Machine Learning · Computer Science 2025-01-29 Haoran Song , Jiarui Feng , Guangfu Li , Michael Province , Philip Payne , Yixin Chen , Fuhai Li

Motivated by the limitations of current spectral analysis methods-such as reliance on single-modality data, limited generalizability, and poor interpretability-we propose a novel multi-modal spectral analysis framework that integrates prior…

Machine Learning · Computer Science 2025-09-03 Jiheng Liang , Ziru Yu , Zujie Xie , Yuchen Guo , Yulan Guo , Xiangyang Yu

Heterogeneous graph learning aims to capture complex relationships and diverse relational semantics among entities in a heterogeneous graph to obtain meaningful representations for nodes and edges. Recent advancements in heterogeneous graph…

Computation and Language · Computer Science 2024-05-21 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Long Xia , Dawei Yin , Chao Huang