English
Related papers

Related papers: A Hierarchical Language Model For Interpretable Gr…

200 papers

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Recently, large language models (LLMs) have been widely researched in the field of graph machine learning due to their outstanding abilities in language comprehension and learning. However, the significant gap between natural language tasks…

Artificial Intelligence · Computer Science 2024-06-21 Zhong Guan , Hongke Zhao , Likang Wu , Ming He , Jianpin Fan

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over structured data, including text-attributed graphs (TAGs), which are common in domains such as citation networks, social platforms, and knowledge graphs. GNNs are…

Machine Learning · Computer Science 2026-04-23 Peyman Baghershahi , Gregoire Fournier , Pranav Nyati , Sourav Medya

While Large Language Models (LLMs) have shown exceptional generalization capabilities, their ability to process graph data, such as molecular structures, remains limited. To bridge this gap, this paper proposes Graph2Token, an efficient…

Machine Learning · Computer Science 2025-03-11 Runze Wang , Mingqi Yang , Yanming Shen

Graph-structured information offers rich contextual information that can enhance language models by providing structured relationships and hierarchies, leading to more expressive embeddings for various applications such as retrieval,…

Heterogeneous graphs are widely present in real-world complex networks, where the diversity of node and relation types leads to complex and rich semantics. Efforts for modeling complex relation semantics in heterogeneous graphs are…

Computation and Language · Computer Science 2025-11-25 Wenda Li , Tongya Zheng , Shunyu Liu , Yu Wang , Kaixuan Chen , Hanyang Yuan , Bingde Hu , Zujie Ren , Mingli Song , Gang Chen

Heterogeneous graph neural networks (HGNNs) excel at capturing structural and semantic information in heterogeneous graphs (HGs), while struggling to generalize across domains and tasks. With the rapid advancement of large language models…

Social and Information Networks · Computer Science 2025-07-31 Jinyu Yang , Cheng Yang , Shanyuan Cui , Zeyuan Guo , Liangwei Yang , Muhan Zhang , Zhiqiang Zhang , Chuan Shi

When we integrate factual knowledge from knowledge graphs (KGs) into large language models (LLMs) to enhance their performance, the cost of injection through training increases with the scale of the models. Consequently, there is…

Computation and Language · Computer Science 2025-01-24 Xinbang Dai , Yuncheng Hua , Tongtong Wu , Yang Sheng , Qiu Ji , Guilin Qi

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

Computation and Language · Computer Science 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

The latest advancements in large language models (LLMs) have revolutionized the field of natural language processing (NLP). Inspired by the success of LLMs in NLP tasks, some recent work has begun investigating the potential of applying…

Artificial Intelligence · Computer Science 2025-02-25 Shengyin Sun , Yuxiang Ren , Jiehao Chen , Chen Ma

With the rapidly improving reasoning abilities of Large Language Models (LLMs), there is also a rising demand to use them in a wide variety of domains. This brings about the need to carefully evaluate the limits of the capabilities of these…

Machine Learning · Computer Science 2026-05-05 Sunil Kumar Maurya , Xin Liu

Graphs data is crucial for many applications, and much of it exists in the relations described in textual format. As a result, being able to accurately recall and encode a graph described in earlier text is a basic yet pivotal ability that…

Machine Learning · Computer Science 2024-11-01 Yanbang Wang , Hejie Cui , Jon Kleinberg

Graphs with abundant attributes are essential in modeling interconnected entities and enhancing predictions across various real-world applications. Traditional Graph Neural Networks (GNNs) often require re-training for different graph tasks…

Computation and Language · Computer Science 2026-05-26 Yanchao Tan , Hang Lv , Pengxiang Zhan , Shiping Wang , Carl Yang

Large language models show great potential in unstructured data understanding, but still face significant challenges with graphs due to their structural hallucination. Existing approaches mainly either verbalize graphs into natural…

Computation and Language · Computer Science 2026-02-03 Jingyao Wu , Bin Lu , Zijun Di , Xiaoying Gan , Meng Jin , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Task planning in language agents is emerging as an important research topic alongside the development of large language models (LLMs). It aims to break down complex user requests in natural language into solvable sub-tasks, thereby…

Machine Learning · Computer Science 2024-10-29 Xixi Wu , Yifei Shen , Caihua Shan , Kaitao Song , Siwei Wang , Bohang Zhang , Jiarui Feng , Hong Cheng , Wei Chen , Yun Xiong , Dongsheng Li

Graph Neural Networks (GNNs) have attracted immense attention in the past decade due to their numerous real-world applications built around graph-structured data. On the other hand, Large Language Models (LLMs) with extensive pretrained…

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

Machine Learning · Computer Science 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He

Generalizing to unseen graph tasks without task-pecific supervision remains challenging. Graph Neural Networks (GNNs) are limited by fixed label spaces, while Large Language Models (LLMs) lack structural inductive biases. Recent advances in…

Machine Learning · Computer Science 2025-08-29 Yicong Wu , Guangyue Lu , Yuan Zuo , Huarong Zhang , Junjie Wu

Our work contributes to the fast-growing literature on the use of Large Language Models (LLMs) to perform graph-related tasks. In particular, we focus on usage scenarios that rely on the visual modality, feeding the model with a drawing of…

Artificial Intelligence · Computer Science 2025-05-07 Walter Didimo , Fabrizio Montecchiani , Tommaso Piselli

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a…

Computation and Language · Computer Science 2025-06-17 Dong Shu , Tianle Chen , Mingyu Jin , Chong Zhang , Mengnan Du , Yongfeng Zhang