English
Related papers

Related papers: Large Language Models are Good Relational Learners

200 papers

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

Large Language Models (LLMs) have achieved remarkable success in natural language processing through strong semantic understanding and generation. However, their black-box nature limits structured and multi-hop reasoning. In contrast,…

Computation and Language · Computer Science 2025-10-27 Guangxin Su , Hanchen Wang , Jianwei Wang , Wenjie Zhang , Ying Zhang , Jian Pei

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

Graph Neural Networks (GNNs) have empowered the advance in graph-structured data analysis. Recently, the rise of Large Language Models (LLMs) like GPT-4 has heralded a new era in deep learning. However, their application to graph data poses…

Machine Learning · Computer Science 2024-04-12 Runjin Chen , Tong Zhao , Ajay Jaiswal , Neil Shah , Zhangyang Wang

Large language models (LLMs) have demonstrated impressive abilities in generating unstructured natural language according to instructions. However, their performance can be inconsistent when tasked with producing text that adheres to…

Computation and Language · Computer Science 2024-02-22 Yinghao Li , Rampi Ramprasad , Chao Zhang

Learning on Graphs has attracted immense attention due to its wide real-world applications. The most popular pipeline for learning on graphs with textual node attributes primarily relies on Graph Neural Networks (GNNs), and utilizes shallow…

Machine Learning · Computer Science 2024-01-17 Zhikai Chen , Haitao Mao , Hang Li , Wei Jin , Hongzhi Wen , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Wenqi Fan , Hui Liu , Jiliang Tang

Large Language Models (LLMs) excel in various natural language processing tasks, but leveraging them for dense passage embedding remains challenging. This is due to their causal attention mechanism and the misalignment between their…

Computation and Language · Computer Science 2024-08-08 Hieu Man , Nghia Trung Ngo , Franck Dernoncourt , Thien Huu Nguyen

Graph representation learning, involving both node features and graph structures, is crucial for real-world applications but often encounters pervasive noise. State-of-the-art methods typically address noise by focusing separately on node…

Machine Learning · Computer Science 2024-10-17 Guangxin Su , Yifan Zhu , Wenjie Zhang , Hanchen Wang , Ying Zhang

Graph Structure Learning (GSL) focuses on capturing intrinsic dependencies and interactions among nodes in graph-structured data by generating novel graph structures. Graph Neural Networks (GNNs) have emerged as promising GSL solutions,…

Machine Learning · Computer Science 2025-03-11 Zirui Guo , Lianghao Xia , Yanhua Yu , Yuling Wang , Kangkang Lu , Zhiyong Huang , Chao Huang

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

Computation and Language · Computer Science 2025-06-26 Yubo Dong , Hehe Fan

The growing trend of Large Language Models (LLM) development has attracted significant attention, with models for various applications emerging consistently. However, the combined application of Large Language Models with semantic…

Computation and Language · Computer Science 2023-05-09 Milena Trajanoska , Riste Stojanov , Dimitar Trajanov

The emergence of large-scale pre-trained language models has revolutionized various AI research domains. Transformers-based Large Language Models (LLMs) have gradually replaced CNNs and RNNs to unify fields of computer vision and natural…

Computation and Language · Computer Science 2024-02-07 Ruosong Ye , Caiqi Zhang , Runhui Wang , Shuyuan Xu , Yongfeng Zhang

The remarkable success of large language models (LLMs) has motivated researchers to adapt them as universal predictors for various graph-related tasks, with the ultimate goal of developing a graph foundation model that generalizes diverse…

Computation and Language · Computer Science 2026-03-03 Zhongjian Zhang , Xiao Wang , Mengmei Zhang , Jiarui Tan , Chuan Shi

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Recently, the emergence of large language models (LLMs) has motivated integrating language descriptions into graphs, forming text-attributed graphs (TAGs) that enhance model encoding capabilities from a data-centric perspective. A review of…

Machine Learning · Computer Science 2026-02-03 Zhihan Zhang , Xunkai Li , Lei Zhu , Guang Zeng , Bowen Fan , Yanzhe Wen , Hongchao Qin , Rong-Hua Li , Guoren Wang

Large language models (LLMs) are emerging as few-shot learners capable of handling a variety of tasks, including comprehension, planning, reasoning, question answering, arithmetic calculations, and more. At the core of these capabilities is…

Databases · Computer Science 2024-11-05 Yu Pan , Hongfeng Yu , Tianjiao Zhao , Jianxin Sun

Despite the recent broad adoption of Large Language Models (LLMs) across various domains, their potential for enriching information systems in extracting and exploring Linked Data (LD) and Resource Description Framework (RDF) triplestores…

Information Retrieval · Computer Science 2024-09-25 Omar Mussa , Omer Rana , Benoît Goossens , Pablo Orozco-Terwengel , Charith Perera

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

Information Retrieval · Computer Science 2024-01-26 Yan Wang , Zhixuan Chu , Xin Ouyang , Simeng Wang , Hongyan Hao , Yue Shen , Jinjie Gu , Siqiao Xue , James Y Zhang , Qing Cui , Longfei Li , Jun Zhou , Sheng Li

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Exploring the application of large language models (LLMs) to graph learning is a emerging endeavor. However, the vast amount of information inherent in large graphs poses significant challenges to this process. This work focuses on the link…

Computation and Language · Computer Science 2024-02-21 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Xueqi Cheng