English
Related papers

Related papers: Are Large Language Models In-Context Graph Learner…

200 papers

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

Information Retrieval · Computer Science 2024-01-26 Yan Wang , Zhixuan Chu , Xin Ouyang , Simeng Wang , Hongyan Hao , Yue Shen , Jinjie Gu , Siqiao Xue , James Y Zhang , Qing Cui , Longfei Li , Jun Zhou , Sheng Li

Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and inference. Meanwhile, retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-10-18 Yimin Tang , Yurong Xu , Ning Yan , Masood Mortazavi

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Retrieval-augmented generation (RAG) with large language models (LLMs) has demonstrated strong performance in multilingual question-answering (QA) tasks by leveraging relevant passages retrieved from corpora. In multilingual RAG (mRAG), the…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Raquel Fernández , Arianna Bisazza

Large language models like ChatGPT are increasingly used in classrooms, but they often provide outdated or fabricated information that can mislead students. Retrieval Augmented Generation (RAG) improves reliability of LLMs by grounding…

Artificial Intelligence · Computer Science 2025-09-10 Amay Jain , Liu Cui , Si Chen

Relation extraction represents a fundamental component in the process of creating knowledge graphs, among other applications. Large language models (LLMs) have been adopted as a promising tool for relation extraction, both in supervised and…

Computation and Language · Computer Science 2026-04-13 Paolo Gajo , Domenic Rosati , Hassan Sajjad , Alberto Barrón-Cedeño

Given a graph with textual attributes, we enable users to `chat with their graph': that is, to ask questions about the graph using a conversational interface. In response to a user's questions, our method provides textual replies and…

Machine Learning · Computer Science 2024-05-28 Xiaoxin He , Yijun Tian , Yifei Sun , Nitesh V. Chawla , Thomas Laurent , Yann LeCun , Xavier Bresson , Bryan Hooi

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in…

Information Retrieval · Computer Science 2024-11-20 Sonal Prabhune , Donald J. Berndt

Despite the impressive advancements of Large Language Models (LLMs) in generating text, they are often limited by the knowledge contained in the input and prone to producing inaccurate or hallucinated content. To tackle these issues,…

Information Retrieval · Computer Science 2024-05-29 Yu Wang , Nedim Lipka , Ruiyi Zhang , Alexa Siu , Yuying Zhao , Bo Ni , Xin Wang , Ryan Rossi , Tyler Derr

The remarkable reasoning and generalization capabilities of Large Language Models (LLMs) have paved the way for their expanding applications in embodied AI, robotics, and other real-world tasks. To effectively support these applications,…

Computation and Language · Computer Science 2025-05-30 Dongil Yang , Minjin Kim , Sunghwan Kim , Beong-woo Kwak , Minjun Park , Jinseok Hong , Woontack Woo , Jinyoung Yeo

Retrieval-Augmented Generation (RAG) was introduced to enhance the capabilities of Large Language Models (LLMs) beyond their encoded prior knowledge. This is achieved by providing LLMs with an external source of knowledge, which helps…

Computation and Language · Computer Science 2026-03-11 Hazem Amamou , Stéphane Gagnon , Alan Davoust , Anderson R. Avila

Retrieval Augmented Generation (RAG) has been a powerful tool for Large Language Models (LLMs) to efficiently process overly lengthy contexts. However, recent LLMs like Gemini-1.5 and GPT-4 show exceptional capabilities to understand long…

Computation and Language · Computer Science 2024-10-18 Zhuowan Li , Cheng Li , Mingyang Zhang , Qiaozhu Mei , Michael Bendersky

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with…

Machine Learning · Computer Science 2025-02-25 Hang Gao , Chenhao Zhang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a…

Computation and Language · Computer Science 2024-03-28 Yunfan Gao , Yun Xiong , Xinyu Gao , Kangxiang Jia , Jinliu Pan , Yuxi Bi , Yi Dai , Jiawei Sun , Meng Wang , Haofen Wang

With the rapid development of Large Language Models (LLMs), various explorations have arisen to utilize LLMs capability of context understanding on recommender systems. While pioneering strategies have primarily transformed traditional…

Information Retrieval · Computer Science 2024-02-27 Naicheng Guo , Hongwei Cheng , Qianqiao Liang , Linxun Chen , Bing Han

With the rise of large language models (LLMs), there has been growing interest in Graph Foundation Models (GFMs) for graph-based tasks. By leveraging LLMs as predictors, GFMs have demonstrated impressive generalizability across various…

Machine Learning · Computer Science 2025-03-06 Runlin Lei , Jiarui Ji , Haipeng Ding , Lu Yi , Zhewei Wei , Yongchao Liu , Chuntao Hong

The advent of Large Language Models (LLMs) has fundamentally reshaped the way we interact with graphs, giving rise to a new paradigm called GraphLLM. As revealed in recent studies, graph learning can benefit from LLMs. However, we observe…

Machine Learning · Computer Science 2026-04-21 Hongyu Zhan , Qixin Wang , Yusen Tan , Haitao Yu , Jingbo Zhou , Shuai Chen , Jia Li , Xiao Tan , Jun Xia

Graph Neural Networks (GNNs) have empowered the advance in graph-structured data analysis. Recently, the rise of Large Language Models (LLMs) like GPT-4 has heralded a new era in deep learning. However, their application to graph data poses…

Machine Learning · Computer Science 2024-04-12 Runjin Chen , Tong Zhao , Ajay Jaiswal , Neil Shah , Zhangyang Wang

Large language models (LLMs) have demonstrated their ability to learn in-context, allowing them to perform various tasks based on a few input-output examples. However, the effectiveness of in-context learning is heavily reliant on the…

Computation and Language · Computer Science 2024-01-29 Liang Wang , Nan Yang , Furu Wei

Large Language Models (LLMs) excel at code generation but struggle with complex problems. Retrieval-Augmented Generation (RAG) mitigates this issue by integrating external knowledge, yet retrieval models often miss relevant context, and…

Software Engineering · Computer Science 2026-01-29 Shahd Seddik , Fahd Seddik , Iman Saberi , Fatemeh Fard , Minh Hieu Huynh , Patanamon Thongtanunam