中文
相关论文

相关论文: Beyond Prefixes: Graph-as-Memory Cross-Attention f…

200 篇论文

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

计算与语言 · 计算机科学 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo

The pretrain-transfer paradigm, which underpins the success of large language models (LLMs), has demonstrated the immense power of creating foundation models that learn generalizable representations from vast datasets. However, extending…

机器学习 · 计算机科学 2025-09-30 Yunhao Liang , Pujun Zhang , Yuan Qu , Shaochong Lin , Zuo-jun Max Shen

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

计算与语言 · 计算机科学 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

In recent years, Large Language Models (LLMs) have shown remarkable performance in generating human-like text, proving to be a valuable asset across various applications. However, adapting these models to incorporate new, out-of-domain…

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

人工智能 · 计算机科学 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Entity alignment, which is a prerequisite for creating a more comprehensive Knowledge Graph (KG), involves pinpointing equivalent entities across disparate KGs. Contemporary methods for entity alignment have predominantly utilized knowledge…

计算与语言 · 计算机科学 2024-01-31 Linyao Yang , Hongyang Chen , Xiao Wang , Jing Yang , Fei-Yue Wang , Han Liu

In the era of personalized education, the provision of comprehensible explanations for learning recommendations is of a great value to enhance the learner's understanding and engagement with the recommended learning content. Large language…

人工智能 · 计算机科学 2025-01-23 Hasan Abu-Rasheed , Christian Weber , Madjid Fathi

While multi-modal models have successfully integrated information from image, video, and audio modalities, integrating graph modality into large language models (LLMs) remains unexplored. This discrepancy largely stems from the inherent…

计算与语言 · 计算机科学 2023-10-13 Yuanchun Shen , Ruotong Liao , Zhen Han , Yunpu Ma , Volker Tresp

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

机器学习 · 计算机科学 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He

Significant efforts have been dedicated to integrating the powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of language, vision and audio data. However, the graph-structured data, which is…

计算与语言 · 计算机科学 2024-12-31 Zipeng Liu , Likang Wu , Ming He , Zhong Guan , Hongke Zhao , Nan Feng

Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior…

机器学习 · 计算机科学 2024-05-24 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Large language models (LLMs) have demonstrated their strong capabilities in various domains, and have been recently integrated for graph analysis as graph language models (GLMs). With LLMs as the predictor, some GLMs can interpret unseen…

计算与语言 · 计算机科学 2025-06-30 Junze Chen , Cheng Yang , Shujie Li , Zhiqiang Zhang , Yawen Li , Junping Du , Chuan Shi

Answering complex questions about textual narratives requires reasoning over both stated context and the world knowledge that underlies it. However, pretrained language models (LM), the foundation of most modern QA systems, do not robustly…

The advent of Large Language Models (LLMs) has fundamentally reshaped the way we interact with graphs, giving rise to a new paradigm called GraphLLM. As revealed in recent studies, graph learning can benefit from LLMs. However, we observe…

机器学习 · 计算机科学 2026-04-21 Hongyu Zhan , Qixin Wang , Yusen Tan , Haitao Yu , Jingbo Zhou , Shuai Chen , Jia Li , Xiao Tan , Jun Xia

Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a…

机器学习 · 计算机科学 2024-06-05 Wenqi Fan , Shijie Wang , Jiani Huang , Zhikai Chen , Yu Song , Wenzhuo Tang , Haitao Mao , Hui Liu , Xiaorui Liu , Dawei Yin , Qing Li

In recent years, powered by the learned discriminative representation via graph neural network (GNN) models, deep graph matching methods have made great progresses in the task of matching semantic features. However, these methods usually…

计算机视觉与模式识别 · 计算机科学 2021-11-18 He Liu , Tao Wang , Yidong Li , Congyan Lang , Yi Jin , Haibin Ling

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

计算与语言 · 计算机科学 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

Graph self-supervised learning (SSL) is now a go-to method for pre-training graph foundation models (GFMs). There is a wide variety of knowledge patterns embedded in the graph data, such as node properties and clusters, which are crucial to…

机器学习 · 计算机科学 2025-05-15 Ziwen Zhao , Yixin Su , Yuhua Li , Yixiong Zou , Ruixuan Li , Rui Zhang

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information and limiting their…

计算与语言 · 计算机科学 2025-09-29 Yifang Zhang , Pengfei Duan , Yiwen Yang , Shengwu Xiong

Machine Learning has been the quintessential solution for many AI problems, but learning is still heavily dependent on the specific training data. Some learning models can be incorporated with a prior knowledge in the Bayesian set up, but…

计算与语言 · 计算机科学 2018-05-22 K M Annervaz , Somnath Basu Roy Chowdhury , Ambedkar Dukkipati