中文
相关论文

相关论文: Beyond Prefixes: Graph-as-Memory Cross-Attention f…

200 篇论文

In Natural Language Processing (NLP), Machine Reading Comprehension (MRC) is the task of answering a question based on a given context. To handle questions in the medical domain, modern language models such as BioBERT, SciBERT and even…

计算与语言 · 计算机科学 2024-12-16 Saptarshi Sengupta , Connor Heaton , Suhan Cui , Soumalya Sarkar , Prasenjit Mitra

Contextualized entity representations learned by state-of-the-art transformer-based language models (TLMs) like BERT, GPT, T5, etc., leverage the attention mechanism to learn the data context from training data corpus. However, these models…

计算与语言 · 计算机科学 2021-09-06 Keyur Faldu , Amit Sheth , Prashant Kikani , Hemang Akbari

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

计算与语言 · 计算机科学 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

机器学习 · 计算机科学 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

计算与语言 · 计算机科学 2024-07-16 Parag Jain , Mirella Lapata

Traditional topic models often struggle with contextual nuances and fail to adequately handle polysemy and rare words. This limitation typically results in topics that lack coherence and quality. Large Language Models (LLMs) can mitigate…

计算与语言 · 计算机科学 2025-05-13 Hajar Sakai , Sarah S. Lam

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

人工智能 · 计算机科学 2023-09-12 Chang Liu , Bo Wu

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

机器学习 · 计算机科学 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

The use of large language models (LLMs) as feature enhancers to optimize node representations, which are then used as inputs for graph neural networks (GNNs), has shown significant potential in graph representation learning. However, the…

机器学习 · 计算机科学 2025-06-12 Hang Gao , Wenxuan Huang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

计算与语言 · 计算机科学 2025-07-08 Wenbo Shang , Xin Huang

Abstract meaning representation (AMR) highlights the core semantic information of text in a graph structure. Recently, pre-trained language models (PLMs) have advanced tasks of AMR parsing and AMR-to-text generation, respectively. However,…

计算与语言 · 计算机科学 2022-05-05 Xuefeng Bai , Yulong Chen , Yue Zhang

While learning personalization offers great potential for learners, modern practices in higher education require a deeper consideration of domain models and learning contexts, to develop effective personalization algorithms. This paper…

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

信息论 · 计算机科学 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Next point-of-interest (POI) recommendation is a key component of smart urban services, yet it remains challenging under cold-start conditions with sparse user-POI interactions. Recent LLM-based methods address this issue through either…

社会与信息网络 · 计算机科学 2026-01-22 Jinze Wang , Lu Zhang , Yiyang Cui , Tiehua Zhang , Zhishu Shen , Yuze Liu , Xingjun Ma , Jiong Jin

Large language models (LLMs), owing to their extensive open-domain knowledge and semantic reasoning capabilities, have been increasingly integrated into recommender systems (RS). However, a substantial gap remains between the pre-training…

信息检索 · 计算机科学 2026-01-27 Bohao Wang , Jiawei Chen , Feng Liu , Changwang Zhang , Jun Wang , Canghong Jin , Chun Chen , Can Wang

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges.…

计算与语言 · 计算机科学 2024-02-22 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

计算与语言 · 计算机科学 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Graph Neural Networks (GNNs) are powerful tools for processing relational data but often struggle to generalize to unseen graphs, giving rise to the development of Graph Foundational Models (GFMs). However, current GFMs are challenged by…

机器学习 · 计算机科学 2026-05-25 Weishuo Ma , Yanbo Wang , Xiyuan Wang , Lei Zou , Muhan Zhang

Pretrained Language Models (PLMs) benefit from external knowledge stored in graph structures for various downstream tasks. However, bridging the modality gap between graph structures and text remains a significant challenge. Traditional…

计算与语言 · 计算机科学 2024-04-11 Shuzhou Yuan , Michael Färber

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

计算与语言 · 计算机科学 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley