English
Related papers

Related papers: GiLT: Augmenting Transformer Language Models with …

200 papers

Large language models like GPT-4, Gemini, and Claude have transformed natural language processing (NLP) tasks such as question answering, dialogue generation, summarization, and so forth; yet their susceptibility to hallucination stands as…

Computation and Language · Computer Science 2025-07-21 Nur A Zarin Nishat , Andrea Coletta , Luigi Bellomarini , Kossi Amouzouvi , Jens Lehmann , Sahar Vahdati

Augmenting large language models (LLM) to use external tools enhances their performance across a variety of tasks. However, prior works over-rely on task-specific demonstration of tool use that limits their generalizability and…

Artificial Intelligence · Computer Science 2024-02-01 Yining Lu , Haoping Yu , Daniel Khashabi

E-learning environments are increasingly harnessing large language models (LLMs) like GPT-3.5 and GPT-4 for tailored educational support. This study introduces an approach that integrates dynamic knowledge graphs with LLMs to offer nuanced…

Artificial Intelligence · Computer Science 2024-12-06 Patrick Ocheja , Brendan Flanagan , Yiling Dai , Hiroaki Ogata

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Recent progress in Large Language Models (LLMs) and language agents has demonstrated significant promise for various future applications across multiple disciplines. While traditional approaches to language agents often rely on fixed,…

Computation and Language · Computer Science 2024-06-18 Lukas Vierling , Jie Fu , Kai Chen

Graph Structure Learning (GSL) focuses on capturing intrinsic dependencies and interactions among nodes in graph-structured data by generating novel graph structures. Graph Neural Networks (GNNs) have emerged as promising GSL solutions,…

Machine Learning · Computer Science 2025-03-11 Zirui Guo , Lianghao Xia , Yanhua Yu , Yuling Wang , Kangkang Lu , Zhiyong Huang , Chao Huang

Learning on Graphs has attracted immense attention due to its wide real-world applications. The most popular pipeline for learning on graphs with textual node attributes primarily relies on Graph Neural Networks (GNNs), and utilizes shallow…

Machine Learning · Computer Science 2024-01-17 Zhikai Chen , Haitao Mao , Hang Li , Wei Jin , Hongzhi Wen , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Wenqi Fan , Hui Liu , Jiliang Tang

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang

This study addresses the challenge of detecting semantic column types in relational tables, a key task in many real-world applications. While language models like BERT have improved prediction accuracy, their token input constraints limit…

Machine Learning · Computer Science 2024-05-02 Ehsan Hoseinzade , Ke Wang

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Large language models (LLMs) like ChatGPT, exhibit powerful zero-shot and instruction-following capabilities, have catalyzed a revolutionary transformation across diverse fields, especially for open-ended tasks. While the idea is less…

Artificial Intelligence · Computer Science 2024-02-29 Mengmei Zhang , Mingwei Sun , Peng Wang , Shen Fan , Yanhu Mo , Xiaoxiao Xu , Hong Liu , Cheng Yang , Chuan Shi

This paper studies learning on text-attributed graphs (TAGs), where each node is associated with a text description. An ideal solution for such a problem would be integrating both the text and graph structure information with large language…

Machine Learning · Computer Science 2023-03-02 Jianan Zhao , Meng Qu , Chaozhuo Li , Hao Yan , Qian Liu , Rui Li , Xing Xie , Jian Tang

Large language models (LLMs) have recently been introduced to graph learning, aiming to extend their zero-shot generalization success to tasks where labeled graph data is scarce. Among these applications, inference over text-attributed…

Machine Learning · Computer Science 2025-06-10 Haoyu Wang , Shikun Liu , Rongzhe Wei , Pan Li

Large language models (LLMs) have demonstrated their strong capabilities in various domains, and have been recently integrated for graph analysis as graph language models (GLMs). With LLMs as the predictor, some GLMs can interpret unseen…

Computation and Language · Computer Science 2025-06-30 Junze Chen , Cheng Yang , Shujie Li , Zhiqiang Zhang , Yawen Li , Junping Du , Chuan Shi

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun

Large Language Models (LLMs), primarily trained on text-based datasets, exhibit exceptional proficiencies in understanding and executing complex linguistic instructions via text outputs. However, they falter when requests to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Xinyu Wang , Bohan Zhuang , Qi Wu

The use of large language models (LLMs) as feature enhancers to optimize node representations, which are then used as inputs for graph neural networks (GNNs), has shown significant potential in graph representation learning. However, the…

Machine Learning · Computer Science 2025-06-12 Hang Gao , Wenxuan Huang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

Language Models such as BERT have grown in popularity due to their ability to be pre-trained and perform robustly on a wide range of Natural Language Processing tasks. Often seen as an evolution over traditional word embedding techniques,…

Computation and Language · Computer Science 2022-06-30 Nimesh Bhana , Terence L. van Zyl

Graph of Thoughts (GoT), a generalized form of recent prompting paradigms for large language models (LLMs), has been shown to be useful for elaborate problem solving. By executing a graph of operations, thoughts of the LLM are structured as…

Machine Learning · Computer Science 2026-05-22 Manuel Noah Riesen , Peter Alfred von Niederhäusern

While neural networks have been used extensively to make substantial progress in the machine translation task, they are known for being heavily dependent on the availability of large amounts of training data. Recent efforts have tried to…

Computation and Language · Computer Science 2019-02-26 Diego Moussallem , Mihael Arčan , Axel-Cyrille Ngonga Ngomo , Paul Buitelaar