English
Related papers

Related papers: GraphTranslator: Aligning Graph Model to Large Lan…

200 papers

Graph Transformers (GTs) have recently demonstrated remarkable performance across diverse domains. By leveraging attention mechanisms, GTs are capable of modeling long-range dependencies and complex structural relationships beyond local…

Machine Learning · Computer Science 2025-06-06 Jiachen Tang , Zhonghao Wang , Sirui Chen , Sheng Zhou , Jiawei Chen , Jiajun Bu

The use of natural language interfaces (NLIs) to create charts is becoming increasingly popular due to the intuitiveness of natural language interactions. One key challenge in this approach is to accurately capture user intents and…

Human-Computer Interaction · Computer Science 2025-01-22 Yuan Tian , Weiwei Cui , Dazhen Deng , Xinjing Yi , Yurun Yang , Haidong Zhang , Yingcai Wu

Over the last few years, large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) that fundamentally transform research and developments in the field. ChatGPT represents one of the…

Computation and Language · Computer Science 2023-04-13 Viet Dac Lai , Nghia Trung Ngo , Amir Pouran Ben Veyseh , Hieu Man , Franck Dernoncourt , Trung Bui , Thien Huu Nguyen

Recent advancements in Large Language Models (LLMs), particularly those built on Transformer architectures, have significantly broadened the scope of natural language processing (NLP) applications, transcending their initial use in chatbot…

Computation and Language · Computer Science 2024-05-29 Chen Wang , Jin Zhao , Jiaqi Gong

Large language models (LLMs) have achieved impressive success across several fields, but their proficiency in understanding and resolving complex graph problems is less explored. To bridge this gap, we introduce GraphInstruct, a novel and…

Computation and Language · Computer Science 2024-07-04 Nuo Chen , Yuhan Li , Jianheng Tang , Jia Li

Large Language Models (LLMs) are capable of successfully performing many language processing tasks zero-shot (without training data). If zero-shot LLMs can also reliably classify and explain social phenomena like persuasiveness and…

Computation and Language · Computer Science 2024-02-27 Caleb Ziems , William Held , Omar Shaikh , Jiaao Chen , Zhehao Zhang , Diyi Yang

How can we best encode structured data into sequential form for use in large language models (LLMs)? In this work, we introduce a parameter-efficient method to explicitly represent structured data for LLMs. Our method, GraphToken, learns an…

Machine Learning · Computer Science 2024-02-09 Bryan Perozzi , Bahare Fatemi , Dustin Zelle , Anton Tsitsulin , Mehran Kazemi , Rami Al-Rfou , Jonathan Halcrow

Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many real-world knowledge sources are organized as heterogeneous graphs rather than plain text. Reasoning over such graphs requires models to…

Machine Learning · Computer Science 2026-05-27 Yuyang Bai , Zhuofeng Li , Ping Nie , Jianwen Xie , Yu Zhang

Large language models (LLMs) have notably accelerated progress towards artificial general intelligence (AGI), with their impressive zero-shot capacity for user-tailored tasks, endowing them with immense potential across a range of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Wenhai Wang , Zhe Chen , Xiaokang Chen , Jiannan Wu , Xizhou Zhu , Gang Zeng , Ping Luo , Tong Lu , Jie Zhou , Yu Qiao , Jifeng Dai

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

While achieving remarkable progress in a broad range of tasks, large language models (LLMs) remain significantly limited in properly using massive external tools. Existing in-context learning approaches simply format tools into a list of…

Artificial Intelligence · Computer Science 2024-03-05 Xukun Liu , Zhiyuan Peng , Xiaoyuan Yi , Xing Xie , Lirong Xiang , Yuchen Liu , Dongkuan Xu

Large language models (LLMs) have shown remarkable multimodal information processing and reasoning ability. When equipped with tools through function calling and enhanced with retrieval-augmented techniques, compound LLM-based systems can…

Machine Learning · Computer Science 2025-11-06 Borun Shi , Ioannis Panagiotas

Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, this paper provides…

Computation and Language · Computer Science 2023-10-25 Longyue Wang , Chenyang Lyu , Tianbo Ji , Zhirui Zhang , Dian Yu , Shuming Shi , Zhaopeng Tu

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps.…

Computation and Language · Computer Science 2024-07-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Programming languages possess rich semantic information - such as data flow - that is represented by graphs and not available from the surface form of source code. Recent code language models have scaled to billions of parameters, but model…

Computation and Language · Computer Science 2025-09-24 Ziyin Zhang , Hang Yu , Shijie Li , Peng Di , Jianguo Li , Rui Wang

The adoption of Large Language Models (LLMs) is rapidly expanding across various tasks that involve inherent graphical structures. Graphs are integral to a wide range of applications, including motion planning for autonomous vehicles,…

Artificial Intelligence · Computer Science 2025-03-17 Piyush Gupta , Sangjae Bae , David Isele

Pretrained Language Models (PLMs) such as BERT have revolutionized the landscape of Natural Language Processing (NLP). Inspired by their proliferation, tremendous efforts have been devoted to Pretrained Graph Models (PGMs). Owing to the…

Machine Learning · Computer Science 2022-03-22 Jun Xia , Yanqiao Zhu , Yuanqi Du , Stan Z. Li

E-learning environments are increasingly harnessing large language models (LLMs) like GPT-3.5 and GPT-4 for tailored educational support. This study introduces an approach that integrates dynamic knowledge graphs with LLMs to offer nuanced…

Artificial Intelligence · Computer Science 2024-12-06 Patrick Ocheja , Brendan Flanagan , Yiling Dai , Hiroaki Ogata

Large language models (LLMs) such as ChatGPT have gained considerable interest across diverse research communities. Their notable ability for text completion and generation has inaugurated a novel paradigm for language-interfaced problem…

Quantitative Methods · Quantitative Biology 2024-02-22 Hengchuang Yin , Zhonghui Gu , Fanhao Wang , Yiparemu Abuduhaibaier , Yanqiao Zhu , Xinming Tu , Xian-Sheng Hua , Xiao Luo , Yizhou Sun

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun