English
Related papers

Related papers: AmbiGraph-Eval: Can LLMs Effectively Handle Ambigu…

200 papers

Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in…

Computation and Language · Computer Science 2024-06-24 Yue Huang , Chenrui Fan , Yuan Li , Siyuan Wu , Tianyi Zhou , Xiangliang Zhang , Lichao Sun

Large language models (LLMs) leverage deep learning architectures to process and predict sequences of words, enabling them to perform a wide range of natural language processing tasks, such as translation, summarization, question answering,…

Computation and Language · Computer Science 2025-09-08 Mohammad Shahedur Rahman , Peng Gao , Yuede Ji

Large Language Model (LLM) evaluation is currently one of the most important areas of research, with existing benchmarks proving to be insufficient and not completely representative of LLMs' various capabilities. We present a curated…

Computation and Language · Computer Science 2024-06-05 Aisha Khatun , Daniel G. Brown

We present a mixed-methods study to explore how large language models (LLMs) can assist users in the visual exploration and analysis of knowledge graphs (KGs). We surveyed and interviewed 20 professionals from industry, government…

Human-Computer Interaction · Computer Science 2024-04-03 Harry Li , Gabriel Appleby , Ashley Suh

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

The proliferation of open-source Large Language Models (LLMs) from various institutions has highlighted the urgent need for comprehensive evaluation methods. However, current evaluation platforms, such as the widely recognized HuggingFace…

Computation and Language · Computer Science 2024-11-01 Fanghua Ye , Mingming Yang , Jianhui Pang , Longyue Wang , Derek F. Wong , Emine Yilmaz , Shuming Shi , Zhaopeng Tu

Graph plays an important role in representing complex relationships in real-world applications such as social networks, biological data and citation networks. In recent years, Large Language Models (LLMs) have achieved tremendous success in…

Machine Learning · Computer Science 2024-03-19 Zheyuan Liu , Xiaoxin He , Yijun Tian , Nitesh V. Chawla

Graph models are fundamental to data analysis in domains rich with complex relationships. Text-to-Graph-Query-Language (Text-to-GQL) systems act as a translator, converting natural language into executable graph queries. This capability…

Artificial Intelligence · Computer Science 2026-02-13 Songlin Lyu , Lujie Ban , Zihang Wu , Tianqi Luo , Jirong Liu , Chenhao Ma , Yuyu Luo , Nan Tang , Shipeng Qi , Heng Lin , Yongchao Liu , Chuntao Hong

The growing importance of textual and relational systems has driven interest in enhancing large language models (LLMs) for graph-structured data, particularly Text-Attributed Graphs (TAGs), where samples are represented by textual…

Machine Learning · Computer Science 2025-01-28 Yuanfu Sun , Zhengnan Ma , Yi Fang , Jing Ma , Qiaoyu Tan

Generative AI, particularly Large Language Models, increasingly integrates graph-based representations to enhance reasoning, retrieval, and structured decision-making. Despite rapid advances, there remains limited clarity regarding when,…

Artificial Intelligence · Computer Science 2026-04-21 Hamed Jelodar , Samita Bai , Mohammad Meymani , Parisa Hamedi , Roozbeh Razavi-Far , Ali Ghorbani

Large Language Models (LLMs), while being increasingly dominant on a myriad of knowledge-intensive activities, have only had limited success understanding lengthy table-text mixtures, such as academic papers and financial reports. Recent…

Computation and Language · Computer Science 2024-12-16 Yikang Pan , Yi Zhu , Rand Xie , Yizhi Liu

Academic question answering (QA) in heterogeneous scholarly networks presents unique challenges requiring both structural understanding and interpretable reasoning. While graph neural networks (GNNs) capture structured graph information and…

Social and Information Networks · Computer Science 2026-01-30 Runsong Jia , Mengjia Wu , Ying Ding , Jie Lu , Yi Zhang

Large language models (LLMs) have recently been introduced to graph learning, aiming to extend their zero-shot generalization success to tasks where labeled graph data is scarce. Among these applications, inference over text-attributed…

Machine Learning · Computer Science 2025-06-10 Haoyu Wang , Shikun Liu , Rongzhe Wei , Pan Li

Large Vision-Language Models (LVLMs) consistently require new arenas to guide their expanding boundaries, yet their capabilities with hypergraphs remain unexplored. In the real world, hypergraphs have significant practical applications in…

Computation and Language · Computer Science 2026-04-20 Yanbin Wei , Chun Kang , Siwei Li , Haoxuan Che , Yang Chen , Hua Liu , Jian Liu , Zhuang Liu , Can Ouyang , Fei Xing , Lei Sha , Rui Liu , Yu Zhang , James Kwok

Recent years have seen important advances in the building of interpretable models, machine learning models that are designed to be easily understood by humans. In this work, we show that large language models (LLMs) are remarkably good at…

Machine Learning · Computer Science 2024-02-23 Sebastian Bordt , Ben Lengerich , Harsha Nori , Rich Caruana

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

Despite the advances in large language models (LLMs), how they use their knowledge for reasoning is not yet well understood. In this study, we propose a method that deconstructs complex real-world questions into a graph, representing each…

Computation and Language · Computer Science 2024-10-07 Miyoung Ko , Sue Hyun Park , Joonsuk Park , Minjoon Seo

Large language models have evolved to process multiple modalities beyond text, such as images and audio, which motivates us to explore how to effectively leverage them for graph reasoning tasks. The key question, therefore, is how to…

Recent advancements in Large Language Models (LLMs) have demonstrated sophisticated capabilities, including the ability to process and comprehend extended contexts. These emergent capabilities necessitate rigorous evaluation methods to…

Although Large Language Models (LLMs) have demonstrated potential in processing graphs, they struggle with comprehending graphical structure information through prompts of graph description sequences, especially as the graph size increases.…

Computation and Language · Computer Science 2024-12-17 Yukun Cao , Shuo Han , Zengyi Gao , Zezhong Ding , Xike Xie , S. Kevin Zhou