English
Related papers

Related papers: GraphInstruct: A Progressive Benchmark for Diagnos…

200 papers

Graph Retrieval Augmented Generation (GraphRAG) has garnered increasing recognition for its potential to enhance large language models (LLMs) by structurally organizing domain-specific corpora and facilitating complex reasoning. However,…

Computation and Language · Computer Science 2025-06-23 Yilin Xiao , Junnan Dong , Chuang Zhou , Su Dong , Qian-wen Zhang , Di Yin , Xing Sun , Xiao Huang

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, including multi-step reasoning such as mathematical proving. However, existing approaches often lack an explicit and…

Computation and Language · Computer Science 2026-05-19 Yutong Li , Yitian Zhou , Xudong Wang , GuoChen , Caiyan Qin

Legal dispute analysis is crucial for intelligent legal assistance systems. However, current LLMs face significant challenges in understanding complex legal concepts, maintaining reasoning consistency, and accurately citing legal sources.…

Artificial Intelligence · Computer Science 2025-09-03 Mingda Zhang , Na Zhao , Jianglong Qing , Qing xu , Kaiwen Pan , Ting luo

Knowledge Graph (KG) inductive reasoning, which aims to infer missing facts from new KGs that are not seen during training, has been widely adopted in various applications. One critical challenge of KG inductive reasoning is handling…

Artificial Intelligence · Computer Science 2024-06-21 Kai Wang , Yuwei Xu , Zhiyong Wu , Siqiang Luo

Large Language Models (LLMs) are increasingly used to automate software development, yet most prior evaluations focus on functional correctness or high-level languages such as Python. As one of the first systematic explorations of…

Software Engineering · Computer Science 2025-09-04 Atieh Barati Nia , Mohammad Dindoost , David A. Bader

Evaluating the graph comprehension and reasoning abilities of Large Language Models (LLMs) is challenging and often incomplete. Existing benchmarks focus primarily on pure graph understanding, lacking a comprehensive evaluation across all…

Artificial Intelligence · Computer Science 2025-02-27 Zike Yuan , Ming Liu , Hui Wang , Bing Qin

The powerful capabilities of Large Language Models (LLMs) have led to their growing use in evaluating human-generated content, particularly in evaluating research ideas within academic settings. Existing solutions primarily rely on…

Machine Learning · Computer Science 2025-05-30 Tao Feng , Yihang Sun , Jiaxuan You

Large language models (LLMs) are widely used, but they often generate subtle factual errors, especially in long-form text. These errors are fatal in some specialized domains such as medicine. Existing fact-checking with grounding documents…

Computation and Language · Computer Science 2025-05-29 Yingjian Chen , Haoran Liu , Yinhong Liu , Jinxiang Xie , Rui Yang , Han Yuan , Yanran Fu , Peng Yuan Zhou , Qingyu Chen , James Caverlee , Irene Li

Graphs are foundational across domains but remain hard to use without deep expertise. LLMs promise accessible natural language (NL) graph analytics, yet they fail to process industry-scale property graphs effectively and efficiently: such…

Retrieval-Augmented Generation (RAG) has become a robust framework for enhancing Large Language Models (LLMs) with external knowledge. Recent advances in RAG have investigated graph based retrieval for intricate reasoning; however, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tejas Sarnaik , Manan Shah , Ravi Hegde

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

Missing data imputation is a critical challenge in various domains, such as healthcare and finance, where data completeness is vital for accurate analysis. Large language models (LLMs), trained on vast corpora, have shown strong potential…

Machine Learning · Computer Science 2025-08-26 Xinrui He , Yikun Ban , Jiaru Zou , Tianxin Wei , Curtiss B. Cook , Jingrui He

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Ensuring that Software Requirements Specifications (SRS) align with higher-level organizational or national requirements is vital, particularly in regulated environments such as finance and aerospace. In these domains, maintaining…

Software Engineering · Computer Science 2024-12-12 Arsalan Masoudifard , Mohammad Mowlavi Sorond , Moein Madadi , Mohammad Sabokrou , Elahe Habibi

A fundamental challenge in graph learning is understanding how models generalize to new, unseen graphs. While synthetic benchmarks offer controlled settings for analysis, existing approaches are confined to single-graph, transductive…

Machine Learning · Computer Science 2026-03-03 Louis Van Langendonck , Guillermo Bernárdez , Nina Miolane , Pere Barlet-Ros

Large Language Models (LLMs) have shown promising results on various language and vision tasks. Recently, there has been growing interest in applying LLMs to graph-based tasks, particularly on Text-Attributed Graphs (TAGs). However, most…

Machine Learning · Computer Science 2024-06-10 Zhongmou He , Jing Zhu , Shengyi Qian , Joyce Chai , Danai Koutra

Multi-turn instruction following is essential for building intelligent conversational systems that can consistently adhere to instructions across dialogue turns. However, existing approaches to enhancing multi-turn instruction following…

Computation and Language · Computer Science 2026-03-26 Zhenhe Li , Can Lin , Ling Zheng , Wen-Da Wei , Junli Liang , Qi Song

Large language models (LLMs) have demonstrated their strong capabilities in various domains, and have been recently integrated for graph analysis as graph language models (GLMs). With LLMs as the predictor, some GLMs can interpret unseen…

Computation and Language · Computer Science 2025-06-30 Junze Chen , Cheng Yang , Shujie Li , Zhiqiang Zhang , Yawen Li , Junping Du , Chuan Shi

Large language models (LLMs) offer significant potential to accelerate systematic literature reviews (SLRs), yet current approaches often rely on brittle, manually crafted prompts that compromise reliability and reproducibility. This…

Computation and Language · Computer Science 2025-09-03 Teo Susnjak

Prompts are the interface for eliciting the capabilities of large language models (LLMs). Understanding their structure and components is critical for analyzing LLM behavior and optimizing performance. However, the field lacks a…

Computation and Language · Computer Science 2026-01-27 Sullam Jeoung , Yueyan Chen , Yi Zhang , Shuai Wang , Haibo Ding , Lin Lee Cheong