English
Related papers

Related papers: From Guidelines to Guarantees: A Graph-Based Evalu…

200 papers

The generalizability to new databases is of vital importance to Text-to-SQL systems which aim to parse human utterances into SQL statements. Existing works achieve this goal by leveraging the exact matching method to identify the lexical…

Computation and Language · Computer Science 2022-08-09 Aiwei Liu , Xuming Hu , Li Lin , Lijie Wen

Progress on graph foundation models is hindered by benchmark practices that conflate the contributions of node features and graph structure, making it hard to tell whether a model actually learns from connectivity, or whether it even needs…

Machine Learning · Computer Science 2026-05-08 Richard von Moos , Mathieu Alain , Bastian Rieck

We introduce an approach to discovery informatics that uses so called knowledge graphs as the essential representation structure. Knowledge graph is an umbrella term that subsumes various approaches to tractable representation of large…

Artificial Intelligence · Computer Science 2015-04-29 Vit Novacek

Graph Retrieval Augmented Generation (GraphRAG) has garnered increasing recognition for its potential to enhance large language models (LLMs) by structurally organizing domain-specific corpora and facilitating complex reasoning. However,…

Computation and Language · Computer Science 2025-06-23 Yilin Xiao , Junnan Dong , Chuang Zhou , Su Dong , Qian-wen Zhang , Di Yin , Xing Sun , Xiao Huang

The integration of Large Language Models (LLMs) into clinical decision support is critically obstructed by their opaque and often unreliable reasoning. In the high-stakes domain of healthcare, correct answers alone are insufficient;…

Artificial Intelligence · Computer Science 2026-04-21 Chen Zhan , Xiaoyu Tan , Gengchen Ma , Yu-Jie Xiong , Xiaoyan Jiang , Xihe Qiu

Automated interpretation of medical images demands robust modeling of complex visual-semantic relationships while addressing annotation scarcity, label imbalance, and clinical plausibility constraints. We introduce MIRNet (Medical Image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Shufeng Kong , Zijie Wang , Nuan Cui , Hao Tang , Yihan Meng , Yuanyuan Wei , Feifan Chen , Yingheng Wang , Zhuo Cai , Yaonan Wang , Yulong Zhang , Yuzheng Li , Zibin Zheng , Caihua Liu , Hao Liang

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Ensuring the reliability and verifiability of large language model (LLM)-enabled systems remains a significant challenge in software engineering. We propose a probabilistic framework for systematically analyzing and improving these systems…

Software Engineering · Computer Science 2025-04-15 Juan Manuel Baldonado , Flavia Bonomo-Braberman , Víctor Adrián Braberman

HealthBranches is a novel benchmark dataset for medical Question-Answering (Q&A), specifically designed to evaluate complex reasoning in Large Language Models (LLMs). This dataset is generated through a semi-automated pipeline that…

Computation and Language · Computer Science 2025-08-12 Cristian Cosentino , Annamaria Defilippo , Marco Dossena , Christopher Irwin , Sara Joubbi , Pietro Liò

Automated vulnerability detection in critical-infrastructure software confronts a fundamental barrier: industrial software is routinely deployed as stripped, symbol-free binaries that deprive conventional Software Composition Analysis of…

Software Engineering · Computer Science 2026-05-11 Bowei Ning , Xuejun Zong , Lian Lian , Kan He , Yifei Sun , Yuxiang Lei , Plamen Vasilev

Large language models (LLMs) have recently shown strong potential in modeling relational structures. However, existing approaches remain fundamentally graph-centric: they focus on processing pairwise graph structures into tokens that LLMs…

Computation and Language · Computer Science 2026-05-22 Mengqi Lei , Guohuan Xie , Shihui Ying , Shaoyi Du , Jun-Hai Yong , Siqi Li , Yue Gao

We introduce HAMLET, a holistic and automated framework for evaluating the long-context comprehension of large language models (LLMs). HAMLET structures source texts into a three-level key-fact hierarchy at root-, branch-, and leaf-levels,…

Computation and Language · Computer Science 2025-08-28 Jiaqi Deng , Yuho Lee , Nicole Hee-Yeon Kim , Hyangsuk Min , Taewon Yun , Minjeong Ban , Kim Yul , Hwanjun Song

Large language models (LLMs) facilitate the development of autonomous agents. As a core component of such agents, task planning aims to decompose complex natural language requests into concrete, solvable sub-tasks. Since LLM-generated plans…

Machine Learning · Computer Science 2026-03-18 Yu Hao , Qiuyu Wang , Cheng Yang , Yawen Li , Zhiqiang Zhang , Chuan Shi

Data visualizations are central to scientific communication, journalism, and everyday decision-making, yet they are frequently prone to errors that can distort interpretation or mislead audiences. Rule-based visualization linters can flag…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Valentin Bonas , Martin Sinnona , Viviana Siless , Emmanuel Iarussi

Current evaluations of large language models aggregate performance across diverse tasks into single scores. This obscures fine-grained ability variation, limiting targeted model improvement and ability-guided selection for specific tasks.…

Artificial Intelligence · Computer Science 2026-04-15 Xu Zhang , Xudong Gong , Jiacheng Qin , Qiang Wang , JiaQi Liao , Zhe Wang , Dawei Feng , Bo Ding

The emergence of large language models (LLMs) has revolutionized the way we interact with graphs, leading to a new paradigm called GraphLLM. Despite the rapid development of GraphLLM methods in recent years, the progress and understanding…

Machine Learning · Computer Science 2024-10-30 Yuhan Li , Peisong Wang , Xiao Zhu , Aochuan Chen , Haiyun Jiang , Deng Cai , Victor Wai Kin Chan , Jia Li

Property graphs are widely used in domains such as healthcare, finance, and social networks, but they often contain errors due to inconsistencies, missing data, or schema violations. Traditional rule-based and heuristic-driven graph repair…

Computation and Language · Computer Science 2025-07-08 Hrishikesh Terdalkar , Angela Bonifati , Andrea Mauri

While Graph Neural Networks (GNNs) and Large Language Models (LLMs) are powerful approaches for learning on Text-Attributed Graphs (TAGs), a comprehensive understanding of their robustness remains elusive. Current evaluations are…

Machine Learning · Computer Science 2025-10-21 Runlin Lei , Lu Yi , Mingguo He , Pengyu Qiu , Zhewei Wei , Yongchao Liu , Chuntao Hong

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

By retrieving contexts from knowledge graphs, graph-based retrieval-augmented generation (GraphRAG) enhances large language models (LLMs) to generate quality answers for user questions. Many GraphRAG methods have been proposed and reported…

Computation and Language · Computer Science 2025-06-10 Qiming Zeng , Xiao Yan , Hao Luo , Yuhao Lin , Yuxiang Wang , Fangcheng Fu , Bo Du , Quanqing Xu , Jiawei Jiang