English
Related papers

Related papers: Knowledge Graph Guided Semantic Evaluation of Lang…

200 papers

Recent advances in language model interpretability have identified circuits, critical subnetworks that replicate model behaviors, yet how knowledge is structured within these crucial subnetworks remains opaque. To gain an understanding…

Computation and Language · Computer Science 2025-07-17 Huaizhi Ge , Frank Rudzicz , Zining Zhu

Reading comprehension is a fundamental skill in human cognitive development. With the advancement of Large Language Models (LLMs), there is a growing need to compare how humans and LLMs understand language across different contexts and…

Computation and Language · Computer Science 2025-07-17 Yuhong Zhang , Jialu Li , Shilai Yang , Yuchen Xu , Gert Cauwenberghs , Tzyy-Ping Jung

Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include…

Computation and Language · Computer Science 2023-06-07 Yujie Lu , Siqi Ouyang , Kairui Zhou

Inspired by the success of large language models, there is a trend toward developing graph foundation models to conduct diverse downstream tasks in various domains. However, current models often require extra fine-tuning to apply their…

Machine Learning · Computer Science 2025-05-16 Kai Wang , Siqiang Luo , Caihua Shan , Yifei Shen

World models improve a learning agent's ability to efficiently operate in interactive and situated environments. This work focuses on the task of building world models of text-based game environments. Text-based games, or interactive…

Machine Learning · Computer Science 2021-10-22 Prithviraj Ammanabrolu , Mark O. Riedl

There has been increasing interest in evaluations of language models for a variety of risks and characteristics. Evaluations relying on natural language understanding for grading can often be performed at scale by using other language…

Computation and Language · Computer Science 2023-12-11 Simon Lermen , Ondřej Kvapil

Large language models (LLMs) like ChatGPT have shown significant advancements across diverse natural language understanding (NLU) tasks, including intelligent dialogue and autonomous agents. Yet, lacking widely acknowledged testing…

Computation and Language · Computer Science 2024-05-10 Jinyang Wu , Feihu Che , Xinxin Zheng , Shuai Zhang , Ruihan Jin , Shuai Nie , Pengpeng Shao , Jianhua Tao

Recently, there has been an increase in the number of knowledge graphs that can be only queried by experts. However, describing questions using structured queries is not straightforward for non-expert users who need to have sufficient…

Computation and Language · Computer Science 2021-05-04 Abdelghny Orogat , Isabelle Liu , Ahmed El-Roby

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

We tackle the problem of weakly-supervised conversational Question Answering over large Knowledge Graphs using a neural semantic parsing approach. We introduce a new Logical Form (LF) grammar that can model a wide range of queries on the…

Computation and Language · Computer Science 2021-09-02 Pierre Marion , Paweł Krzysztof Nowak , Francesco Piccinno

Integrating knowledge graphs (KGs) into the reasoning processes of large language models (LLMs) has emerged as a promising approach to mitigate hallucination. However, existing work in this area often relies on proprietary or extremely…

Computation and Language · Computer Science 2025-09-10 Yi-Jie Cheng , Oscar Chew , Yun-Nung Chen

Knowledge Graph Foundation Models (KGFMs) have shown promise in enabling zero-shot reasoning over unseen graphs by learning transferable patterns. However, most existing KGFMs rely solely on graph structure, overlooking the rich semantic…

Computation and Language · Computer Science 2025-09-22 Arvindh Arun , Sumit Kumar , Mojtaba Nayyeri , Bo Xiong , Ponnurangam Kumaraguru , Antonio Vergari , Steffen Staab

While multi-modal models have successfully integrated information from image, video, and audio modalities, integrating graph modality into large language models (LLMs) remains unexplored. This discrepancy largely stems from the inherent…

Computation and Language · Computer Science 2023-10-13 Yuanchun Shen , Ruotong Liao , Zhen Han , Yunpu Ma , Volker Tresp

Knowledge Graphs (KG) act as a great tool for holding distilled information from large natural language text corpora. The problem of natural language querying over knowledge graphs is essential for the human consumption of this information.…

Machine Learning · Computer Science 2021-12-22 Aayushee Gupta , K. M. Annervaz , Ambedkar Dukkipati , Shubhashis Sengupta

In order to facilitate the accesses of general users to knowledge graphs, an increasing effort is being exerted to construct graph-structured queries of given natural language questions. At the core of the construction is to deduce the…

Artificial Intelligence · Computer Science 2024-04-01 Ruijie Wang , Meng Wang , Jun Liu , Michael Cochez , Stefan Decker

Open-domain question answering (QA) is known to involve several underlying knowledge and reasoning challenges, but are models actually learning such knowledge when trained on benchmark tasks? To investigate this, we introduce several new…

Computation and Language · Computer Science 2020-09-03 Kyle Richardson , Ashish Sabharwal

Knowledge graphs (KGs) are powerful data structures, but exploring them effectively remains difficult for even expert users. Large language models (LLMs) are increasingly used to address this gap, yet little is known empirically about how…

Machine Learning · Computer Science 2025-05-29 Harry Li , Gabriel Appleby , Kenneth Alperin , Steven R Gomez , Ashley Suh

Personalized messaging plays an essential role in improving communication in areas such as healthcare, education, and professional engagement. This paper introduces a framework that uses the Knowledge Graph (KG) to dynamically rephrase…

Artificial Intelligence · Computer Science 2025-03-19 Rajeev Kumar , Harishankar Kumar , Kumari Shalini

Graphs are a generalized concept that encompasses more complex data structures than trees, such as difference lists, doubly-linked lists, skip lists, and leaf-linked trees. Normally, these structures are handled with destructive assignments…

Programming Languages · Computer Science 2022-09-13 Jin Sano , Naoki Yamamoto , Kazunori Ueda

Typical user-friendly renderings of knowledge graphs are visualisations and natural language text. Within the latter HCI solution approach, data-driven natural language generation systems receive increased attention, but they are often…

Computation and Language · Computer Science 2021-06-29 Zola Mahlaza , C. Maria Keet , Jarryd Dunn , Matthew Poulter