English
Related papers

Related papers: KNIGHT: Knowledge Graph-Driven Multiple-Choice Que…

200 papers

Large language models (LLMs) demonstrate strong reasoning abilities when prompted to generate chain-of-thought (CoT) explanations alongside answers. However, previous research on evaluating LLMs has solely focused on answer accuracy,…

Computation and Language · Computer Science 2024-06-21 Minh-Vuong Nguyen , Linhao Luo , Fatemeh Shiri , Dinh Phung , Yuan-Fang Li , Thuy-Trang Vu , Gholamreza Haffari

Knowledge Graphs (KGs) are crucial in the field of artificial intelligence and are widely used in downstream tasks, such as question-answering (QA). The construction of KGs typically requires significant effort from domain experts. Large…

Computation and Language · Computer Science 2025-02-04 Rui Yang , Boming Yang , Aosong Feng , Sixun Ouyang , Moritz Blum , Tianwei She , Yuang Jiang , Freddy Lecue , Jinghui Lu , Irene Li

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

Knowledge Components (KCs) linked to assessments enhance the measurement of student learning, enrich analytics, and facilitate adaptivity. However, generating and linking KCs to assessment items requires significant effort and…

Artificial Intelligence · Computer Science 2024-06-03 Steven Moore , Robin Schmucker , Tom Mitchell , John Stamper

Despite the remarkable progress of Large Language Models (LLMs), their performance in question answering (QA) remains limited by the lack of domain-specific and up-to-date knowledge. Retrieval-Augmented Generation (RAG) addresses this…

Information Retrieval · Computer Science 2025-09-17 Yaodong Su , Yixiang Fang , Yingli Zhou , Quanqing Xu , Chuanhui Yang

Generating high-quality MCQs, especially those targeting diverse cognitive levels and incorporating common misconceptions into distractor design, is time-consuming and expertise-intensive, making manual creation impractical at scale.…

Computation and Language · Computer Science 2025-11-07 Nicy Scaria , Silvester John Joseph Kennedy , Diksha Seth , Ananya Thakur , Deepak Subramani

The cold-start problem remains a critical challenge in real-world recommender systems, as new items with limited interaction data or insufficient information are frequently introduced. Despite recent advances leveraging external knowledge…

Information Retrieval · Computer Science 2025-11-26 Wooseong Yang , Weizhi Zhang , Yuqing Liu , Yuwei Han , Yu Wang , Junhyun Lee , Philip S. Yu

As the field of Large Language Models (LLMs) evolves at an accelerated pace, the critical need to assess and monitor their performance emerges. We introduce a benchmarking framework focused on knowledge graph engineering (KGE) accompanied…

Artificial Intelligence · Computer Science 2023-09-01 Lars-Peter Meyer , Johannes Frey , Kurt Junghanns , Felix Brei , Kirill Bulert , Sabine Gründer-Fahrer , Michael Martin

Claim verification is a core component of automated fact-checking systems, aimed at determining the truthfulness of a statement by assessing it against reliable evidence sources such as documents or knowledge bases. This work presents…

Computation and Language · Computer Science 2026-01-28 Vítor N. Lourenço , Aline Paes , Tillman Weyde , Audrey Depeige , Mohnish Dubey

This study investigates the task of knowledge-based question generation (KBQG). Conventional KBQG works generated questions from fact triples in the knowledge graph, which could not express complex operations like aggregation and comparison…

Computation and Language · Computer Science 2022-08-29 Guanming Xiong , Junwei Bao , Wen Zhao , Youzheng Wu , Xiaodong He

Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include…

Computation and Language · Computer Science 2023-06-07 Yujie Lu , Siqi Ouyang , Kairui Zhou

Multi-hop question generation (MQG) aims to generate complex questions which require reasoning over multiple pieces of information of the input passage. Most existing work on MQG has focused on exploring graph-based networks to equip the…

Computation and Language · Computer Science 2022-02-15 Dan Su , Peng Xu , Pascale Fung

Knowledge graph reasoning (KGR) is the task of inferring new knowledge by performing logical deductions on knowledge graphs. Recently, large language models (LLMs) have demonstrated remarkable performance in complex reasoning tasks. Despite…

Artificial Intelligence · Computer Science 2025-12-11 Yu Liu , Xixun Lin , Yanmin Shang , Yangxi Li , Shi Wang , Yanan Cao

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Knowledge graphs (KGs) have the advantage of providing fine-grained detail for question-answering systems. Unfortunately, building a reliable KG is time-consuming and expensive as it requires human intervention. To overcome this issue, we…

Computation and Language · Computer Science 2021-03-12 Seunghak Yu , Tianxing He , James Glass

The rapid expansion of medical literature presents growing challenges for structuring and integrating domain knowledge at scale. Knowledge Graphs (KGs) offer a promising solution by enabling efficient retrieval, automated reasoning, and…

Computation and Language · Computer Science 2025-08-20 Duzhen Zhang , Zixiao Wang , Zhong-Zhi Li , Yahan Yu , Shuncheng Jia , Jiahua Dong , Haotian Xu , Xing Wu , Yingying Zhang , Tielin Zhang , Jie Yang , Xiuying Chen , Le Song

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Equipped with Chain-of-Thought (CoT), Large language models (LLMs) have shown impressive reasoning ability in various downstream tasks. Even so, suffering from hallucinations and the inability to access external knowledge, LLMs often come…

Computation and Language · Computer Science 2023-10-31 Keheng Wang , Feiyu Duan , Sirui Wang , Peiguang Li , Yunsen Xian , Chuantao Yin , Wenge Rong , Zhang Xiong

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework for enhancing the capabilities of Large Language Models (LLMs) by integrating retrieval-based methods with generative models. As external knowledge repositories…

Computation and Language · Computer Science 2025-11-14 Shuyi Liu , Yuming Shang , Xi Zhang

Chain-of-Thought (CoT) prompting along with sub-question generation and answering has enhanced multi-step reasoning capabilities of Large Language Models (LLMs). However, prompting the LLMs to directly generate sub-questions is suboptimal…

Computation and Language · Computer Science 2024-06-25 Jinyoung Park , Ameen Patel , Omar Zia Khan , Hyunwoo J. Kim , Joo-Kyung Kim