English
Related papers

Related papers: Do I have the Knowledge to Answer? Investigating A…

200 papers

Question-answering for domain-specific applications has recently attracted much interest due to the latest advancements in large language models (LLMs). However, accurately assessing the performance of these applications remains a…

Information needs are naturally represented as questions. Automatic Natural-Language Question Answering (NLQA) has only recently become a practical task on a larger scale and without domain constraints. This paper gives a brief introduction…

Computation and Language · Computer Science 2007-05-23 Jochen L. Leidner

Pre-trained language models (PLMs) have shown their effectiveness in multiple scenarios. However, KBQA remains challenging, especially regarding coverage and generalization settings. This is due to two main factors: i) understanding the…

Computation and Language · Computer Science 2022-10-25 Yiheng Shu , Zhiwei Yu , Yuhan Li , Börje F. Karlsson , Tingting Ma , Yuzhong Qu , Chin-Yew Lin

Knowledge from diverse application domains is organized as knowledge graphs (KGs) that are stored in RDF engines accessible in the web via SPARQL endpoints. Expressing a well-formed SPARQL query requires information about the graph…

Artificial Intelligence · Computer Science 2023-08-10 Reham Omar , Ishika Dhall , Panos Kalnis , Essam Mansour

It is often challenging to solve a complex problem from scratch, but much easier if we can access other similar problems with their solutions -- a paradigm known as case-based reasoning (CBR). We propose a neuro-symbolic CBR approach…

Computation and Language · Computer Science 2021-11-09 Rajarshi Das , Manzil Zaheer , Dung Thai , Ameya Godbole , Ethan Perez , Jay-Yoon Lee , Lizhen Tan , Lazaros Polymenakos , Andrew McCallum

Question answering over temporal knowledge graphs (TKGQA) has recently found increasing interest. TKGQA requires temporal reasoning techniques to extract the relevant information from temporal knowledge bases. The only existing TKGQA…

Artificial Intelligence · Computer Science 2023-07-21 Zifeng Ding , Zongyue Li , Ruoxia Qi , Jingpei Wu , Bailan He , Yunpu Ma , Zhao Meng , Shuo Chen , Ruotong Liao , Zhen Han , Volker Tresp

Retrieval-Augmented Generation (RAG) systems show remarkable potential as question answering tools in the K-12 Education domain, where knowledge is typically queried within the restricted scope of authoritative textbooks. However,…

Computation and Language · Computer Science 2025-07-22 Tianshi Zheng , Weihan Li , Jiaxin Bai , Weiqi Wang , Yangqiu Song

Table Question Answering (TQA) aims at composing an answer to a question based on tabular data. While prior research has shown that TQA models lack robustness, understanding the underlying cause and nature of this issue remains…

Computation and Language · Computer Science 2024-04-30 Wei Zhou , Mohsen Mesgar , Heike Adel , Annemarie Friedrich

Despite the massive advancements in large language models (LLMs), they still suffer from producing plausible but incorrect responses. To improve the reliability of LLMs, recent research has focused on uncertainty quantification to predict…

Artificial Intelligence · Computer Science 2025-04-01 Yongjin Yang , Haneul Yoo , Hwaran Lee

Large language models (LLMs) have demonstrated remarkable proficiency in understanding and generating responses to complex queries through large-scale pre-training. However, the efficacy of these models in memorizing and reasoning among…

Computation and Language · Computer Science 2024-02-23 Qiyuan He , Yizhong Wang , Wenya Wang

Ambiguous questions persist in open-domain question answering, because formulating a precise question with a unique answer is often challenging. Previously, Min et al. (2020) have tackled this issue by generating disambiguated questions for…

Computation and Language · Computer Science 2023-10-26 Dongryeol Lee , Segwang Kim , Minwoo Lee , Hwanhee Lee , Joonsuk Park , Sang-Woo Lee , Kyomin Jung

Knowledge Graphs (KG) act as a great tool for holding distilled information from large natural language text corpora. The problem of natural language querying over knowledge graphs is essential for the human consumption of this information.…

Machine Learning · Computer Science 2021-12-22 Aayushee Gupta , K. M. Annervaz , Ambedkar Dukkipati , Shubhashis Sengupta

Recent studies on Knowledge Base Question Answering (KBQA) have shown great progress on this task via better question understanding. Previous works for encoding questions mainly focus on the word sequences, but seldom consider the…

Computation and Language · Computer Science 2021-07-19 Pengju Zhang , Yonghui Jia , Muhua Zhu , Wenliang Chen , Min Zhang

Knowledge Base Question Answering (KBQA) aims to answer natural language questions with factual information such as entities and relations in KBs. However, traditional Pre-trained Language Models (PLMs) are directly pre-trained on…

Computation and Language · Computer Science 2023-08-29 Guanting Dong , Rumei Li , Sirui Wang , Yupeng Zhang , Yunsen Xian , Weiran Xu

User queries are often underspecified and may admit multiple valid interpretations. Rather than silently making assumptions about the user's intent, a helpful assistant should surface such ambiguity by asking a clarifying question. Doing so…

Computation and Language · Computer Science 2026-05-26 Jinyan Su , Claire Cardie

The rise of large language models (LLMs) has enabled us to seek answers to inherently debatable questions on LLM chatbots, necessitating a reliable way to evaluate their ability. However, traditional QA benchmarks assume fixed answers are…

Computation and Language · Computer Science 2024-08-05 Rongwu Xu , Xuan Qi , Zehan Qi , Wei Xu , Zhijiang Guo

The Knowledge Base Question Answering (KBQA) task aims to answer natural language questions based on a given knowledge base. Recently, Large Language Models (LLMs) have shown strong capabilities in language understanding and can be used to…

Computation and Language · Computer Science 2024-02-13 Yantao Liu , Zixuan Li , Xiaolong Jin , Yucan Guo , Long Bai , Saiping Guan , Jiafeng Guo , Xueqi Cheng

Automatic Question Answering (QA) has been successfully applied in various domains such as search engines and chatbots. Biomedical QA (BQA), as an emerging QA task, enables innovative applications to effectively perceive, access and…

Computation and Language · Computer Science 2024-01-17 Qiao Jin , Zheng Yuan , Guangzhi Xiong , Qianlan Yu , Huaiyuan Ying , Chuanqi Tan , Mosha Chen , Songfang Huang , Xiaozhong Liu , Sheng Yu

Question answering on knowledge bases (KBQA) poses a unique challenge for semantic parsing research due to two intertwined challenges: large search space and ambiguities in schema linking. Conventional ranking-based KBQA models, which rely…

Computation and Language · Computer Science 2022-10-25 Yu Gu , Yu Su

In current NLP research, large-scale language models and their abilities are widely being discussed. Some recent works have also found notable failures of these models. Often these failure examples involve complex reasoning abilities. This…

Computation and Language · Computer Science 2023-02-06 Himanshu Gupta , Neeraj Varshney , Swaroop Mishra , Kuntal Kumar Pal , Saurabh Arjun Sawant , Kevin Scaria , Siddharth Goyal , Chitta Baral