English
Related papers

Related papers: A Learn-Then-Reason Model Towards Generalization i…

200 papers

Recent studies on Knowledge Base Question Answering (KBQA) have shown great progress on this task via better question understanding. Previous works for encoding questions mainly focus on the word sequences, but seldom consider the…

Computation and Language · Computer Science 2021-07-19 Pengju Zhang , Yonghui Jia , Muhua Zhu , Wenliang Chen , Min Zhang

Large language models (LLMs) demonstrate remarkable performance on knowledge-intensive tasks, suggesting that real-world knowledge is encoded in their model parameters. However, besides explorations on a few probing tasks in limited…

Computation and Language · Computer Science 2024-03-26 Yuyang Bai , Shangbin Feng , Vidhisha Balachandran , Zhaoxuan Tan , Shiqi Lou , Tianxing He , Yulia Tsvetkov

Pre-trained language models (LMs) have become ubiquitous in solving various natural language processing (NLP) tasks. There has been increasing interest in what knowledge these LMs contain and how we can extract that knowledge, treating LMs…

Computation and Language · Computer Science 2021-09-16 Mujeen Sung , Jinhyuk Lee , Sean Yi , Minji Jeon , Sungdong Kim , Jaewoo Kang

Generative Artificial Intelligence (AI), because of its emergent abilities, has empowered various fields, one typical of which is large language models (LLMs). One of the typical application fields of Generative AI is large language models…

Computation and Language · Computer Science 2024-02-12 Yan Zhao , Zhongyun Li , Yushan Pan , Jiaxing Wang , Yihong Wang

Language models (LMs) have shown great potential as implicit knowledge bases (KBs). And for their practical use, knowledge in LMs need to be updated periodically. However, existing tasks to assess LMs' efficacy as KBs do not adequately…

Computation and Language · Computer Science 2022-04-28 Kyungjae Lee , Wookje Han , Seung-won Hwang , Hwaran Lee , Joonsuk Park , Sang-Woo Lee

Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world…

Computation and Language · Computer Science 2023-07-04 Alex Mallen , Akari Asai , Victor Zhong , Rajarshi Das , Daniel Khashabi , Hannaneh Hajishirzi

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Large Language Models (LLMs) have demonstrated remarkable success in diverse natural language processing (NLP) tasks in general domains. However, LLMs sometimes generate responses with the hallucination about medical facts due to limited…

Computation and Language · Computer Science 2025-01-14 Haochun Wang , Sendong Zhao , Zewen Qiang , Zijian Li , Nuwa Xi , Yanrui Du , MuZhen Cai , Haoqiang Guo , Yuhan Chen , Haoming Xu , Bing Qin , Ting Liu

Relational knowledge bases (KBs) are commonly used to represent world knowledge in machines. However, while advantageous for their high degree of precision and interpretability, KBs are usually organized according to manually-defined…

Computation and Language · Computer Science 2021-09-13 Tara Safavi , Danai Koutra

Knowledge-based Visual Question Answering (KVQA) requires both image and world knowledge to answer questions. Current methods first retrieve knowledge from the image and external knowledge base with the original complex question, then…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Wenbin An , Feng Tian , Jiahao Nie , Wenkai Shi , Haonan Lin , Yan Chen , QianYing Wang , Yaqiang Wu , Guang Dai , Ping Chen

Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge…

Computation and Language · Computer Science 2020-10-20 Sai Sharath Japa , Rekabdar Banafsheh

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that…

Computation and Language · Computer Science 2024-06-07 Anand Subramanian , Viktor Schlegel , Abhinav Ramesh Kashyap , Thanh-Tung Nguyen , Vijay Prakash Dwivedi , Stefan Winkler

Large Language Models (LLMs) are increasingly explored as knowledge bases (KBs), yet current evaluation methods focus too narrowly on knowledge retention, overlooking other crucial criteria for reliable performance. In this work, we rethink…

Computation and Language · Computer Science 2024-12-17 Danna Zheng , Mirella Lapata , Jeff Z. Pan

Integrating large language models (LLMs) with rule-based reasoning offers a powerful solution for improving the flexibility and reliability of Knowledge Base Completion (KBC). Traditional rule-based KBC methods offer verifiable reasoning…

Computation and Language · Computer Science 2025-01-03 Qiyuan He , Jianfei Yu , Wenya Wang

Recently, there has been a surge of interest in the NLP community on the use of pretrained Language Models (LMs) as Knowledge Bases (KBs). Researchers have shown that LMs trained on a sufficiently large (web) corpus will encode a…

Computation and Language · Computer Science 2022-04-14 Badr AlKhamissi , Millicent Li , Asli Celikyilmaz , Mona Diab , Marjan Ghazvininejad

Answer selection and knowledge base question answering (KBQA) are two important tasks of question answering (QA) systems. Existing methods solve these two tasks separately, which requires large number of repetitive work and neglects the…

Computation and Language · Computer Science 2018-12-07 Yang Deng , Yuexiang Xie , Yaliang Li , Min Yang , Nan Du , Wei Fan , Kai Lei , Ying Shen

In this position paper, we propose a new approach to generating a type of knowledge base (KB) from text, based on question generation and entity linking. We argue that the proposed type of KB has many of the key advantages of a traditional…

Artificial Intelligence · Computer Science 2022-07-05 Wenhu Chen , William W. Cohen , Michiel De Jong , Nitish Gupta , Alessandro Presta , Pat Verga , John Wieting

Complex question answering over knowledge base (Complex KBQA) is challenging because it requires various compositional reasoning capabilities, such as multi-hop inference, attribute comparison, set operation. Existing benchmarks have some…

Computation and Language · Computer Science 2022-06-24 Shulin Cao , Jiaxin Shi , Liangming Pan , Lunyiu Nie , Yutong Xiang , Lei Hou , Juanzi Li , Bin He , Hanwang Zhang

Large Language Models (LLMs) have led to significant improvements in the Knowledge Base Question Answering (KBQA) task. However, datasets used in KBQA studies do not capture the true complexity of KBQA tasks. They either have simple…

Computation and Language · Computer Science 2024-10-22 Shicheng Liu , Sina J. Semnani , Harold Triedman , Jialiang Xu , Isaac Dan Zhao , Monica S. Lam

Embedding-based methods are popular for Knowledge Base Question Answering (KBQA), but few current models have numerical reasoning skills and thus struggle to answer ordinal constrained questions. This paper proposes a new embedding-based…

Computation and Language · Computer Science 2022-05-17 Yu Feng , Jing Zhang , Xiaokang Zhang , Lemao Liu , Cuiping Li , Hong Chen