English
Related papers

Related papers: What Does My QA Model Know? Devising Controlled Pr…

200 papers

It is prevalent to utilize external knowledge to help machine answer questions that need background commonsense, which faces a problem that unlimited knowledge will transmit noisy and misleading information. Towards the issue of introducing…

Computation and Language · Computer Science 2021-07-06 Luxi Xing , Yue Hu , Jing Yu , Yuqiang Xie , Wei Peng

Declarative knowledge and procedural knowledge are two key parts in meta-cognitive theory, and these two hold significant importance in pre-training and inference of LLMs. However, a comprehensive analysis comparing these two types of…

Computation and Language · Computer Science 2024-03-18 Zhuoqun Li , Hongyu Lin , Yaojie Lu , Hao Xiang , Xianpei Han , Le Sun

Machine learning is making substantial progress in diverse applications. The success is mostly due to advances in deep learning. However, deep learning can make mistakes and its generalization abilities to new tasks are questionable. We ask…

One of the most challenging question types in VQA is when answering the question requires outside knowledge not present in the image. In this work we study open-domain knowledge, the setting when the knowledge required to answer a question…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Kenneth Marino , Xinlei Chen , Devi Parikh , Abhinav Gupta , Marcus Rohrbach

We describe a new class of learning models called memory networks. Memory networks reason with inference components combined with a long-term memory component; they learn how to use these jointly. The long-term memory can be read and…

Artificial Intelligence · Computer Science 2015-12-01 Jason Weston , Sumit Chopra , Antoine Bordes

Concept-based Models are a class of inherently explainable networks that improve upon standard Deep Neural Networks by providing a rationale behind their predictions using human-understandable `concepts'. With these models being highly…

Machine Learning · Computer Science 2025-06-06 Sanchit Sinha , Aidong Zhang

Commonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained during pre-training.…

Computation and Language · Computer Science 2021-09-08 Kaixin Ma , Filip Ilievski , Jonathan Francis , Satoru Ozaki , Eric Nyberg , Alessandro Oltramari

Recent success of deep learning models for the task of extractive Question Answering (QA) is hinged on the availability of large annotated corpora. However, large domain specific annotated corpora are limited and expensive to construct. In…

Computation and Language · Computer Science 2018-04-04 Bhuwan Dhingra , Danish Pruthi , Dheeraj Rajagopal

In what sense does a large language model have knowledge? The answer to this question extends beyond the capabilities of a particular AI system, and challenges our assumptions about the nature of knowledge and intelligence. We answer by…

Artificial Intelligence · Computer Science 2024-04-02 Ilker Yildirim , L. A. Paul

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge…

Computation and Language · Computer Science 2022-12-14 Michihiro Yasunaga , Hongyu Ren , Antoine Bosselut , Percy Liang , Jure Leskovec

Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their…

Computation and Language · Computer Science 2023-12-06 Paul Youssef , Osman Alperen Koraş , Meijie Li , Jörg Schlötterer , Christin Seifert

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on…

Computation and Language · Computer Science 2020-09-22 Peifeng Wang , Nanyun Peng , Filip Ilievski , Pedro Szekely , Xiang Ren

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

Computation and Language · Computer Science 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

Neural network based sequence-to-sequence models in an encoder-decoder framework have been successfully applied to solve Question Answering (QA) problems, predicting answers from statements and questions. However, almost all previous models…

Computation and Language · Computer Science 2017-09-05 Huayu Li , Martin Renqiang Min , Yong Ge , Asim Kadav

Understanding human language often necessitates understanding entities and their place in a taxonomy of knowledge -- their types. Previous methods to learn entity types rely on training classifiers on datasets with coarse, noisy, and…

Computation and Language · Computer Science 2022-05-02 Shuyang Li , Mukund Sridhar , Chandana Satya Prakash , Jin Cao , Wael Hamza , Julian McAuley

Machine comprehension question answering, which finds an answer to the question given a passage, involves high-level reasoning processes of understanding and tracking the relevant contents across various semantic units such as words,…

Computation and Language · Computer Science 2018-07-24 Minjeong Kim , David Keetae Park , Hyungjong Noh , Yeonsoo Lee , Jaegul Choo

The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge…

Computation and Language · Computer Science 2022-02-03 Hariom A. Pandya , Brijesh S. Bhatt

Complex query answering (CQA) on knowledge graphs (KGs) is gaining momentum as a challenging reasoning task. In this paper, we show that the current benchmarks for CQA might not be as complex as we think, as the way they are built distorts…

Machine Learning · Computer Science 2025-07-04 Cosimo Gregucci , Bo Xiong , Daniel Hernandez , Lorenzo Loconte , Pasquale Minervini , Steffen Staab , Antonio Vergari

Answering questions related to the legal domain is a complex task, primarily due to the intricate nature and diverse range of legal document systems. Providing an accurate answer to a legal query typically necessitates specialized knowledge…

Computation and Language · Computer Science 2023-09-18 Abdelrahman Abdallah , Bhawna Piryani , Adam Jatowt

Building automatic technical support system is an important yet challenge task. Conceptually, to answer a user question on a technical forum, a human expert has to first retrieve relevant documents, and then read them carefully to identify…

Computation and Language · Computer Science 2021-05-19 Wenhao Yu , Lingfei Wu , Yu Deng , Qingkai Zeng , Ruchi Mahindru , Sinem Guven , Meng Jiang