English
Related papers

Related papers: DisentQA: Disentangling Parametric and Contextual …

200 papers

Deep NLP models have been shown to learn spurious correlations, leaving them brittle to input perturbations. Recent work has shown that counterfactual or contrastive data -- i.e. minimally perturbed inputs -- can reveal these weaknesses,…

Computation and Language · Computer Science 2022-03-31 Bhargavi Paranjape , Matthew Lamm , Ian Tenney

Conversational semantic parsing over tables requires knowledge acquiring and reasoning abilities, which have not been well explored by current state-of-the-art approaches. Motivated by this fact, we propose a knowledge-aware semantic parser…

Computation and Language · Computer Science 2018-09-13 Yibo Sun , Duyu Tang , Nan Duan , Jingjing Xu , Xiaocheng Feng , Bing Qin

In-context learning can improve the performances of knowledge-rich tasks such as question answering. In such scenarios, in-context examples trigger a language model (LM) to surface information stored in its parametric knowledge. We study…

Computation and Language · Computer Science 2024-04-05 Yoonsang Lee , Pranav Atreya , Xi Ye , Eunsol Choi

Knowledge-intensive language understanding tasks require Language Models (LMs) to integrate relevant context, mitigating their inherent weaknesses, such as incomplete or outdated knowledge. However, conflicting knowledge can be present in…

Computation and Language · Computer Science 2024-10-08 Sara Vera Marjanović , Haeun Yu , Pepa Atanasova , Maria Maistro , Christina Lioma , Isabelle Augenstein

Incorporating multiple knowledge sources is proven to be beneficial for answering complex factoid questions. To utilize multiple knowledge bases (KB), previous works merge all KBs into a single graph via entity alignment and reduce the…

Computation and Language · Computer Science 2023-09-12 Minhao Zhang , Yongliang Ma , Yanzeng Li , Ruoyu Zhang , Lei Zou , Ming Zhou

We consider the problem of answering observational, interventional, and counterfactual queries in a causally sufficient setting where only observational data and the causal graph are available. Utilizing the recent developments in diffusion…

Machine Learning · Statistics 2024-10-11 Patrick Chao , Patrick Blöbaum , Sapan Patel , Shiva Prasad Kasiviswanathan

Fact-based dialogue generation is a task of generating a human-like response based on both dialogue context and factual texts. Various methods were proposed to focus on generating informative words that contain facts effectively. However,…

Computation and Language · Computer Science 2020-05-11 Ryota Tanaka , Akinobu Lee

Knowledge Graph Question Answering (KGQA) aims to improve factual accuracy by leveraging structured knowledge. However, real-world Knowledge Graphs (KGs) are often incomplete, leading to the problem of Incomplete KGQA (IKGQA). A common…

Artificial Intelligence · Computer Science 2025-12-08 Jilong Liu , Pengyang Shao , Wei Qin , Fei Liu , Yonghui Yang , Richang Hong

We present a new multimodal question answering challenge, ManyModalQA, in which an agent must answer a question by considering three distinct modalities: text, images, and tables. We collect our data by scraping Wikipedia and then utilize…

Computation and Language · Computer Science 2020-01-23 Darryl Hannan , Akshay Jain , Mohit Bansal

Generative models for counterfactual outcomes face two key sources of bias. Confounding bias arises when approaches fail to account for systematic differences between those who receive the intervention and those who do not. Misspecification…

Machine Learning · Statistics 2025-09-23 Alex Luedtke , Kenji Fukumizu

It is well documented that NLP models learn social biases, but little work has been done on how these biases manifest in model outputs for applied tasks like question answering (QA). We introduce the Bias Benchmark for QA (BBQ), a dataset…

Computation and Language · Computer Science 2022-03-17 Alicia Parrish , Angelica Chen , Nikita Nangia , Vishakh Padmakumar , Jason Phang , Jana Thompson , Phu Mon Htut , Samuel R. Bowman

Although counterfactual reasoning is a fundamental aspect of intelligence, the lack of large-scale counterfactual open-domain question-answering (QA) benchmarks makes it difficult to evaluate and improve models on this ability. To address…

Computation and Language · Computer Science 2023-05-24 Wenhao Yu , Meng Jiang , Peter Clark , Ashish Sabharwal

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on…

Computation and Language · Computer Science 2020-09-22 Peifeng Wang , Nanyun Peng , Filip Ilievski , Pedro Szekely , Xiang Ren

Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge…

Computation and Language · Computer Science 2020-10-20 Sai Sharath Japa , Rekabdar Banafsheh

Language models are known to encode a great amount of factual knowledge through pretraining. However, such knowledge might be insufficient to cater to user requests, requiring the model to integrate external knowledge sources and adhere to…

Computation and Language · Computer Science 2024-07-19 Sizhe Zhou , Sha Li , Yu Meng , Yizhu Jiao , Heng Ji , Jiawei Han

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include…

Computation and Language · Computer Science 2023-06-07 Yujie Lu , Siqi Ouyang , Kairui Zhou

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled latent…

Machine Learning · Computer Science 2024-02-26 Hanqi Yan , Lingjing Kong , Lin Gui , Yuejie Chi , Eric Xing , Yulan He , Kun Zhang

In order to facilitate natural language understanding, the key is to engage commonsense or background knowledge. However, how to engage commonsense effectively in question answering systems is still under exploration in both research…

Computation and Language · Computer Science 2020-11-06 Qianglong Chen , Feng Ji , Haiqing Chen , Yin Zhang

Current QA systems can generate reasonable-sounding yet false answers without explanation or evidence for the generated answer, which is especially problematic when humans cannot readily check the model's answers. This presents a challenge…

Computation and Language · Computer Science 2022-04-14 Alicia Parrish , Harsh Trivedi , Ethan Perez , Angelica Chen , Nikita Nangia , Jason Phang , Samuel R. Bowman