English
Related papers

Related papers: Retrieval-guided Counterfactual Generation for QA

200 papers

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Open-domain question answering (QA) tasks usually require the retrieval of relevant information from a large corpus to generate accurate answers. We propose a novel approach called Generator-Retriever-Generator (GRG) that combines document…

Computation and Language · Computer Science 2024-03-27 Abdelrahman Abdallah , Adam Jatowt

A machine learning model, under the influence of observed or unobserved confounders in the training data, can learn spurious correlations and fail to generalize when deployed. For image classifiers, augmenting a training dataset using…

Machine Learning · Computer Science 2022-12-13 Abbavaram Gowtham Reddy , Saloni Dash , Amit Sharma , Vineeth N Balasubramanian

Despite the evolution of language models, they continue to portray harmful societal biases and stereotypes inadvertently learned from training data. These inherent biases often result in detrimental effects in various applications.…

Computation and Language · Computer Science 2024-07-24 Ewoenam Kwaku Tokpo , Toon Calders

We present a novel generative method for producing unseen and plausible counterfactual examples for reinforcement learning (RL) agents based upon outcome variables that characterize agent behavior. Our approach uses a variational…

Artificial Intelligence · Computer Science 2022-07-19 Eric Yeh , Pedro Sequeira , Jesse Hostetler , Melinda Gervasio

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Retrieval-augmented generation (RAG) has emerged as a critical mechanism in contemporary NLP to support Large Language Models(LLMs) in systematically accessing richer factual context. However, the integration of RAG mechanisms brings its…

Computation and Language · Computer Science 2025-06-11 Leonardo Ranaldi , Marco Valentino , Andrè Freitas

Counterfactual Data Augmentation (CDA) has been one of the preferred techniques for mitigating gender bias in natural language models. CDA techniques have mostly employed word substitution based on dictionaries. Although such…

Computation and Language · Computer Science 2023-11-07 Ewoenam Kwaku Tokpo , Toon Calders

While counterfactual examples are useful for analysis and training of NLP models, current generation methods either rely on manual labor to create very few counterfactuals, or only instantiate limited types of perturbations such as…

Computation and Language · Computer Science 2021-06-02 Tongshuang Wu , Marco Tulio Ribeiro , Jeffrey Heer , Daniel S. Weld

Automatic multi-hop fact verification task has gained significant attention in recent years. Despite impressive results, these well-designed models perform poorly on out-of-domain data. One possible solution is to augment the training data…

Computation and Language · Computer Science 2023-10-24 Yingjie Zhu , Jiasheng Si , Yibo Zhao , Haiyang Zhu , Deyu Zhou , Yulan He

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved from a knowledge base. However, its effectiveness is fundamentally constrained by the reliability of both the retriever…

Computation and Language · Computer Science 2025-01-31 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Qingyao Ai

Counterfactual explanations are one of the prominent eXplainable Artificial Intelligence (XAI) techniques, and suggest changes to input data that could alter predictions, leading to more favourable outcomes. Existing counterfactual methods…

Artificial Intelligence · Computer Science 2025-05-22 Andrei Buliga , Chiara Di Francescomarino , Chiara Ghidini , Marco Montali , Massimiliano Ronzani

Open-domain dialogue generation suffers from the data insufficiency problem due to the vast size of potential responses. In this paper, we propose to explore potential responses by counterfactual reasoning. Given an observed response, the…

Machine Learning · Computer Science 2020-10-12 Qingfu Zhu , Weinan Zhang , Ting Liu , William Yang Wang

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

In the domain of Visual Question Answering (VQA), studies have shown improvement in users' mental model of the VQA system when they are exposed to examples of how these systems answer certain Image-Question (IQ) pairs. In this work, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Kamran Alipour , Arijit Ray , Xiao Lin , Michael Cogswell , Jurgen P. Schulze , Yi Yao , Giedrius T. Burachas

The proliferation of online misinformation has posed significant threats to public interest. While numerous online users actively participate in the combat against misinformation, many of such responses can be characterized by the lack of…

Computation and Language · Computer Science 2024-03-25 Zhenrui Yue , Huimin Zeng , Yimeng Lu , Lanyu Shang , Yang Zhang , Dong Wang

Counterfactual explanations elucidate algorithmic decisions by pointing to scenarios that would have led to an alternative, desired outcome. Giving insight into the model's behavior, they hint users towards possible actions and give grounds…

Machine Learning · Statistics 2024-04-05 Susanne Dandl , Kristin Blesch , Timo Freiesleben , Gunnar König , Jan Kapar , Bernd Bischl , Marvin Wright

Question answering (QA) models for reading comprehension have been demonstrated to exploit unintended dataset biases such as question-context lexical overlap. This hinders QA models from generalizing to under-represented samples such as…

Computation and Language · Computer Science 2021-09-24 Kazutoshi Shinoda , Saku Sugawara , Akiko Aizawa

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

In recent years, various machine and deep learning architectures have been successfully introduced to the field of predictive process analytics. Nevertheless, the inherent opacity of these algorithms poses a significant challenge for human…

Artificial Intelligence · Computer Science 2024-03-15 Alexander Stevens , Chun Ouyang , Johannes De Smedt , Catarina Moreira