English
Related papers

Related papers: Rome was built in 1776: A Case Study on Factual Co…

200 papers

While neural language models can generate text with remarkable fluency and coherence, controlling for factual correctness in generation remains an open research question. This major discrepancy between the surface-level fluency and the…

Computation and Language · Computer Science 2021-06-08 Saadia Gabriel , Asli Celikyilmaz , Rahul Jha , Yejin Choi , Jianfeng Gao

Knowledge underpins reasoning. Recent research demonstrates that when relevant knowledge is provided as additional context to commonsense question answering (QA), it can substantially enhance the performance even on top of state-of-the-art.…

Computation and Language · Computer Science 2022-10-25 Jiacheng Liu , Skyler Hallinan , Ximing Lu , Pengfei He , Sean Welleck , Hannaneh Hajishirzi , Yejin Choi

Automatic argument generation is an appealing but challenging task. In this paper, we study the specific problem of counter-argument generation, and present a novel framework, CANDELA. It consists of a powerful retrieval system and a novel…

Computation and Language · Computer Science 2019-06-11 Xinyu Hua , Zhe Hu , Lu Wang

With the rapid development of artificial intelligence technology, especially the increasingly widespread application of question-and-answer systems, high-quality question generation has become a key component in supporting the development…

Computation and Language · Computer Science 2024-09-30 Zhenhong Zhang , Jiajing Chen , Weiyan Shi , Lingjie Yi , Chihang Wang , Qian Yu

Despite the rapid progress in multihop question-answering (QA), models still have trouble explaining why an answer is correct, with limited explanation training data available to learn from. To address this, we introduce three explanation…

Computation and Language · Computer Science 2020-10-08 Harsh Jhamtani , Peter Clark

Automated fact-checking systems verify claims against evidence to predict their veracity. In real-world scenarios, the retrieved evidence may not unambiguously support or refute the claim and yield conflicting but valid interpretations.…

Computation and Language · Computer Science 2023-12-15 Max Glockner , Ieva Staliūnaitė , James Thorne , Gisela Vallejo , Andreas Vlachos , Iryna Gurevych

Process Reward Models (PRMs) have emerged as a promising approach for improving LLM reasoning capabilities by providing process supervision over reasoning traces. However, existing approaches for constructing PRM training data remain costly…

Computation and Language · Computer Science 2026-04-10 Ryo Kamoi , Yusen Zhang , Nan Zhang , Sarkar Snigdha Sarathi Das , Ranran Haoran Zhang , Wenpeng Yin , Rui Zhang

Question Generation is the task of automatically creating questions from textual input. In this work we present a new Attentional Encoder--Decoder Recurrent Neural Network model for automatic question generation. Our model incorporates…

Computation and Language · Computer Science 2018-10-09 Vrindavan Harrison , Marilyn Walker

Present language understanding methods have demonstrated extraordinary ability of recognizing patterns in texts via machine learning. However, existing methods indiscriminately use the recognized patterns in the testing phase that is…

Computation and Language · Computer Science 2021-06-08 Fuli Feng , Jizhi Zhang , Xiangnan He , Hanwang Zhang , Tat-Seng Chua

Faithfully correcting factual errors is critical for maintaining the integrity of textual knowledge bases and preventing hallucinations in sequence-to-sequence models. Drawing on humans' ability to identify and correct factual errors, we…

Computation and Language · Computer Science 2023-05-30 Kung-Hsiang Huang , Hou Pong Chan , Heng Ji

Explainability methods are used to benchmark the extent to which model predictions align with human rationales i.e., are 'right for the right reasons'. Previous work has failed to acknowledge, however, that what counts as a rationale is…

Computation and Language · Computer Science 2023-10-16 Terne Sasha Thorn Jakobsen , Laura Cabello , Anders Søgaard

Hallucination has been a popular topic in natural language generation (NLG). In real-world applications, unfaithful content can result in poor data quality or loss of trust from end users. Thus, it is crucial to fact-check before adopting…

Computation and Language · Computer Science 2025-02-11 Xiaonan Jing , Srinivas Billa , Danny Godbout

Knowledge gaps and hallucinations are persistent challenges for Large Language Models (LLMs), which generate unreliable responses when lacking the necessary information to fulfill user instructions. Existing approaches, such as…

Computation and Language · Computer Science 2025-11-20 Riccardo Pozzi , Matteo Palmonari , Andrea Coletta , Luigi Bellomarini , Jens Lehmann , Sahar Vahdati

Recourse generators provide actionable insights, often through feature-based counterfactual explanations (CFEs), to help negatively classified individuals understand how to adjust their input features to achieve a positive classification.…

Machine Learning · Computer Science 2025-06-04 Keziah Naggita , Matthew R. Walter , Avrim Blum

Confidentiality hinders the publication of authentic, labeled datasets of personal and enterprise data, although they could be useful for evaluating knowledge graph construction approaches in industrial scenarios. Therefore, our plan is to…

Databases · Computer Science 2021-08-02 Markus Schröder , Christian Jilek , Andreas Dengel

Large language models are widely used across domains, yet there are concerns about their factual reliability and biases. Factual knowledge probing offers a systematic means to evaluate these aspects. Most existing benchmarks focus on…

Computation and Language · Computer Science 2025-12-15 Evren Ayberk Munis , Deniz Yılmaz , Arianna Muti , Çağrı Toraman

We propose a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span 38 categories, including health, law, finance and politics. We crafted questions that…

Computation and Language · Computer Science 2022-05-10 Stephanie Lin , Jacob Hilton , Owain Evans

Document grounded generation is the task of using the information provided in a document to improve text generation. This work focuses on two different document grounded generation tasks: Wikipedia Update Generation task and Dialogue…

Computation and Language · Computer Science 2021-04-27 Shrimai Prabhumoye , Kazuma Hashimoto , Yingbo Zhou , Alan W Black , Ruslan Salakhutdinov

Question answer generation using Natural Language Processing models is ubiquitous in the world around us. It is used in many use cases such as the building of chat bots, suggestive prompts in google search and also as a way of navigating…

Computation and Language · Computer Science 2023-11-28 Shashidhar Reddy Javaji , Haoran Hu , Sai Sameer Vennam , Vijaya Gajanan Buddhavarapu

Fact verification systems typically rely on neural network classifiers for veracity prediction which lack explainability. This paper proposes ProoFVer, which uses a seq2seq model to generate natural logic-based inferences as proofs. These…

Computation and Language · Computer Science 2022-07-05 Amrith Krishna , Sebastian Riedel , Andreas Vlachos