English
Related papers

Related papers: DialFact: A Benchmark for Fact-Checking in Dialogu…

200 papers

In this paper we present the ClaimBuster dataset of 23,533 statements extracted from all U.S. general election presidential debates and annotated by human coders. The ClaimBuster dataset can be leveraged in building computational methods to…

Computation and Language · Computer Science 2020-05-01 Fatma Arslan , Naeemul Hassan , Chengkai Li , Mark Tremayne

A pressing challenge in current dialogue systems is to successfully converse with users on topics with information distributed across different modalities. Previous work in multiturn dialogue systems has primarily focused on either text or…

Computation and Language · Computer Science 2022-04-29 Kai Nakamura , Sharon Levy , Yi-Lin Tuan , Wenhu Chen , William Yang Wang

The Development Knowledge Question Answering (Dev Knowledge QA) task aims to provide natural language answers to knowledge-seeking questions during software development. To investigate its importance and to what extent it has been explored,…

Software Engineering · Computer Science 2025-12-10 Jing Zhang , Lianghong Guo , Yanlin Wang , Mingwei Liu , Jiachi Chen , Yuchi Ma , Ensheng Shi , Terry Yue Zhuo , Hongyu Zhang , Zibin Zheng

We contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification. It is collected from 26 fact checking websites in English, paired with textual sources and rich…

Computation and Language · Computer Science 2019-10-22 Isabelle Augenstein , Christina Lioma , Dongsheng Wang , Lucas Chaves Lima , Casper Hansen , Christian Hansen , Jakob Grue Simonsen

We first propose a new task named Dialogue Description (Dial2Desc). Unlike other existing dialogue summarization tasks such as meeting summarization, we do not maintain the natural flow of a conversation but describe an object or an action…

Computation and Language · Computer Science 2018-11-02 Haojie Pan , Junpei Zhou , Zhou Zhao , Yan Liu , Deng Cai , Min Yang

In this paper, we explore the problem of Claim Extraction using one-to-many text generation methods, comparing LLMs, small summarization models finetuned for the task, and a previous NER-centric baseline QACG. As the current publications on…

Computation and Language · Computer Science 2025-02-10 Herbert Ullrich , Tomáš Mlynář , Jan Drchal

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Evaluation), a public…

Computation and Language · Computer Science 2020-10-02 Shikib Mehri , Mihail Eric , Dilek Hakkani-Tur

The availability of smart devices leads to an exponential increase in multimedia content. However, advancements in deep learning have also enabled the creation of highly sophisticated Deepfake content, including speech Deepfakes, which pose…

Sound · Computer Science 2025-07-16 Menglu Li , Yasaman Ahmadiadli , Xiao-Ping Zhang

Fact-checking real-world claims often requires collecting multiple pieces of evidence and applying complex multi-step reasoning. In this paper, we present Program-Guided Fact-Checking (ProgramFC), a novel fact-checking model that decomposes…

Computation and Language · Computer Science 2023-05-23 Liangming Pan , Xiaobao Wu , Xinyuan Lu , Anh Tuan Luu , William Yang Wang , Min-Yen Kan , Preslav Nakov

We introduce ClarQ-LLM, an evaluation framework consisting of bilingual English-Chinese conversation tasks, conversational agents and evaluation metrics, designed to serve as a strong benchmark for assessing agents' ability to ask…

Computation and Language · Computer Science 2024-09-17 Yujian Gan , Changling Li , Jinxia Xie , Luou Wen , Matthew Purver , Massimo Poesio

Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the claim. In this paper we…

Computation and Language · Computer Science 2023-11-09 Michael Schlichtkrull , Zhijiang Guo , Andreas Vlachos

This paper proposes a novel task on commonsense-enhanced task-based dialogue grounded in documents and describes the Task2Dial dataset, a novel dataset of document-grounded task-based dialogues, where an Information Giver (IG) provides…

Computation and Language · Computer Science 2022-04-05 Carl Strathearn , Dimitra Gkatzia

Check-worthy claim detection aims at providing plausible misinformation to downstream fact-checking systems or human experts to check. This is a crucial step toward accelerating the fact-checking process. Many efforts have been put into how…

Computation and Language · Computer Science 2023-07-25 Yang Bai , Anthony Colas , Daisy Zhe Wang

We present CFEVER, a Chinese dataset designed for Fact Extraction and VERification. CFEVER comprises 30,012 manually created claims based on content in Chinese Wikipedia. Each claim in CFEVER is labeled as "Supports", "Refutes", or "Not…

Computation and Language · Computer Science 2025-06-17 Ying-Jia Lin , Chun-Yi Lin , Chia-Jen Yeh , Yi-Ting Li , Yun-Yu Hu , Chih-Hao Hsu , Mei-Feng Lee , Hung-Yu Kao

Researchers have been investigating automated solutions for fact-checking in a variety of fronts. However, current approaches often overlook the fact that the amount of information released every day is escalating, and a large amount of…

Computation and Language · Computer Science 2024-10-08 Jing Yang , Didier Vega-Oliveros , Tais Seibt , Anderson Rocha

We propose a novel paradigm for automatic fact-checking that leverages frame semantics to enhance the structured understanding of claims and guide the process of fact-checking them. To support this, we introduce a pilot dataset of…

Computation and Language · Computer Science 2025-08-21 Jacob Devasier , Rishabh Mediratta , Akshith Putta , Chengkai Li

Fact verification systems assess a claim's veracity based on evidence. An important consideration in designing them is faithfulness, i.e. generating explanations that accurately reflect the reasoning of the model. Recent works have focused…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Marek Strong , Andreas Vlachos

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

Information verification is quite a challenging task, this is because many times verifying a claim can require picking pieces of information from multiple pieces of evidence which can have a hierarchy of complex semantic relations.…

Computation and Language · Computer Science 2021-02-23 Usama Khalid , Mirza Omer Beg

Recent research suggests that not all fact-checking efforts are equal: when and what is fact-checked plays a pivotal role in effectively correcting misconceptions. In that context, signals capturing how much attention specific topics…

Computers and Society · Computer Science 2022-05-10 Manoel Horta Ribeiro , Savvas Zannettou , Oana Goga , Fabrício Benevenuto , Robert West