English
Related papers

Related papers: Checking Fact Worthiness using Sentence Embeddings

200 papers

We investigate the task of assessing sentence-level prompt relevance in learner essays. Various systems using word overlap, neural embeddings and neural compositional models are evaluated on two datasets of learner writing. We propose a new…

Computation and Language · Computer Science 2017-07-18 Marek Rei , Ronan Cummins

Given the recent proliferation of false claims online, there has been a lot of manual fact-checking effort. As this is very time-consuming, human fact-checkers can benefit from tools that can support them and make them more efficient. Here,…

Computation and Language · Computer Science 2022-11-16 Shaden Shaar , Nikola Georgiev , Firoj Alam , Giovanni Da San Martino , Aisha Mohamed , Preslav Nakov

In the context of investigative journalism, we address the problem of automatically identifying which claims in a given document are most worthy and should be prioritized for fact-checking. Despite its importance, this is a relatively…

Computation and Language · Computer Science 2019-12-18 Pepa Gencheva , Ivan Koychev , Lluís Màrquez , Alberto Barrón-Cedeño , Preslav Nakov

Text embedding models from Natural Language Processing can map text data (e.g. words, sentences, documents) to supposedly meaningful numerical representations (a.k.a. text embeddings). While such models are increasingly applied in social…

Computers and Society · Computer Science 2023-01-24 Qixiang Fang , Dong Nguyen , Daniel L Oberski

Cutting-edge abstractive summarisers generate fluent summaries, but the factuality of the generated text is not guaranteed. Early summary factuality evaluation metrics are usually based on n-gram overlap and embedding similarity, but are…

Computation and Language · Computer Science 2024-09-24 Yuxuan Ye , Edwin Simpson , Raul Santos Rodriguez

Recently, there has been an interest in factual verification and prediction over structured data like tables and graphs. To circumvent any false news incident, it is necessary to not only model and predict over structured data efficiently…

Computation and Language · Computer Science 2021-04-13 Aditya Jindal , Ankur Gupta , Jaya Srivastava , Preeti Menghwani , Vijit Malik , Vishesh Kaushik , Ashutosh Modi

Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation. In this paper, we present an automated fact-checking platform which given a…

Computation and Language · Computer Science 2019-04-04 Sebastião Miranda , David Nogueira , Afonso Mendes , Andreas Vlachos , Andrew Secker , Rebecca Garrett , Jeff Mitchel , Zita Marinho

As the first step of automatic fact checking, claim check-worthiness detection is a critical component of fact checking systems. There are multiple lines of research which study this problem: check-worthiness ranking from political speeches…

Computation and Language · Computer Science 2020-09-17 Dustin Wright , Isabelle Augenstein

We propose a new uniform framework for text classification and ranking that can automate the process of identifying check-worthy sentences in political debates and speech transcripts. Our framework combines the semantic analysis of the…

Computation and Language · Computer Science 2022-11-22 Ting Su , Craig Macdonald , Iadh Ounis

As online false information continues to grow, automated fact-checking has gained an increasing amount of attention in recent years. Researchers in the field of Natural Language Processing (NLP) have contributed to the task by building…

Computation and Language · Computer Science 2021-09-24 Xia Zeng , Amani S. Abumansour , Arkaitz Zubiaga

Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking.…

Computation and Language · Computer Science 2024-02-09 Eun Cheol Choi , Emilio Ferrara

Fact-checking the truthfulness of claims usually requires reasoning over multiple evidence sentences. Oftentimes, evidence sentences may not be always self-contained, and may require additional contexts and references from elsewhere to…

Computation and Language · Computer Science 2025-02-17 Delvin Ce Zhang , Dongwon Lee

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. Difficulties lie in assessing the factuality of free-form responses in open…

Computation and Language · Computer Science 2025-10-30 Yuxia Wang , Minghan Wang , Hasan Iqbal , Georgi Georgiev , Jiahui Geng , Preslav Nakov

Word and sentence embeddings are useful feature representations in natural language processing. However, intrinsic evaluation for embeddings lags far behind, and there has been no significant update since the past decade. Word and sentence…

Computation and Language · Computer Science 2022-03-22 Bin Wang , C. -C. Jay Kuo , Haizhou Li

Fact verification models have enjoyed a fast advancement in the last two years with the development of pre-trained language models like BERT and the release of large scale datasets such as FEVER. However, the challenging problem of fake…

Computation and Language · Computer Science 2020-10-13 Qifei Li , Wangchunshu Zhou

Recent years have seen the proliferation of disinformation and fake news online. Traditional approaches to mitigate these issues is to use manual or automatic fact-checking. Recently, another approach has emerged: checking whether the input…

Computation and Language · Computer Science 2022-05-10 Shaden Shaar , Firoj Alam , Giovanni Da San Martino , Preslav Nakov

The wide use of social media and digital technologies facilitates sharing various news and information about events and activities. Despite sharing positive information misleading and false information is also spreading on social media.…

Computation and Language · Computer Science 2022-07-18 Prerona Tarannum , Firoj Alam , Md. Arid Hasan , Sheak Rashed Haider Noori

Widespread and rapid dissemination of false news has made fact-checking an indispensable requirement. Given its time-consuming and labor-intensive nature, the task calls for an automated support to meet the demand. In this paper, we propose…

Computation and Language · Computer Science 2021-08-10 Ipek Baris Schlicht , Erhan Sezerer , Selma Tekir , Oul Han , Zeyd Boukhers

We introduce 'FactCheck Editor', an advanced text editor designed to automate fact-checking and correct factual inaccuracies. Given the widespread issue of misinformation, often a result of unintentional mistakes by content creators, our…

Computation and Language · Computer Science 2024-05-01 Vinay Setty

The increased use of large language models (LLMs) across a variety of real-world applications calls for automatic tools to check the factual accuracy of their outputs, as LLMs often hallucinate. This is difficult as it requires assessing…

Computation and Language · Computer Science 2025-10-30 Hasan Iqbal , Yuxia Wang , Minghan Wang , Georgi Georgiev , Jiahui Geng , Iryna Gurevych , Preslav Nakov