English
Related papers

Related papers: SemEval-2019 Task 8: Fact Checking in Community Qu…

200 papers

Media is full of false claims. Even Oxford Dictionaries named "post-truth" as the word of 2016. This makes it more important than ever to build systems that can identify the veracity of a story, and the kind of discourse there is around it.…

Computation and Language · Computer Science 2017-04-21 Leon Derczynski , Kalina Bontcheva , Maria Liakata , Rob Procter , Geraldine Wong Sak Hoi , Arkaitz Zubiaga

This paper discusses the fourth year of the ``Sentiment Analysis in Twitter Task''. SemEval-2016 Task 4 comprises five subtasks, three of which represent a significant departure from previous editions. The first two subtasks are reruns from…

Computation and Language · Computer Science 2021-09-22 Preslav Nakov , Alan Ritter , Sara Rosenthal , Fabrizio Sebastiani , Veselin Stoyanov

We present the system we built for participating in SemEval-2016 Task 3 on Community Question Answering. We achieved the best results on subtask C, and strong results on subtasks A and B, by combining a rich set of various types of…

The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers. Evidence can be found either via a search engine, or via a…

This paper describes our submission to subtask a and b of SemEval-2020 Task 4. For subtask a, we use a ALBERT based model with improved input form to pick out the common sense statement from two statement candidates. For subtask b, we use a…

Computation and Language · Computer Science 2020-07-07 Shilei Liu , Yu Guo , Bochao Li , Feiliang Ren

This is the proposal for RumourEval-2019, which will run in early 2019 as part of that year's SemEval event. Since the first RumourEval shared task in 2017, interest in automated claim validation has greatly increased, as the dangers of…

Computation and Language · Computer Science 2018-09-19 Genevieve Gorrell , Kalina Bontcheva , Leon Derczynski , Elena Kochkina , Maria Liakata , Arkaitz Zubiaga

In this paper, we describe the 2015 iteration of the SemEval shared task on Sentiment Analysis in Twitter. This was the most popular sentiment analysis shared task to date with more than 40 teams participating in each of the last three…

Computation and Language · Computer Science 2019-12-09 Sara Rosenthal , Saif M Mohammad , Preslav Nakov , Alan Ritter , Svetlana Kiritchenko , Veselin Stoyanov

Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we…

Computation and Language · Computer Science 2018-03-09 Tsvetomila Mihaylova , Preslav Nakov , Lluis Marquez , Alberto Barron-Cedeno , Mitra Mohtarami , Georgi Karadzhov , James Glass

Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation. We introduce the task of fact-checking in dialogue, which is a relatively unexplored area. We construct DialFact, a testing benchmark dataset of…

Computation and Language · Computer Science 2022-03-25 Prakhar Gupta , Chien-Sheng Wu , Wenhao Liu , Caiming Xiong

We present the results and the main findings of SemEval-2024 Task 8: Multigenerator, Multidomain, and Multilingual Machine-Generated Text Detection. The task featured three subtasks. Subtask A is a binary classification task determining…

ISCAS participated in two subtasks of SemEval 2020 Task 5: detecting counterfactual statements and detecting antecedent and consequence. This paper describes our system which is based on pre-trained transformers. For the first subtask, we…

Computation and Language · Computer Science 2020-09-18 Yaojie Lu , Annan Li , Hongyu Lin , Xianpei Han , Le Sun

This paper describes team Turing's submission to SemEval 2017 RumourEval: Determining rumour veracity and support for rumours (SemEval 2017 Task 8, Subtask A). Subtask A addresses the challenge of rumour stance classification, which…

Computation and Language · Computer Science 2017-04-25 Elena Kochkina , Maria Liakata , Isabelle Augenstein

We study the problem of automatic fact-checking, paying special attention to the impact of contextual and discourse information. We address two related tasks: (i) detecting check-worthy claims, and (ii) fact-checking claims. We develop…

We present an overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims, with focus on Task 1: Check-Worthiness. The task asks to predict which claims in a political debate should be…

We describe SemEval-2021 task 6 on Detection of Persuasion Techniques in Texts and Images: the data, the annotation guidelines, the evaluation setup, the results, and the participating systems. The task focused on memes and had three…

This paper describes BUT-FIT's submission at SemEval-2020 Task 5: Modelling Causal Reasoning in Language: Detecting Counterfactuals. The challenge focused on detecting whether a given statement contains a counterfactual (Subtask 1) and…

Computation and Language · Computer Science 2020-07-29 Martin Fajcik , Josef Jon , Martin Docekal , Pavel Smrz

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each decision. To study…

Computation and Language · Computer Science 2020-10-06 David Wadden , Shanchuan Lin , Kyle Lo , Lucy Lu Wang , Madeleine van Zuylen , Arman Cohan , Hannaneh Hajishirzi

This paper presents a system developed for SemEval 2025 Task 8: Question Answering (QA) over tabular data. Our approach integrates several key components: text-to-SQL and text-to-code generation modules, a self-correction mechanism, and a…

Computation and Language · Computer Science 2025-06-17 Nikolas Evkarpidi , Elena Tutubalina

This paper presents our strategies in SemEval 2020 Task 4: Commonsense Validation and Explanation. We propose a novel way to search for evidence and choose the different large-scale pre-trained models as the backbone for three subtasks. The…

Computation and Language · Computer Science 2020-07-27 Jiajing Wan , Xinting Huang