English
Related papers

Related papers: SemEval-2020 Task 5: Counterfactual Recognition

200 papers

In semantic parsing for question-answering, it is often too expensive to collect gold parses or even gold answers as supervision signals. We propose to convert model outputs into a set of human-understandable statements which allow…

Computation and Language · Computer Science 2018-11-30 Carolin Lawrence , Stefan Riezler

When a retrieval system receives a query it has encountered before, previous relevance feedback, such as clicks or explicit judgments can help to improve retrieval results. However, the content of a previously relevant document may have…

Information Retrieval · Computer Science 2025-02-07 Jüri Keller , Maik Fröbe , Gijs Hendriksen , Daria Alexander , Martin Potthast , Matthias Hagen , Philipp Schaer

In this paper, we describe our mUlti-task learNIng for cOmmonsense reasoNing (UNION) system submitted for Task C of the SemEval2020 Task 4, which is to generate a reason explaining why a given false statement is non-sensical. However, we…

Computation and Language · Computer Science 2020-07-01 Anandh Perumal , Chenyang Huang , Amine Trabelsi , Osmar R. Zaïane

Language models, particularly generative models, are susceptible to hallucinations, generating outputs that contradict factual knowledge or the source text. This study explores methods for detecting hallucinations in three SemEval-2024 Task…

When applied in healthcare, reinforcement learning (RL) seeks to dynamically match the right interventions to subjects to maximize population benefit. However, the learned policy may disproportionately allocate efficacious actions to one…

Machine Learning · Statistics 2025-01-15 Jitao Wang , Chengchun Shi , John D. Piette , Joshua R. Loftus , Donglin Zeng , Zhenke Wu

Counterfactual reasoning from logged data has become increasingly important for many applications such as web advertising or healthcare. In this paper, we address the problem of learning stochastic policies with continuous actions from the…

Machine Learning · Statistics 2025-02-24 Houssam Zenati , Alberto Bietti , Matthieu Martin , Eustache Diemert , Pierre Gaillard , Julien Mairal

In recent years, the growing ubiquity of Internet memes on social media platforms, such as Facebook, Instagram, and Twitter, has become a topic of immense interest. However, the classification and recognition of memes is much more…

Computation and Language · Computer Science 2020-07-29 Li Yuan , Jin Wang , Xuejie Zhang

The SemEval-2025 Task 11, Bridging the Gap in Text-Based Emotion Detection, introduces an emotion recognition challenge spanning over 28 languages. This competition encourages researchers to explore more advanced approaches to address the…

Computation and Language · Computer Science 2025-08-19 Tian Li , Yujian Sun , Huizhi Liang

This paper describes our system developed for SemEval-2024 Task 8, ``Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection'' Machine-generated texts have been one of the main concerns due to the use of…

Computation and Language · Computer Science 2024-03-29 Shubhashis Roy Dipta , Sadat Shahriar

In the environment of fair lending laws and the General Data Protection Regulation (GDPR), the ability to explain a model's prediction is of paramount importance. High quality explanations are the first step in assessing fairness.…

Machine Learning · Computer Science 2021-06-23 Rachana Balasubramanian , Samuel Sharpe , Brian Barr , Jason Wittenbach , C. Bayan Bruss

Counterfactual inference considers a hypothetical intervention in a parallel world that shares some evidence with the factual world. If the evidence specifies a conditional distribution on a manifold, counterfactuals may be analytically…

Machine Learning · Statistics 2024-07-03 Juha Karvanen , Santtu Tikka , Matti Vihola

The ability to understand emotions is an essential component of human-like artificial intelligence, as emotions greatly influence human cognition, decision making, and social interactions. In addition to emotion recognition in…

Computation and Language · Computer Science 2024-07-09 Fanfan Wang , Heqing Ma , Jianfei Yu , Rui Xia , Erik Cambria

Being able to provide counterfactual interventions - sequences of actions we would have had to take for a desirable outcome to happen - is essential to explain how to change an unfavourable decision by a black-box machine learning model…

Machine Learning · Computer Science 2023-02-08 Giovanni De Toni , Bruno Lepri , Andrea Passerini

This work presents an ensemble system based on various uni-modal and bi-modal model architectures developed for the SemEval 2022 Task 5: MAMI-Multimedia Automatic Misogyny Identification. The challenge organizers provide an English meme…

Computation and Language · Computer Science 2022-04-11 Wentao Yu , Benedikt Boenninghoff , Jonas Roehrig , Dorothea Kolossa

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

In the framework of structural causal models, counterfactual queries describe events that concern multiple alternative states of the system under study. Counterfactual queries often take the form of "what if" type questions such as "would…

Methodology · Statistics 2023-11-23 Santtu Tikka

Users from the online environment can create different ways of expressing their thoughts, opinions, or conception of amusement. Internet memes were created specifically for these situations. Their main purpose is to transmit ideas by using…

Computation and Language · Computer Science 2020-11-11 George-Alexandru Vlad , George-Eduard Zaharia , Dumitru-Clementin Cercel , Costin-Gabriel Chiru , Stefan Trausan-Matu

Counterfactual reasoning is pivotal in human cognition and especially important for providing explanations and making decisions. While Judea Pearl's influential approach is theoretically elegant, its generation of a counterfactual scenario…

Artificial Intelligence · Computer Science 2024-11-01 Guang-Yuan Hao , Jiji Zhang , Biwei Huang , Hao Wang , Kun Zhang

Counterfactual Explanations (CEs) are a powerful technique used to explain Machine Learning models by showing how the input to a model should be minimally changed for the model to produce a different output. Similar proposals have been made…

Artificial Intelligence · Computer Science 2025-09-01 Nicola Gigante , Francesco Leofante , Andrea Micheli

Counterfactual reasoning, a fundamental aspect of human cognition, involves contemplating alternatives to established facts or past events, significantly enhancing our abilities in planning and decision-making. In light of the advancements…

Computation and Language · Computer Science 2024-04-17 Letian Zhang , Xiaotong Zhai , Zhongkai Zhao , Yongshuo Zong , Xin Wen , Bingchen Zhao