English
Related papers

Related papers: Stance Detection Benchmark: How Robust Is Your Sta…

200 papers

In this study, we use recent stance detection methods to study the stance (for, against or neutral) of statements in official information booklets for voters. Our main goal is to answer the fundamental question: are topics to be voted on…

Computation and Language · Computer Science 2023-06-16 Eric Egli , Noah Mamié , Eyal Liron Dolev , Mathias Müller

We describe MITRE's submission to the SemEval-2016 Task 6, Detecting Stance in Tweets. This effort achieved the top score in Task A on supervised stance detection, producing an average F1 score of 67.8 when assessing whether a tweet author…

Artificial Intelligence · Computer Science 2016-06-14 Guido Zarrella , Amy Marsh

Context detection involves labeling segments of an online stream of data as belonging to different tasks. Task labels are used in lifelong learning algorithms to perform consolidation or other procedures that prevent catastrophic…

Machine Learning · Computer Science 2024-09-04 Jeffery Dick , Saptarshi Nath , Christos Peridis , Eseoghene Benjamin , Soheil Kolouri , Andrea Soltoggio

Machine learning models are often brittle on production data despite achieving high accuracy on benchmark datasets. Benchmark datasets have traditionally served dual purposes: first, benchmarks offer a standard on which machine learning…

Machine Learning · Computer Science 2022-09-26 Matthew Groh

The proliferation of misinformation, such as rumors on social media, has drawn significant attention, prompting various expressions of stance among users. Although rumor detection and stance detection are distinct tasks, they can complement…

Computation and Language · Computer Science 2025-02-14 Ruichao Yang , Jing Ma , Wei Gao , Hongzhan Lin

Argumentative stance classification plays a key role in identifying authors' viewpoints on specific topics. However, generating diverse pairs of argumentative sentences across various domains is challenging. Existing benchmarks often come…

Computation and Language · Computer Science 2024-11-19 Jiaqing Yuan , Ruijie Xi , Munindar P. Singh

Zero-shot stance detection is challenging because it requires detecting the stance of previously unseen targets in the inference phase. The ability to learn transferable target-invariant features is critical for zero-shot stance detection.…

Computation and Language · Computer Science 2022-10-10 Xuechen Zhao , Jiaying Zou , Zhong Zhang , Feng Xie , Bin Zhou , Lei Tian

The proliferation of fake news and its propagation on social media has become a major concern due to its ability to create devastating impacts. Different machine learning approaches have been suggested to detect fake news. However, most of…

Computation and Language · Computer Science 2021-04-14 Junaed Younus Khan , Md. Tawkat Islam Khondaker , Sadia Afroz , Gias Uddin , Anindya Iqbal

Mis- and disinformation online have become a major societal problem as major sources of online harms of different kinds. One common form of mis- and disinformation is out-of-context (OOC) information, where different pieces of information…

Computation and Language · Computer Science 2025-09-09 Xin Yuan , Jie Guo , Weidong Qiu , Zheng Huang , Shujun Li

The recent advances in natural language processing have yielded many exciting developments in text analysis and language understanding models; however, these models can also be used to track people, bringing severe privacy concerns. In this…

Computation and Language · Computer Science 2022-07-26 Dilara Dogan , Bahadir Altun , Muhammed Said Zengin , Mucahid Kutlu , Tamer Elsayed

Open-set learning and discovery (OSLD) is a challenging machine learning task in which samples from new (unknown) classes can appear at test time. It can be seen as a generalization of zero-shot learning, where the new classes are not known…

The task of definition detection is important for scholarly papers, because papers often make use of technical terminology that may be unfamiliar to readers. Despite prior work on definition detection, current approaches are far from being…

Computation and Language · Computer Science 2020-10-13 Dongyeop Kang , Andrew Head , Risham Sidhu , Kyle Lo , Daniel S. Weld , Marti A. Hearst

Recent advancements in Document Layout Analysis through Large Language Models and Multimodal Models have significantly improved layout detection. However, despite these improvements, challenges remain in addressing critical structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Inbum Heo , Taewook Hwang , Jeesu Jung , Sangkeun Jung

Human cognition, driven by complex neurochemical processes, oscillates between imagination and reality and learns to self-correct whenever such subtle drifts lead to hallucinations or unsafe associations. In recent years, LLMs have…

Computation and Language · Computer Science 2026-01-09 Sharanya Dasgupta , Arkaprabha Basu , Sujoy Nath , Swagatam Das

As the number of novel data-driven approaches to material science continues to grow, it is crucial to perform consistent quality, reliability and applicability assessments of model performance. In this paper, we benchmark the Materials…

Materials Science · Physics 2021-08-04 Pierre-Paul De Breuck , Matthew L. Evans , Gian-Marco Rignanese

The Internet is rife with flourishing rumours that spread through microblogs and social media. Recent work has shown that analysing the stance of the crowd towards a rumour is a good indicator for its veracity. One state-of-the-art system…

Computation and Language · Computer Science 2019-07-03 Anders Edelbo Lillie , Emil Refsgaard Middelboe

To advance argumentative stance prediction as a multimodal problem, the First Shared Task in Multimodal Argument Mining hosted stance prediction in crucial social topics of gun control and abortion. Our exploratory study attempts to…

Computation and Language · Computer Science 2023-10-12 Arushi Sharma , Abhibha Gupta , Maneesh Bilalpur

We extensively compare, qualitatively and quantitatively, 40 state-of-the-art models (28 salient object detection, 10 fixation prediction, 1 objectness, and 1 baseline) over 6 challenging datasets for the purpose of benchmarking salient…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Ali Borji , Ming-Ming Cheng , Huaizu Jiang , Jia Li

Social media's global reach amplifies the spread of information, highlighting the need for robust Natural Language Processing tasks like stance detection across languages and modalities. Prior research predominantly focuses on text-only…

Computation and Language · Computer Science 2025-01-30 Jake Vasilakes , Carolina Scarton , Zhixue Zhao

This paper describes our approach for the Detecting Stance in Tweets task (SemEval-2016 Task 6). We utilized recent advances in short text categorization using deep learning to create word-level and character-level models. The choice…

Computation and Language · Computer Science 2016-06-21 Prashanth Vijayaraghavan , Ivan Sysoev , Soroush Vosoughi , Deb Roy