English
Related papers

Related papers: TurQUaz at CheckThat! 2025: Debating Large Languag…

200 papers

In this paper, we develop an LLM-powered framework for the curation and evaluation of emerging opinion mining in online health communities. We formulate emerging opinion mining as a pairwise stance detection problem between (title, comment)…

Computation and Language · Computer Science 2024-03-07 Joseph Gatto , Madhusudan Basak , Yash Srivastava , Philip Bohlman , Sarah M. Preum

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-checkers with their…

Computation and Language · Computer Science 2024-10-31 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Marián Šimko

The spread of propaganda through the internet has increased drastically over the past years. Lately, propaganda detection has started gaining importance because of the negative impact it has on society. In this work, we describe our…

Computation and Language · Computer Science 2022-10-21 Tanmay Chavan , Aditya Kane

We introduce ClaimCheck, an LLM-guided automatic fact-checking system designed to verify real-world claims using live Web evidence and small language models. Unlike prior systems that rely on large, closed-source models and static knowledge…

Computation and Language · Computer Science 2025-10-03 Akshith Reddy Putta , Jacob Devasier , Chengkai Li

Scientific literature is growing exponentially, creating a critical bottleneck for researchers to efficiently synthesize knowledge. While general-purpose Large Language Models (LLMs) show potential in text processing, they often fail to…

Computation and Language · Computer Science 2025-09-11 Fengyu She , Nan Wang , Hongfei Wu , Ziyi Wan , Jingmian Wang , Chang Wang

We propose a multi-task deep-learning approach for estimating the check-worthiness of claims in political debates. Given a political debate, such as the 2016 US Presidential and Vice-Presidential ones, the task is to predict which…

Computation and Language · Computer Science 2019-08-22 Slavena Vasileva , Pepa Atanasova , Lluís Màrquez , Alberto Barrón-Cedeño , Preslav Nakov

Accurate detection of errors in large language models (LLM) responses is central to the success of scalable oversight, or providing effective supervision to superhuman intelligence. Yet, self-diagnosis is often unreliable on complex tasks…

Machine Learning · Computer Science 2025-10-27 Yongqiang Chen , Gang Niu , James Cheng , Bo Han , Masashi Sugiyama

The rise of Large Language Models (LLMs) has raised questions about their ability to understand climate-related contexts. Though climate change dominates social media, analyzing its multimodal expressions is understudied, and current tools…

Computation and Language · Computer Science 2025-04-08 Abhilekh Borah , Hasnat Md Abdullah , Kangda Wei , Ruihong Huang

Misinformation spread over social media has become an undeniable infodemic. However, not all spreading claims are made equal. If propagated, some claims can be destructive, not only on the individual level, but to organizations and even…

Computation and Language · Computer Science 2022-11-10 Maram Hasanain , Tamer Elsayed

Significant scientific discoveries have driven the progress of human civilisation. The explosion of scientific literature and data has created information barriers across disciplines that have slowed the pace of scientific discovery. Large…

Computation and Language · Computer Science 2023-11-13 Biqing Qi , Kaiyan Zhang , Haoxiang Li , Kai Tian , Sihang Zeng , Zhang-Ren Chen , Bowen Zhou

Common methods for aligning large language models (LLMs) with desired behaviour heavily rely on human-labelled data. However, as models grow increasingly sophisticated, they will surpass human expertise, and the role of human evaluation…

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

With the rapid expansion of content on social media platforms, analyzing and comprehending online discourse has become increasingly complex. This paper introduces LLMTaxo, a novel framework leveraging large language models for the automated…

Computation and Language · Computer Science 2025-10-21 Haiqi Zhang , Zhengyuan Zhu , Zeyu Zhang , Chengkai Li

Large language models (LLMs) have grown in their usage to provide support for question answering across numerous disciplines. The models on their own have already shown promise for answering basic questions, however fail quickly where…

Information Retrieval · Computer Science 2025-04-15 David Brett , Anniek Myatt

This paper describes the participation of QUST_NLP in the SemEval-2025 Task 7. We propose a three-stage retrieval framework specifically designed for fact-checked claim retrieval. Initially, we evaluate the performance of several retrieval…

Computation and Language · Computer Science 2025-06-30 Jiyan Liu , Youzheng Liu , Taihang Wang , Xiaoman Xu , Yimin Wang , Ye Jiang

The widespread use of social media has led to a surge in popularity for automated methods of analyzing public opinion. Supervised methods are adept at text categorization, yet the dynamic nature of social media discussions poses a continual…

Computation and Language · Computer Science 2025-01-28 Tunazzina Islam , Dan Goldwasser

While Large Language Models (LLMs) can amplify online misinformation, they also show promise in tackling misinformation. In this paper, we empirically study the capabilities of three LLMs -- ChatGPT, Gemini, and Claude -- in countering…

Computation and Language · Computer Science 2025-09-29 Adiba Mahbub Proma , Neeley Pate , James Druckman , Gourab Ghoshal , Hangfeng He , Ehsan Hoque

The advancements of large language models (LLMs) have piqued growing interest in developing LLM-based language agents to automate scientific discovery end-to-end, which has sparked both excitement and skepticism about their true…

As the application of Large Language Models (LLMs) expands, the demand for reliable evaluations increases. Existing LLM evaluation benchmarks primarily rely on static datasets, making it challenging to assess model performance in dynamic…

Computation and Language · Computer Science 2024-10-08 Qingchen Yu , Shichao Song , Ke Fang , Yunfeng Shi , Zifan Zheng , Hanyu Wang , Simin Niu , Zhiyu Li

The identification and classification of political claims is an important step in the analysis of political newspaper reports; however, resources for this task are few and far between. This paper explores different strategies for the…

Computation and Language · Computer Science 2023-10-16 Urs Zaberer , Sebastian Padó , Gabriella Lapesa