中文
相关论文

相关论文: MultiCW: A Large-Scale Balanced Benchmark Dataset …

200 篇论文

Robust automatic fact-checking systems have the potential to combat online misinformation at scale. However, most existing research primarily focuses on English. In this paper, we introduce MultiSynFact, the first large-scale multilingual…

计算与语言 · 计算机科学 2025-02-24 Yi-Ling Chung , Aurora Cobo , Pablo Serna

Recent advances in speech synthesis and voice conversion have greatly improved the naturalness and authenticity of generated audio. Meanwhile, evolving encoding, compression, and transmission mechanisms on social media platforms further…

声音 · 计算机科学 2026-03-09 Daixian Li , Jun Xue , Yanzhen Ren , Zhuolin Yi , Yihuan Huang , Guanxiang Feng , Yi Chai

Multilingual Large Language Models (LLMs) offer powerful capabilities for cross-lingual fact-checking. However, these models often exhibit language bias, performing disproportionately better on high-resource languages such as English than…

Multilingual falsehoods threaten information integrity worldwide, yet detection benchmarks remain confined to English or a few high-resource languages, leaving low-resource linguistic communities without robust defense tools. We introduce…

Predictive analysis is a cornerstone of modern decision-making, with applications in various domains. Large Language Models (LLMs) have emerged as powerful tools in enabling nuanced, knowledge-intensive conversations, thus aiding in complex…

计算与语言 · 计算机科学 2025-05-26 Qin Chen , Yuanyi Ren , Xiaojun Ma , Yuyang Shi

In the context of fact-checking, claims are often repeated across various platforms and in different languages, which can benefit from a process that reduces this redundancy. While retrieving previously fact-checked claims has been…

计算与语言 · 计算机科学 2025-03-31 Rrubaa Panchendrarajan , Rubén Míguez , Arkaitz Zubiaga

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

计算与语言 · 计算机科学 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Claim-level Uncertainty Quantification (UQ) is a promising approach to mitigate the lack of reliability in Large Language Models (LLMs). We introduce MUCH, the first claim-level UQ benchmark designed for fair and reproducible evaluation of…

计算与语言 · 计算机科学 2026-02-23 Jérémie Dentan , Alexi Canesse , Davide Buscaldi , Aymen Shabou , Sonia Vanier

We introduce a new reading comprehension dataset, dubbed MultiWikiQA, which covers 306 languages and has 1,220,757 samples in total. We start with Wikipedia articles, which also provide the context for the dataset samples, and use an LLM to…

计算与语言 · 计算机科学 2026-03-05 Dan Saattrup Smart

Large language models (LLMs) are advancing at an unprecedented pace globally, with regions increasingly adopting these models for applications in their primary language. Evaluation of these models in diverse linguistic environments,…

In this paper, we explore the challenges associated with establishing an end-to-end fact-checking pipeline in a real-world context, covering over 90 languages. Our real-world experimental benchmarks demonstrate that fine-tuning Transformer…

计算与语言 · 计算机科学 2024-05-01 Vinay Setty

Deploying Large Language Models (LLMs) in medical applications requires fact-checking capabilities to ensure patient safety and regulatory compliance. We introduce MedFact, a challenging Chinese medical fact-checking benchmark with 2,116…

计算与语言 · 计算机科学 2025-11-18 Jiayi He , Yangmin Huang , Qianyun Du , Xiangying Zhou , Zhiyang He , Jiaxue Hu , Xiaodong Tao , Lixian Lai

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by…

计算与语言 · 计算机科学 2021-06-18 Ashim Gupta , Vivek Srikumar

Large Language Models (LLMs) are widely used in many different domains, but because of their limited interpretability, there are questions about how trustworthy they are in various perspectives, e.g., truthfulness and toxicity. Recent…

软件工程 · 计算机科学 2024-08-21 Xuan Xie , Jiayang Song , Yuheng Huang , Da Song , Fuyuan Zhang , Felix Juefei-Xu , Lei Ma

The rise of digital misinformation has heightened interest in using multilingual Large Language Models (LLMs) for fact-checking. This study systematically evaluates translation bias and the effectiveness of LLMs for cross-lingual claim…

计算与语言 · 计算机科学 2024-10-15 Aryan Singhal , Veronica Shao , Gary Sun , Ryan Ding , Jonathan Lu , Kevin Zhu

The evaluation of Large Language Models (LLMs) on mathematical reasoning has largely focused on elementary problems, competition-style questions, or formal theorem proving, leaving graduate-level and computational mathematics relatively…

计算与语言 · 计算机科学 2026-03-05 Bianca Raimondi , Francesco Pivi , Davide Evangelista , Maurizio Gabbrielli

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

计算机与社会 · 计算机科学 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

Text watermarking provides an effective solution for identifying synthetic text generated by large language models. However, existing techniques often focus on satisfying specific criteria while ignoring other key aspects, lacking a unified…

密码学与安全 · 计算机科学 2025-03-28 Shuhao Zhang , Bo Cheng , Jiale Han , Yuli Chen , Zhixuan Wu , Changbao Li , Pingli Gu

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, focus on only one or two languages and tasks, suffer from evidence leakage, or rely on external sets of news articles for…

计算与语言 · 计算机科学 2026-01-13 Jiahui Geng , Jonathan Tonglet , Iryna Gurevych

Identifying check-worthy claims is often the first step of automated fact-checking systems. Tackling this task in a multilingual setting has been understudied. Encoding inputs with multilingual text representations could be one approach to…

计算与语言 · 计算机科学 2021-09-21 Ipek Baris Schlicht , Angel Felipe Magnossão de Paula , Paolo Rosso