中文
相关论文

相关论文: DecMetrics: Structured Claim Decomposition Scoring…

200 篇论文

We present ThinknCheck, a 1B-parameter verifier for grounded claim verification that first produces a short, structured rationale and then a binary verdict. We construct LLMAggreFact-Think, a 24.1k reasoning-augmented training set derived…

人工智能 · 计算机科学 2026-04-03 Delip Rao , Feijiang Han , Chris Callison-Burch

Few-shot prompting is a surprisingly powerful way to use Large Language Models (LLMs) to solve various tasks. However, this approach struggles as the task complexity increases or when the individual reasoning steps of the task themselves…

计算与语言 · 计算机科学 2023-04-13 Tushar Khot , Harsh Trivedi , Matthew Finlayson , Yao Fu , Kyle Richardson , Peter Clark , Ashish Sabharwal

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

计算与语言 · 计算机科学 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

计算机与社会 · 计算机科学 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

While language models (LMs) can sometimes generate factually correct text and estimate truth values of individual claims, these generally do not reflect a globally coherent, manipulable model of the world. As a consequence, current LMs also…

计算与语言 · 计算机科学 2024-06-28 Afra Feyza Akyürek , Ekin Akyürek , Leshem Choshen , Derry Wijaya , Jacob Andreas

Entity abstract summarization aims to generate a coherent description of a given entity based on a set of relevant Internet documents. Pretrained language models (PLMs) have achieved significant success in this task, but they may suffer…

计算与语言 · 计算机科学 2024-03-01 Fangwei Zhu , Peiyi Wang , Zhifang Sui

A core part of scientific peer review involves providing expert critiques that directly assess the scientific claims a paper makes. While it is now possible to automatically generate plausible (if generic) reviews, ensuring that these…

In this paper, we explore the challenges associated with establishing an end-to-end fact-checking pipeline in a real-world context, covering over 90 languages. Our real-world experimental benchmarks demonstrate that fine-tuning Transformer…

计算与语言 · 计算机科学 2024-05-01 Vinay Setty

LLM-based reviewing systems typically take only the manuscript as input, leaving literature and code-based claims hard to verify. We present FactReview, a system that extracts review-relevant claims, grounds them in related work, and, when…

人工智能 · 计算机科学 2026-05-28 Ling Yue , Chaoqian Ouyang , Hang Xu , Ruijun Huang , Yuchen Liu , Libin Zheng , Wei Liu , Shaowu Pan , Shimin Di , Min-Ling Zhang

Backtesting LLMs on resolved events assumes models reason only from pre-cutoff knowledge, yet pretrained models inevitably leak post-cutoff knowledge. We introduce a claim-level evaluation framework that decomposes prediction rationales…

人工智能 · 计算机科学 2026-05-26 Zeyu Zhang , Ryan Chen , Bradly C. Stadie

Scientific and Technical Intelligence (S&TI) analysis requires verifying complex technical claims across rapidly growing literature, where existing approaches fail to bridge the verification gap between surface-level accuracy and deeper…

人工智能 · 计算机科学 2026-04-06 Yuntao Du , Minh Dinh , Kaiyuan Zhang , Ninghui Li

Attributed Question Answering (AQA) aims to provide both a trustworthy answer and a reliable attribution report for a given question. Retrieval is a widely adopted approach, including two general paradigms: Retrieval-Then-Read (RTR) and…

计算与语言 · 计算机科学 2025-09-15 Zhichao Yan , Jiapu Wang , Jiaoyan Chen , Xiaoli Li , Ru Li , Jeff Z. Pan

Fact-checking systems with search-enabled large language models (LLMs) have shown strong potential for verifying claims by dynamically retrieving external evidence. However, the robustness of such systems against adversarial attack remains…

密码学与安全 · 计算机科学 2026-03-17 Haoran Ou , Kangjie Chen , Gelei Deng , Hangcheng Liu , Jie Zhang , Tianwei Zhang , Kwok-Yan Lam

Claim verification is the task of determining whether a claim is supported or refuted by evidence. Self-improvement methods, where reasoning chains are generated and those leading to correct results are selected for training, have succeeded…

人工智能 · 计算机科学 2025-09-25 Haisong Gong , Jing Li , Junfei Wu , Qiang Liu , Shu Wu , Liang Wang

Fact-checking long-form text is challenging, and it is therefore common practice to break it down into multiple atomic claims. The typical approach to fact-checking these atomic claims involves retrieving a fixed number of pieces of…

信息检索 · 计算机科学 2025-10-20 Zhuohan Xie , Rui Xing , Yuxia Wang , Jiahui Geng , Hasan Iqbal , Dhruv Sahnan , Iryna Gurevych , Preslav Nakov

Despite rapid progress in claim verification, we lack a systematic understanding of what reasoning these benchmarks actually exercise. We generate structured reasoning traces for 24K claim-verification examples across 9 datasets using…

计算与语言 · 计算机科学 2026-04-03 Delip Rao , Chris Callison-Burch

Large language models (LLMs) are reshaping automated fact-checking (AFC) by enabling unified, end-to-end verification pipelines rather than isolated components. While large proprietary models achieve strong performance, their closed…

计算与语言 · 计算机科学 2026-01-19 Malin Astrid Larsson , Harald Fosen Grunnaleite , Vinay Setty

Large language models (LLMs) are known to hallucinate, producing natural language outputs that are not grounded in the input, reference materials, or real-world knowledge. In enterprise applications where AI features support business…

Assessing scientific claims requires identifying, extracting, and reasoning with multimodal data expressed in information-rich figures in scientific literature. Despite the large body of work in scientific QA, figure captioning, and other…

Online misinformation remains a critical challenge, and fact-checkers increasingly rely on claim matching systems that use sentence embedding models to retrieve relevant fact-checks. However, as users interact with claims online, they often…

计算与语言 · 计算机科学 2025-06-06 Jabez Magomere , Emanuele La Malfa , Manuel Tonneau , Ashkan Kazemi , Scott Hale