English
Related papers

Related papers: Can LLMs Improve Multimodal Fact-Checking by Askin…

200 papers

Large language models (LLMs) encode knowledge with varying degrees of confidence. When responding to queries, models face an inherent trade-off: they can generate responses that are less informative but highly factual, or more informative…

Computation and Language · Computer Science 2026-02-03 Ziwei Gong , Yanda Chen , Julia Hirschberg , Chen Zhao , He He , Zhou Yu , Kathleen Mckeown

Large language models have demonstrated significant potential as the next-generation information access engines. However, their reliability is hindered by issues of hallucination and generating non-factual content. This is particularly…

Computation and Language · Computer Science 2024-10-03 Chao-Wei Huang , Yun-Nung Chen

With the growing number of submitted scientific papers, there is an increasing demand for systems that can assist reviewers in evaluating research claims. Experimental results are a core component of scientific work, often presented in…

Computation and Language · Computer Science 2025-11-14 Xanh Ho , Yun-Ang Wu , Sunisth Kumar , Florian Boudin , Atsuhiro Takasu , Akiko Aizawa

The emergence of Large Language Models (LLMs) as chat assistants capable of generating human-like conversations has amplified the need for robust evaluation methods, particularly for open-ended tasks. Conventional metrics such as EM and F1,…

Computation and Language · Computer Science 2025-11-12 Sher Badshah , Hassan Sajjad

Factuality evaluation aims to detect factual errors produced by language models (LMs) and hence guide the development of more factual models. Towards this goal, we train a factuality evaluator, FenCE, that provides LM generators with…

Computation and Language · Computer Science 2025-06-03 Yiqing Xie , Wenxuan Zhou , Pradyot Prakash , Di Jin , Yuning Mao , Quintin Fettes , Arya Talebzadeh , Sinong Wang , Han Fang , Carolyn Rose , Daniel Fried , Hejia Zhang

Large Language Models (LLMs) are commonly used in Question Answering (QA) settings, increasingly in the natural sciences if not science at large. Reliable Uncertainty Quantification (UQ) is critical for the trustworthy uptake of generated…

Computation and Language · Computer Science 2026-02-03 Philip Müller , Nicholas Popovič , Michael Färber , Peter Steinbach

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

In this paper, we study how open-source large language models (LLMs) can be effectively deployed for improving query rewriting in conversational search, especially for ambiguous queries. We introduce CHIQ, a two-step method that leverages…

Information Retrieval · Computer Science 2024-09-27 Fengran Mo , Abbas Ghaddar , Kelong Mao , Mehdi Rezagholizadeh , Boxing Chen , Qun Liu , Jian-Yun Nie

Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language.…

Machine Learning · Computer Science 2023-05-10 Michael Kuchnik , Virginia Smith , George Amvrosiadis

Table-based Fact Verification (TFV) aims to extract the entailment relation between statements and structured tables. Existing TFV methods based on small-scaled models suffer from insufficient labeled data and weak zero-shot ability.…

Computation and Language · Computer Science 2024-11-14 Hanwen Zhang , Qingyi Si , Peng Fu , Zheng Lin , Weiping Wang

Large Language Models (LLMs) have become essential tools across various domains due to their impressive capabilities in understanding and generating human-like text. The ability to accurately answer multiple-choice questions (MCQs) holds…

Computation and Language · Computer Science 2025-01-06 Mohamed Hisham Abdellatif

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

Computation and Language · Computer Science 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

The advent of large language models (LLMs) has unlocked great opportunities in complex data management tasks, particularly in question answering (QA) over complicated multi-table relational data. Despite significant progress, systematically…

Artificial Intelligence · Computer Science 2024-12-02 Zipeng Qiu , You Peng , Guangxin He , Binhang Yuan , Chen Wang

Claim verification can be a challenging task. In this paper, we present a method to enhance the robustness and reasoning capabilities of automated claim verification through the extraction of short facts from evidence. Our novel approach,…

Computation and Language · Computer Science 2024-07-29 Nazanin Jafari , James Allan

The increasing multimodal disinformation, where deceptive claims are reinforced through coordinated text and visual content, poses significant challenges to automated fact-checking. Recent efforts leverage Large Language Models (LLMs) for…

Artificial Intelligence · Computer Science 2026-01-09 Haoran Ou , Gelei Deng , Xingshuo Han , Jie Zhang , Han Qiu , Shangwei Guo , Tianwei Zhang

Large language models (LLMs) often hallucinate, yet most existing fact-checking methods treat factuality evaluation as a binary classification problem, offering limited interpretability and failing to capture fine-grained error types. In…

Computation and Language · Computer Science 2026-01-13 Yuzhuo Bai , Shuzheng Si , Kangyang Luo , Qingyi Wang , Wenhao Li , Gang Chen , Fanchao Qi , Maosong Sun

We review discourses about the philosophy of science in qualitative research and evidence from cognitive linguistics in order to ground a framework for discussing the use of Large Language Models (LLMs) to support the qualitative analysis…

Human-Computer Interaction · Computer Science 2024-07-17 James Eschrich , Sarah Sterman

This paper investigates the logical reasoning capabilities of large language models (LLMs). For a precisely defined yet tractable formulation, we choose the conceptually simple but technically complex task of constructing proofs in Boolean…

Machine Learning · Computer Science 2025-04-30 Yuan Xia , Akanksha Atrey , Fadoua Khmaissia , Kedar S. Namjoshi

Large Language Models (LLMs) are increasingly used to answer everyday questions, yet their performance on culturally grounded and dialectal content remains uneven across languages. We propose a comprehensive method that (i) translates…

Computation and Language · Computer Science 2026-04-20 Hunzalah Hassan Bhatti , Firoj Alam

We introduce KoLasSimpleQA, the first benchmark evaluating the multilingual factual ability of Large Language Models (LLMs). Inspired by existing research, we created the question set with features such as single knowledge point coverage,…

Computation and Language · Computer Science 2025-05-23 Bowen Jiang , Runchuan Zhu , Jiang Wu , Zinco Jiang , Yifan He , Junyuan Gao , Jia Yu , Rui Min , Yinfan Wang , Haote Yang , Songyang Zhang , Dahua Lin , Lijun Wu , Conghui He