中文
相关论文

相关论文: FactLLaMA: Optimizing Instruction-Following Langua…

200 篇论文

Large language models (LLMs) often hallucinate, yet most existing fact-checking methods treat factuality evaluation as a binary classification problem, offering limited interpretability and failing to capture fine-grained error types. In…

计算与语言 · 计算机科学 2026-01-13 Yuzhuo Bai , Shuzheng Si , Kangyang Luo , Qingyi Wang , Wenhao Li , Gang Chen , Fanchao Qi , Maosong Sun

We introduce Inference-Time Intervention (ITI), a technique designed to enhance the "truthfulness" of large language models (LLMs). ITI operates by shifting model activations during inference, following a set of directions across a limited…

机器学习 · 计算机科学 2024-06-27 Kenneth Li , Oam Patel , Fernanda Viégas , Hanspeter Pfister , Martin Wattenberg

The advent of Large Language Models (LLMs) has significantly transformed the AI landscape, enhancing machine learning and AI capabilities. Factuality issue is a critical concern for LLMs, as they may generate factually incorrect responses.…

计算与语言 · 计算机科学 2024-04-02 Xiaoze Liu , Feijie Wu , Tianyang Xu , Zhuo Chen , Yichi Zhang , Xiaoqian Wang , Jing Gao

Large Language Models (LLMs) exhibit impressive results across a wide range of natural language processing (NLP) tasks, yet they can often produce factually incorrect outputs. This paper introduces a simple but effective low-latency…

计算与语言 · 计算机科学 2024-10-22 Changmao Li , Jeffrey Flanigan

Recent benchmarks have probed factual consistency and rhetorical robustness in Large Language Models (LLMs). However, a knowledge gap exists regarding how directional framing of factually true statements influences model agreement, a common…

计算与语言 · 计算机科学 2025-06-16 Jaeho Lee , Atharv Chowdhary

Large language models (LLMs) show strong reasoning abilities across diverse tasks, yet their performance on extended contexts remains inconsistent. While prior research has emphasized mid-context degradation in question answering, this…

计算与语言 · 计算机科学 2026-02-25 Pietro Bernardelle , Stefano Civelli , Kevin Roitero , Gianluca Demartini

Recent Language Models (LMs) have shown impressive capabilities in generating texts with the knowledge internalized in parameters. Yet, LMs often generate the factually incorrect responses to the given queries, since their knowledge may be…

计算与语言 · 计算机科学 2023-10-20 Jinheon Baek , Soyeong Jeong , Minki Kang , Jong C. Park , Sung Ju Hwang

Large Language Models (LLMs), with gradually improving reading comprehension and reasoning capabilities, are being applied to a range of complex language tasks, including the automatic generation of language data for various purposes.…

Pre-trained Language Models (PLMs) encode various facts about the world at their pre-training phase as they are trained to predict the next or missing word in a sentence. There has a been an interest in quantifying and improving the amount…

计算与语言 · 计算机科学 2024-10-18 Paul Youssef , Jörg Schlötterer , Christin Seifert

The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations. Rather than merely exploring the breadth of LLM abilities, we believe meticulous and thoughtful designs are essential to thorough,…

Despite recent concerns about undesirable behaviors generated by large language models (LLMs), including non-factual, biased, and hateful language, we find LLMs are inherent multi-task language checkers based on their latent representations…

In response to the growing problem of misinformation in the context of globalization and informatization, this paper proposes a classification method for fact-check-worthiness estimation based on prompt tuning. We construct a model for…

计算与语言 · 计算机科学 2025-04-28 Yinglong Yu , Hao Shen , Zhengyi Lyu , Qi He

Existing benchmarks for evaluating mathematical reasoning in large language models (LLMs) rely primarily on competition problems, formal proofs, or artificially challenging questions -- failing to capture the nature of mathematics…

人工智能 · 计算机科学 2025-10-21 Jie Zhang , Cezara Petrui , Kristina Nikolić , Florian Tramèr

Fact-checking techniques can mitigate hallucinations in Large Language Models (LLMs), a prominent issue in specialized domains. As parameter-efficient techniques such as Low-Rank Adaptation (LoRA) can overcome substantial computational…

计算与语言 · 计算机科学 2024-10-17 Hyeryun Park , Jeongwon Kwak , Dongsuk Jang , Sumin Park , Jinwook Choi

Despite showing increasingly human-like abilities, large language models (LLMs) often struggle with factual inaccuracies, i.e. "hallucinations", even when they hold relevant knowledge. To address these hallucinations, current approaches…

计算与语言 · 计算机科学 2024-06-12 Xiaoying Zhang , Baolin Peng , Ye Tian , Jingyan Zhou , Lifeng Jin , Linfeng Song , Haitao Mi , Helen Meng

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

计算与语言 · 计算机科学 2025-08-05 Yijun Feng

Large Language Models (LLMs) have demonstrated impressive performance in various NLP tasks, but they still suffer from challenges such as hallucination and weak numerical reasoning. To overcome these challenges, external tools can be used…

计算与语言 · 计算机科学 2023-06-26 Yuchen Zhuang , Yue Yu , Kuan Wang , Haotian Sun , Chao Zhang

Fake news and misinformation poses a significant threat to society, making efficient mitigation essential. However, manual fact-checking is costly and lacks scalability. Large Language Models (LLMs) offer promise in automating…

计算与语言 · 计算机科学 2025-06-09 Xiaofei Xu , Xiuzhen Zhang , Ke Deng

With the proliferation of Large Language Models (LLMs), the detection of misinformation has become increasingly important and complex. This research proposes an innovative verifiable misinformation detection LLM agent that goes beyond…

人工智能 · 计算机科学 2025-08-06 Zikun Cui , Tianyi Huang , Chia-En Chiang , Cuiqianhe Du

This paper investigates the factuality of large language models (LLMs) as knowledge bases in the legal domain, in a realistic usage scenario: we allow for acceptable variations in the answer, and let the model abstain from answering when…

计算与语言 · 计算机科学 2024-09-19 Rajaa El Hamdani , Thomas Bonald , Fragkiskos Malliaros , Nils Holzenberger , Fabian Suchanek