中文
相关论文

相关论文: Truth Forest: Toward Multi-Scale Truthfulness in L…

200 篇论文

The propensity of Large Language Models (LLMs) to generate hallucinations and non-factual content undermines their reliability in high-stakes domains, where rigorous control over Type I errors (the conditional probability of incorrectly…

计算与语言 · 计算机科学 2024-11-08 Fan Nie , Xiaotian Hou , Shuhang Lin , James Zou , Huaxiu Yao , Linjun Zhang

While large language models (LLMs) have demonstrated strong performance on factoid question answering, they are still prone to hallucination and untruthful responses, particularly when tasks demand information outside their parametric…

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

计算与语言 · 计算机科学 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Neural network pruning has emerged as a promising approach for deploying LLMs in low-resource scenarios while preserving downstream task performance. However, for the first time, we reveal that such pruning disrupts LLMs' internal…

机器学习 · 计算机科学 2025-09-04 Yao Fu , Runchao Li , Xianxuan Long , Haotian Yu , Xiaotian Han , Yu Yin , Pan Li

While large language models (LLMs) have demonstrated remarkable abilities across various fields, hallucination remains a significant challenge. Recent studies have explored hallucinations through the lens of internal representations,…

计算与语言 · 计算机科学 2024-12-30 Junteng Liu , Shiqi Chen , Yu Cheng , Junxian He

Large language models (LLMs) are trained on extensive datasets that encapsulate substantial world knowledge. However, their outputs often include confidently stated inaccuracies. Earlier works suggest that LLMs encode truthfulness as a…

计算与语言 · 计算机科学 2025-06-03 Yuntai Bao , Xuhong Zhang , Tianyu Du , Xinkui Zhao , Zhengwen Feng , Hao Peng , Jianwei Yin

Large Language Models (LLMs) often produce fluent yet factually incorrect statements-a phenomenon known as hallucination-posing serious risks in high-stakes domains. We present Layer-wise Semantic Dynamics (LSD), a geometric framework for…

计算与语言 · 计算机科学 2025-10-07 Amir Hameed Mir

Despite advancements in large language models (LLMs), non-factual responses still persist in fact-seeking question answering. Unlike extensive studies on post-hoc detection of these responses, this work studies non-factuality prediction…

计算与语言 · 计算机科学 2025-08-19 Yanling Wang , Haoyang Li , Hao Zou , Jing Zhang , Xinlei He , Qi Li , Ke Xu

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the…

计算与语言 · 计算机科学 2025-06-02 Giovanni Servedio , Alessandro De Bellis , Dario Di Palma , Vito Walter Anelli , Tommaso Di Noia

Generative Large Language Models (LLMs)inevitably produce untruthful responses. Accurately predicting the truthfulness of these outputs is critical, especially in high-stakes settings. To accelerate research in this domain and make…

Large Language Models (LLMs) have revolutionized various domains with extensive knowledge and creative capabilities. However, a critical issue with LLMs is their tendency to produce outputs that diverge from factual reality. This phenomenon…

计算与语言 · 计算机科学 2024-07-19 Jinwen He , Yujia Gong , Kai Chen , Zijin Lin , Chengan Wei , Yue Zhao

Despite their impressive capabilities, large language models (LLMs) are prone to hallucinations, i.e., generating content that deviates from facts seen during pretraining. We propose a simple decoding strategy for reducing hallucinations…

计算与语言 · 计算机科学 2024-03-12 Yung-Sung Chuang , Yujia Xie , Hongyin Luo , Yoon Kim , James Glass , Pengcheng He

Large Language Models (LLMs) offer a promising alternative to traditional survey methods, potentially enhancing efficiency and reducing costs. In this study, we use LLMs to create virtual populations that answer survey questions, enabling…

人机交互 · 计算机科学 2025-03-24 Enzo Sinacola , Arnault Pachot , Thierry Petit

The development of Large Language Models (LLMs) has notably transformed numerous sectors, offering impressive text generation capabilities. Yet, the reliability and truthfulness of these models remain pressing concerns. To this end, we…

计算与语言 · 计算机科学 2024-02-12 Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements:…

计算与语言 · 计算机科学 2024-03-18 Guanghua Li , Wensheng Lu , Wei Zhang , Defu Lian , Kezhong Lu , Rui Mao , Kai Shu , Hao Liao

As content generated by Large Language Model (LLM) has grown exponentially, the ability to accurately identify and fingerprint such text has become increasingly crucial. In this work, we introduce a novel black-box approach for…

密码学与安全 · 计算机科学 2024-08-07 Dmitri Iourovitski , Sanat Sharma , Rakshak Talwar

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

计算与语言 · 计算机科学 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Large language models (LLMs) offer unprecedented opportunities for analyzing social phenomena at scale. This paper demonstrates the value of LLMs in psychological measurement by (1) compiling the first large-scale dataset of election rumors…

人工智能 · 计算机科学 2026-01-09 Etienne Casanova , R. Michael Alvarez

We study how to characterize and predict the truthfulness of texts generated from large language models (LLMs), which serves as a crucial step in building trust between humans and LLMs. Although several approaches based on entropy or…

计算与语言 · 计算机科学 2024-02-29 Fan Yin , Jayanth Srinivasa , Kai-Wei Chang