English
Related papers

Related papers: From Single to Multi: How LLMs Hallucinate in Mult…

200 papers

Recent methodologies utilizing synthetic datasets have aimed to address inconsistent hallucinations in large language models (LLMs); however,these approaches are primarily tailored to specific tasks, limiting their generalizability.…

Artificial Intelligence · Computer Science 2025-02-28 Xinxin You , Xien Liu , Qixin Sun , Huan Zhang , Kaiyin Zhou , Shaohui Liu , GuoPing Hu , ShiJin Wang , Si Liu , Ji Wu

Large language models (LLMs) are prone to three types of hallucination: Input-Conflicting, Context-Conflicting and Fact-Conflicting hallucinations. The purpose of this study is to mitigate the different types of hallucination by exploiting…

Artificial Intelligence · Computer Science 2025-06-17 Ao Jia , Haiming Wu , Guohui Yao , Dawei Song , Songkun Ji , Yazhou Zhang

A common use of NLP is to facilitate the understanding of large document collections, with a shift from using traditional topic models to Large Language Models. Yet the effectiveness of using LLM for large corpus understanding in real-world…

Computation and Language · Computer Science 2025-06-05 Zongxia Li , Lorena Calvo-Bartolomé , Alexander Hoyle , Paiheng Xu , Alden Dima , Juan Francisco Fung , Jordan Boyd-Graber

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

Computation and Language · Computer Science 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

This study explores the sycophantic tendencies of Large Language Models (LLMs), where these models tend to provide answers that match what users want to hear, even if they are not entirely correct. The motivation behind this exploration…

Computation and Language · Computer Science 2024-08-27 Aswin RRV , Nemika Tyagi , Md Nayem Uddin , Neeraj Varshney , Chitta Baral

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Large Language Models (LLMs) have shown capabilities close to human performance in various analytical tasks, leading researchers to use them for time and labor-intensive analyses. However, their capability to handle highly specialized and…

Computation and Language · Computer Science 2024-10-08 Alexander S. Choi , Syeda Sabrina Akter , JP Singh , Antonios Anastasopoulos

The utility of Large Language Models (LLMs) in analytical tasks is rooted in their vast pre-trained knowledge, which allows them to interpret ambiguous inputs and infer missing information. However, this same capability introduces a…

Artificial Intelligence · Computer Science 2026-04-21 Humam Kourani , Anton Antonov , Alessandro Berti , Wil M. P. van der Aalst

Large vision-language models (LVLMs) have demonstrated remarkable multimodal comprehension and reasoning capabilities, but they still suffer from severe object hallucination. Previous studies primarily attribute the flaw to linguistic prior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Haohan Zheng , Zhenguo Zhang

Large language models (LLMs) possess extensive world knowledge, including geospatial knowledge, which has been successfully applied to various geospatial tasks such as mobility prediction and social indicator prediction. However, LLMs often…

Computation and Language · Computer Science 2025-07-29 Shengyuan Wang , Jie Feng , Tianhui Liu , Dan Pei , Yong Li

We investigate a critical yet under-explored question in Large Vision-Language Models (LVLMs): Do LVLMs genuinely comprehend interleaved image-text in the document? Existing document understanding benchmarks often assess LVLMs using…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Haolong Yan , Kaijun Tan , Yeqing Shen , Xin Huang , Zheng Ge , Xiangyu Zhang , Si Li , Daxin Jiang

It is well known that the standard likelihood training and approximate decoding objectives in neural text generation models lead to less human-like responses for open-ended tasks such as language modeling and story generation. In this paper…

Computation and Language · Computer Science 2020-05-05 Joshua Maynez , Shashi Narayan , Bernd Bohnet , Ryan McDonald

The use of Large Language Models (LLMs) has drawn growing interest within the scientific community. LLMs can handle large volumes of textual data and support methods for evidence synthesis. Although recent studies highlight the potential of…

Software Engineering · Computer Science 2026-02-12 Cauã Ferreira Barros , Marcos Kalinowski , Mohamad Kassab , Valdemar Vicente Graciano Neto

Meeting summarization has become a critical task since digital encounters have become a common practice. Large language models (LLMs) show great potential in summarization, offering enhanced coherence and context understanding compared to…

Computation and Language · Computer Science 2025-02-19 Frederic Kirstein , Terry Ruas , Bela Gipp

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

The proliferation of complex structured data in hybrid sources, such as PDF documents and web pages, presents unique challenges for current Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) in providing accurate…

Information Retrieval · Computer Science 2025-08-22 Shivani Upadhyay , Messiah Ataey , Syed Shariyar Murtaza , Yifan Nie , Jimmy Lin

Recent advances in large language models (LLMs) have led to new summarization strategies, offering an extensive toolkit for extracting important information. However, these approaches are frequently limited by their reliance on isolated…

Artificial Intelligence · Computer Science 2024-06-21 Pranav Janjani , Mayank Palan , Sarvesh Shirude , Ninad Shegokar , Sunny Kumar , Faruk Kazi

Large Language Models (LLMs) are now state-of-the-art at summarization, yet the internal notion of importance that drives their information selections remains hidden. We propose to investigate this by combining behavioral and computational…

Computation and Language · Computer Science 2026-02-03 Yongxin Zhou , Changshun Wu , Philippe Mulhem , Didier Schwab , Maxime Peyrard

State-of-the-art language models (LMs) are notoriously susceptible to generating hallucinated information. Such inaccurate outputs not only undermine the reliability of these models but also limit their use and raise serious concerns about…

Computation and Language · Computer Science 2024-03-21 Ayush Agrawal , Mirac Suzgun , Lester Mackey , Adam Tauman Kalai