English
Related papers

Related papers: LLMAuditor: A Framework for Auditing Large Languag…

200 papers

We propose an auditing method to identify whether a large language model (LLM) encodes patterns such as hallucinations in its internal states, which may propagate to downstream tasks. We introduce a weakly supervised auditing technique…

Machine Learning · Computer Science 2023-12-06 Miriam Rateike , Celia Cintas , John Wamburu , Tanya Akumu , Skyler Speakman

Large language models (LLMs) are widely used as scalable evaluators of model responses in lieu of human annotators. However, imperfect sensitivity and specificity of the LLM judges induce bias in naive evaluation scores. We propose a simple…

Machine Learning · Computer Science 2026-02-10 Chungpa Lee , Thomas Zeng , Jongwon Jeong , Jy-yong Sohn , Kangwook Lee

Inventory management remains a challenge for many small and medium-sized businesses that lack the expertise to deploy advanced optimization methods. This paper investigates whether Large Language Models (LLMs) can help bridge this gap. We…

Artificial Intelligence · Computer Science 2026-01-05 Yaqi Duan , Yichun Hu , Jiashuo Jiang

Large Language Models (LLMs) are widely used in critical fields such as healthcare, education, and finance due to their remarkable proficiency in various language-related tasks. However, LLMs are prone to generating factually incorrect…

Computation and Language · Computer Science 2023-11-27 Muneeswaran I , Shreya Saxena , Siva Prasad , M V Sai Prakash , Advaith Shankar , Varun V , Vishal Vaddina , Saisubramaniam Gopalakrishnan

Hallucination, or the generation of incorrect or fabricated information, remains a critical challenge in large language models (LLMs), particularly in high-stake domains such as legal question answering (QA). In order to mitigate the…

Computation and Language · Computer Science 2025-01-14 Yinghao Hu , Leilei Gan , Wenyi Xiao , Kun Kuang , Fei Wu

Large language models (LLMs) are increasingly used as alternatives to traditional search engines given their capacity to generate text that resembles human language. However, this shift is concerning, as LLMs often generate hallucinations,…

Computation and Language · Computer Science 2024-10-25 Cléa Chataigner , Afaf Taïk , Golnoosh Farnadi

Inspired by the superior language abilities of large language models (LLM), large vision-language models (LVLM) have been recently explored by integrating powerful LLMs for improving the performance on complex multimodal tasks. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Yifan Li , Yifan Du , Kun Zhou , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

Large Language Models (LLMs) demonstrate impressive capabilities in natural language processing but suffer from inaccuracies and logical inconsistencies known as hallucinations. This compromises their reliability, especially in domains…

Artificial Intelligence · Computer Science 2025-12-08 Ruslan Idelfonso Magana Vsevolodovna , Marco Monti

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

Computation and Language · Computer Science 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy…

Artificial Intelligence · Computer Science 2025-01-17 Huandong Wang , Wenjie Fu , Yingzhou Tang , Zhilong Chen , Yuxi Huang , Jinghua Piao , Chen Gao , Fengli Xu , Tao Jiang , Yong Li

The advent of large language models (LLMs) has facilitated the development of natural language text generation. It also poses unprecedented challenges, with content hallucination emerging as a significant concern. Existing solutions often…

Computation and Language · Computer Science 2024-06-06 Xiaoxi Sun , Jinpeng Li , Yan Zhong , Dongyan Zhao , Rui Yan

Recent advancements in large audio-language models (LALMs) have shown impressive capabilities in understanding and reasoning about audio and speech information. However, these models still face challenges, including hallucinating…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Chun-Yi Kuan , Hung-yi Lee

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

Human-Computer Interaction · Computer Science 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

Large Language Models (LLMs) are widely used to generate plausible text on online platforms, without revealing the generation process. As users increasingly encounter such black-box outputs, detecting hallucinations has become a critical…

Computation and Language · Computer Science 2026-04-08 Joosung Lee , Cheonbok Park , Hwiyeol Jo , Jeonghoon Kim , Joonsuk Park , Kang Min Yoo

Large language models (LLMs) are increasingly used to translate natural-language optimization problems into mathematical formulations and solver code, but matching the reference objective value is not a reliable test of correctness: an…

Artificial Intelligence · Computer Science 2026-05-13 Zhong Li , Zihan Guo , Xiaohan Lu , Juntao Wang , Jie Song , Chao Shen , Jiageng Wu , Mingyang Sun

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

The usage of Large Language Models (LLMs) for software and test development has continued to increase since LLMs were first introduced, but only recently have the expectations of LLMs become more realistic. Verifying the correctness of code…

Software Engineering · Computer Science 2025-08-20 Zachariah Sollenberger , Rahul Patel , Saieda Ali Zada , Sunita Chandrasekaran

Large language models (LLMs) have emerged as a potential solution to automate the complex processes involved in writing literature reviews, such as literature collection, organization, and summarization. However, it is yet unclear how good…

Computation and Language · Computer Science 2025-08-22 Xuemei Tang , Xufeng Duan , Zhenguang G. Cai

Large audio-language models (LALMs) enhance traditional large language models by integrating audio perception capabilities, allowing them to tackle audio-related tasks. Previous research has primarily focused on assessing the performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee