English
Related papers

Related papers: Enhancing LLM's Ability to Generate More Repositor…

200 papers

Large Vision-Language Models (LVLMs) usually generate texts which satisfy context coherence but don't match the visual input. Such a hallucination issue hinders LVLMs' applicability in the real world. The key to solving hallucination in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Nanxing Hu , Xiaoyue Duan , Jinchao Zhang , Guoliang Kang

Retrieval Augmented Generation (RAG) systems have emerged as a powerful method for enhancing large language models (LLMs) with up-to-date information. However, the retrieval step in RAG can sometimes surface documents containing…

Computation and Language · Computer Science 2025-04-02 Vignesh Gokul , Srikanth Tenneti , Alwarappan Nakkiran

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

To address hallucination issues in large language models (LLMs), this paper proposes a method for mitigating prompt-induced hallucinations. Building on a knowledge distillation chain-style model, we introduce a code module to guide…

Computation and Language · Computer Science 2026-01-07 Jinbo Hao , Kai Yang , Qingzhen Su , Yang Chen , Yifan Li , Chao Jiang

Existing navigation decision support systems often perform poorly when handling non-predefined navigation scenarios. Leveraging the generalization capabilities of large language model (LLM) in handling unknown scenarios, this research…

Artificial Intelligence · Computer Science 2025-02-25 Feng Ma , Xiu-min Wang , Chen Chen , Xiao-bin Xu , Xin-ping Yan

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

Machine Learning · Computer Science 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Large language models (LLMs) achieve strong performance across many tasks but remain vulnerable to hallucinations, motivating the need for realistic adversarial prompts that elicit such failures. We formulate hallucination elicitation as a…

Computation and Language · Computer Science 2026-05-14 Buyun Liang , Jinqi Luo , Liangzu Peng , Kwan Ho Ryan Chan , Darshan Thaker , Kaleab A. Kinfu , Fengrui Tian , Hamed Hassani , René Vidal

Large Language Models (LLMs) are revolutionizing software engineering (SE), with special emphasis on code generation and analysis. However, their applications to broader SE practices including conceptualization, design, and other non-code…

Software Engineering · Computer Science 2025-06-16 Fabian C. Peña

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

Computation and Language · Computer Science 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

Reference resolution is an important problem, one that is essential to understand and successfully handle context of different kinds. This context includes both previous turns and context that pertains to non-conversational entities, such…

Computation and Language · Computer Science 2024-08-20 Joel Ruben Antony Moniz , Soundarya Krishnan , Melis Ozyildirim , Prathamesh Saraf , Halim Cagri Ates , Yuan Zhang , Hong Yu

Large Language Models (LLMs) have exhibited remarkable proficiency in natural language understanding, prompting extensive exploration of their potential applications across diverse domains. In the medical domain, open-source LLMs have…

Computation and Language · Computer Science 2024-08-01 Cui Long , Yongbin Liu , Chunping Ouyang , Ying Yu

Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection. To overcome this issue, we propose a novel framework that leverages a small language…

Computation and Language · Computer Science 2024-08-26 Mengya Hu , Rui Xu , Deren Lei , Yaxi Li , Mingyu Wang , Emily Ching , Eslam Kamal , Alex Deng

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

Computation and Language · Computer Science 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

Computation and Language · Computer Science 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks. However, repository-level code generation presents unique challenges, particularly due to the need to utilize information spread across…

Software Engineering · Computer Science 2025-11-24 Zhiyuan Pan , Xing Hu , Xin Xia , Xiaohu Yang

Large Language Models (LLMs) have shown promising potentials in program generation and no-code automation. However, LLMs are prone to generate hallucinations, i.e., they generate text which sounds plausible but is incorrect. Although there…

Software Engineering · Computer Science 2025-07-10 Vibhor Agarwal , Yulong Pei , Salwa Alamir , Xiaomo Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities across a variety of tasks in different domains. However, they sometimes generate responses that are logically coherent but factually incorrect or misleading, which is…

Computation and Language · Computer Science 2025-05-23 Fujie Zhang , Peiqi Yu , Biao Yi , Baolei Zhang , Tong Li , Zheli Liu

Retrieval-augmented generation (RAG) techniques have emerged as a promising solution to enhance the reliability of large language models (LLMs) by addressing issues like hallucinations, outdated knowledge, and domain adaptation. In…

Computation and Language · Computer Science 2025-01-28 Weihang Su , Yichen Tang , Qingyao Ai , Junxi Yan , Changyue Wang , Hongning Wang , Ziyi Ye , Yujia Zhou , Yiqun Liu