English
Related papers

Related papers: Generating Effective CoT Traces for Mitigating Cau…

200 papers

While many capabilities of language models (LMs) improve with increased training budget, the influence of scale on hallucinations is not yet fully understood. Hallucinations come in many forms, and there is no universally accepted…

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao

Despite achieving outstanding performance on various cross-modal tasks, current large vision-language models (LVLMs) still suffer from hallucination issues, manifesting as inconsistencies between their generated responses and the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Rui Hu , Yahan Tu , Shuyu Wei , Dongyuan Lu , Jitao Sang

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Difficult decision-making problems abound in various disciplines and domains. The proliferation of generative techniques, especially large language models (LLMs), has excited interest in using them for decision support. However, LLMs cannot…

Artificial Intelligence · Computer Science 2025-09-16 Boris Kovalerchuk , Brent D. Fegley

The prevalent use of large language models (LLMs) in various domains has drawn attention to the issue of "hallucination," which refers to instances where LLMs generate factually inaccurate or ungrounded information. Existing techniques for…

Computation and Language · Computer Science 2023-10-10 Junyu Luo , Cao Xiao , Fenglong Ma

Large language models (LLMs) are increasingly being applied to clinical care, a domain where both accuracy and transparent reasoning are critical for safe and trustworthy deployment. Chain-of-thought (CoT) prompting, which elicits…

Computation and Language · Computer Science 2025-12-09 Jiageng Wu , Kevin Xie , Bowen Gu , Nils Krüger , Kueiyu Joshua Lin , Jie Yang

Chain of thought (CoT) has proven useful for problems requiring complex reasoning. Many of these problems are both textual and multimodal. Given the inputs in different modalities, a model generates a rationale and then uses it to answer a…

Computation and Language · Computer Science 2024-05-17 Guangmin Zheng , Jin Wang , Xiaobing Zhou , Xuejie Zhang

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Chain-of-Thought (CoT) prompting has been shown to enhance the multi-step reasoning capabilities of Large Language Models (LLMs). However, debates persist about whether LLMs exhibit abstract generalization or rely on shallow heuristics when…

Computation and Language · Computer Science 2024-10-07 Akshara Prabhakar , Thomas L. Griffiths , R. Thomas McCoy

Large Language models (LLMs) show extraordinary abilities, but they are still prone to hallucinations, especially when we use them for generating Academic content. We have investigated four popular LLMs, ChatGPT, Grok, Gemini, and Copilot…

Computation and Language · Computer Science 2026-05-07 Humam Khan , Md Tabrez Nafis , Shahab Saquib Sohail , Aqeel Khalique , Rehan Hasan Khan

Despite their powerful chat, coding, and reasoning abilities, Large Language Models (LLMs) frequently hallucinate. Conventional wisdom suggests that hallucinations are a consequence of a balance between creativity and factuality, which can…

Long chain-of-thought (CoT) prompting helps Large Language Models (LLMs) solve difficult problems, but very long traces often slow or even degrade performance on fast, intuitive "System-1" tasks. We introduce Connector-Aware Compact CoT…

Artificial Intelligence · Computer Science 2025-09-16 Sunguk Choi , Yonghoon Kwon , Heondeuk Lee

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

Computation and Language · Computer Science 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß

Chain-of-thought (CoT) prompting enables large language models (LLMs) to solve complex reasoning tasks by generating an explanation before the final prediction. Despite it's promising ability, a critical downside of CoT prompting is that…

Computation and Language · Computer Science 2023-03-08 Seungone Kim , Se June Joo , Yul Jang , Hyungjoo Chae , Jinyoung Yeo

Large reasoning models (LRMs) spend substantial test-time compute on long chain-of-thought (CoT) traces, but what *characterizes* an effective CoT remains unclear. While prior work reports gains from lengthening CoTs and increasing review…

Machine Learning · Computer Science 2025-09-24 Yunzhen Feng , Julia Kempe , Cheng Zhang , Parag Jain , Anthony Hartshorn

Multimodal Large Language Models (MLLMs) have emerged as a central focus in both industry and academia, but often suffer from biases introduced by visual and language priors, which can lead to multimodal hallucination. These biases arise…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Guanyu Zhou , Yibo Yan , Xin Zou , Kun Wang , Aiwei Liu , Xuming Hu

Recent advances in large language models (LLMs), such as ChatGPT, have led to highly sophisticated conversation agents. However, these models suffer from "hallucinations," where the model generates false or fabricated information.…

Computation and Language · Computer Science 2023-06-12 Philip Feldman , James R. Foulds , Shimei Pan