English
Related papers

Related papers: ForgerySleuth: Empowering Multimodal Large Languag…

200 papers

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

Computation and Language · Computer Science 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

With the continuous advancement of large language models (LLMs), it is essential to create new benchmarks to effectively evaluate their expanding capabilities and identify areas for improvement. This work focuses on multi-image reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mehran Kazemi , Nishanth Dikkala , Ankit Anand , Petar Devic , Ishita Dasgupta , Fangyu Liu , Bahare Fatemi , Pranjal Awasthi , Dee Guo , Sreenivas Gollapudi , Ahmed Qureshi

Despite achieving rapid developments and with widespread applications, Large Vision-Language Models (LVLMs) confront a serious challenge of being prone to generating hallucinations. An over-reliance on linguistic priors has been identified…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Lanyun Zhu , Deyi Ji , Tianrun Chen , Peng Xu , Jieping Ye , Jun Liu

Large-scale multilingual machine translation systems have demonstrated remarkable ability to translate directly between numerous languages, making them increasingly appealing for real-world applications. However, when deployed in the wild,…

Computation and Language · Computer Science 2023-03-29 Nuno M. Guerreiro , Duarte Alves , Jonas Waldendorf , Barry Haddow , Alexandra Birch , Pierre Colombo , André F. T. Martins

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Large Language Models (LLMs) demonstrate remarkable capabilities in text understanding and generation. However, their tendency to produce factually inconsistent outputs, commonly referred to as ''hallucinations'', remains a critical…

Computation and Language · Computer Science 2026-01-13 Dingwei Chen , Ziqiang Liu , Feiteng Fang , Chak Tou Leong , Shiwen Ni , Ahmadreza Argha , Hamid Alinejad-Rokny , Min Yang , Chengming Li

Multimodal language models can exhibit hallucinations in their outputs, which limits their reliability. The ability to automatically detect these errors is important for mitigating them, but has been less explored and existing efforts do…

Computation and Language · Computer Science 2024-09-04 Spencer Whitehead , Jacob Phillips , Sean Hendryx

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

Ensuring the robustness of deep learning models requires comprehensive and diverse testing. Existing approaches, often based on simple data augmentation techniques or generative adversarial networks, are limited in producing realistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luciano Baresi , Davide Yi Xian Hu , Muhammad Irfan Mas'udi , Giovanni Quattrocchi

This paper presents DreamLLM, a learning framework that first achieves versatile Multimodal Large Language Models (MLLMs) empowered with frequently overlooked synergy between multimodal comprehension and creation. DreamLLM operates on two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runpei Dong , Chunrui Han , Yuang Peng , Zekun Qi , Zheng Ge , Jinrong Yang , Liang Zhao , Jianjian Sun , Hongyu Zhou , Haoran Wei , Xiangwen Kong , Xiangyu Zhang , Kaisheng Ma , Li Yi

Recent advancements in Multimodal Large Language Models (MLLMs) have greatly improved their abilities in image understanding. However, these models often struggle with grasping pixel-level semantic details, e.g., the keypoints of an object.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Ruimao Zhang

Is automated hallucination detection possible? In this work, we introduce a theoretical framework to analyze the feasibility of automatically detecting hallucinations produced by large language models (LLMs). Inspired by the classical…

Machine Learning · Computer Science 2025-06-03 Amin Karbasi , Omar Montasser , John Sous , Grigoris Velegkas

Multimodal Large Language Models (MLLMs) represent the cutting edge of AI technology, with DeepSeek models emerging as a leading open-source alternative offering competitive performance to closed-source systems. While these models…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Chashi Mahiul Islam , Samuel Jacob Chacko , Preston Horne , Xiuwen Liu

Multimodal deepfake detection (MDD) aims to uncover manipulations across visual, textual, and auditory modalities, thereby reinforcing the reliability of modern information systems. Although large vision-language models (LVLMs) exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yuxin Liu , Fei Wang , Kun Li , Yiqi Nie , Junjie Chen , Yanyan Wei , Zhangling Duan , Zhaohong Jia

Retouching is an essential task in post-manipulation of raw photographs. Generative editing, guided by text or strokes, provides a new tool accessible to users but can easily change the identity of the original objects in unacceptable and…

Graphics · Computer Science 2025-05-12 Niladri Shekhar Dutt , Duygu Ceylan , Niloy J. Mitra

Large Language Models (LLMs) and Large Multimodal Models (LMMs) demonstrate impressive problem-solving skills in many tasks and domains. However, their ability to reason with complex images in academic domains has not been systematically…

Multimedia · Computer Science 2025-10-01 Chenghao Ma , Haihong E. , Junpeng Ding , Jun Zhang , Ziyan Ma , Huang Qing , Bofei Gao , Liang Chen , Yifan Zhu , Meina Song

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu