English
Related papers

Related papers: ForgeryGPT: A Multimodal LLM for Interpretable Ima…

200 papers

While diffusion models excel at generating high-quality images, they often struggle with accurate counting, attributes, and spatial relationships in complex multi-object scenes. One potential solution involves employing Multimodal Large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiayang Sun , Hongbo Wang , Jie Cao , Huaibo Huang , Ran He

Large language models (LLMs) have garnered significant attention for their remarkable capabilities across various domains, whose vast parameter scales present challenges for practical deployment. Structured pruning is an effective method to…

Artificial Intelligence · Computer Science 2024-12-25 Gui Ling , Ziyang Wang , Yuliang Yan , Qingwen Liu

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun

Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities across a wide range of vision-language tasks. However, due to the restricted input resolutions, MLLMs face significant challenges in precisely understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lu Zhang , Jiazuo Yu , Haomiao Xiong , Ping Hu , Yunzhi Zhuge , Huchuan Lu , You He

Fine-grained detection and localization of localized image edits is crucial for assessing content authenticity, especially as modern diffusion models and image editors can produce highly realistic manipulations. However, this problem faces…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhen Sun , Ziyi Zhang , Zeren Luo , Zhiyuan Zhong , Zeyang Sha , Tianshuo Cong , Zheng Li , Shiwen Cui , Weiqiang Wang , Jiaheng Wei , Xinlei He , Qi Li , Qian Wang

Large language models (LLMs) have undergone significant expansion and have been increasingly integrated across various domains. Notably, in the realm of robot task planning, LLMs harness their advanced reasoning and language comprehension…

Large language models(LLMS)have shown excellent text generation capabilities, capable of generating fluent human-like responses for many downstream tasks. However, applying large language models to real-world critical tasks remains…

Computation and Language · Computer Science 2023-07-21 Le Xiao , Xin Shan

Large Visual Language Models (LVLMs) integrate visual and linguistic modalities, exhibiting exceptional performance across various multimodal tasks. Nevertheless, LVLMs remain vulnerable to the issue of object hallucinations. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Chao Wang , Xuancheng Zhou , Weiwei Fu , Yang Zhou

In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The…

Computation and Language · Computer Science 2023-12-22 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Anurag Maravi , Marcin Abram

Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive ability to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Hang Hua , Jing Shi , Kushal Kafle , Simon Jenni , Daoan Zhang , John Collomosse , Scott Cohen , Jiebo Luo

Large Language Models (LLMs), such as ChatGPT, LLaMA, GLM, and PaLM, have exhibited remarkable performances across various tasks in recent years. However, LLMs face two main challenges in real-world applications. One challenge is that…

Machine Learning · Computer Science 2023-10-17 Tao Fan , Yan Kang , Guoqiang Ma , Weijing Chen , Wenbin Wei , Lixin Fan , Qiang Yang

Multi-modal large language models (MLLMs) have achieved remarkable success in fine-grained visual understanding across a range of tasks. However, they often encounter significant challenges due to inadequate alignment for fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Wei Wang , Zhaowei Li , Qi Xu , Linfeng Li , YiQing Cai , Botian Jiang , Hang Song , Xingcan Hu , Pengyu Wang , Li Xiao

The rapid development of Multimodal Large Language Models (MLLMs) has enabled the integration of multiple modalities, including texts and images, within the large language model (LLM) framework. However, texts and images are usually…

Artificial Intelligence · Computer Science 2025-03-11 Yi Fang , Bowen Jin , Jiacheng Shen , Sirui Ding , Qiaoyu Tan , Jiawei Han

Large Language Models (LLMs) excel in fluency but risk producing inaccurate content, called "hallucinations." This paper outlines a standardized process for categorizing fine-grained hallucination types and proposes an innovative…

Computation and Language · Computer Science 2024-07-02 Kunquan Deng , Zeyu Huang , Chen Li , Chenghua Lin , Min Gao , Wenge Rong

Large language models (LLMs) have achieved state-of-the-art performance in various language processing tasks, motivating their adoption in simultaneous translation. Current fine-tuning methods to adapt LLMs for simultaneous translation…

Computation and Language · Computer Science 2024-10-10 Matthew Raffel , Victor Agostinelli , Lizhong Chen

Large language models (LLMs), such as ChatGPT, have demonstrated impressive capabilities in various tasks and attracted an increasing interest as a natural language interface across many domains. Recently, large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhihao Chen , Bin Hu , Chuang Niu , Tao Chen , Yuxin Li , Hongming Shan , Ge Wang

With the rapid development of facial forgery techniques, forgery detection has attracted more and more attention due to security concerns. Existing approaches attempt to use frequency information to mine subtle artifacts under high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Qiqi Gu , Shen Chen , Taiping Yao , Yang Chen , Shouhong Ding , Ran Yi

Previous learning-based vulnerability detection methods relied on either medium-sized pre-trained models or smaller neural networks from scratch. Recent advancements in Large Pre-Trained Language Models (LLMs) have showcased remarkable…

Software Engineering · Computer Science 2024-01-30 Xin Zhou , Ting Zhang , David Lo

Constructing dataset for fashion style recognition is challenging due to the inherent subjectivity and ambiguity of style concepts. Recent advances in text-to-image models have facilitated generative data augmentation by synthesizing images…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuki Hirakawa , Ryotaro Shimizu

Modern large language models become multimodal, analyzing various data formats like text and images. While fine-tuning is effective for adapting these multimodal language models (MLMs) to downstream tasks, full fine-tuning is…

Computation and Language · Computer Science 2025-12-01 Alexander Sergeev , Evgeny Kotelnikov