English
Related papers

Related papers: IAD-GPT: Advancing Visual Knowledge in Multimodal …

200 papers

Industrial anomaly detection (IAD) has garnered significant attention and experienced rapid development. However, the recent development of IAD approach has encountered certain difficulties due to dataset limitations. On the one hand, most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chengjie Wang , Wenbing Zhu , Bin-Bin Gao , Zhenye Gan , Jianning Zhang , Zhihao Gu , Shuguang Qian , Mingang Chen , Lizhuang Ma

The Multimodal Large Language Models (MLLMs) have activated the capabilitiesof Large Language Models (LLMs) in solving visual-language tasks by integratingvisual information. The prevailing approach in existing MLLMs involvesemploying an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Tianxiang Wu , Minxin Nie , Ziqiang Cao

Recently, Multimodal Large Language Models (MLLMs) have gained significant attention for their remarkable ability to process and analyze non-textual data, such as images, videos, and audio. Notably, several adaptations of general-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Wenhui Zhu , Xin Li , Xiwen Chen , Peijie Qiu , Vamsi Krishna Vasa , Xuanzhao Dong , Yanxi Chen , Natasha Lepore , Oana Dumitrascu , Yi Su , Yalin Wang

Multimodal Large Language Models (MLLMs), such as GPT4o, have shown strong capabilities in visual reasoning and explanation generation. However, despite these strengths, they face significant challenges in the increasingly critical task of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Fanrui Zhang , Jiawei Liu , Jiaying Zhu , Esther Sun , Dong Li , Qiang Zhang , Zheng-Jun Zha

Visual prompt-based methods have seen growing interest in incremental learning (IL) for image classification. These approaches learn additional embedding vectors while keeping the model frozen, making them efficient to train. However, no…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Matthias Neuwirth-Trapp , Maarten Bieshaar , Danda Pani Paudel , Luc Van Gool

Video anomaly detection (VAD) aims to identify and ground anomalous behaviors or events in videos, serving as a core technology in the fields of intelligent surveillance and public safety. With the advancement of deep learning, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shibo Gao , Peipei Yang , Haiyang Guo , Yangyang Liu , Yi Chen , Shuai Li , Han Zhu , Jian Xu , Xu-Yao Zhang , Linlin Huang

Although Multimodal Large Language Models (MLLMs) have demonstrated promising versatile capabilities, their performance is still inferior to specialized models on downstream tasks, which makes adaptation necessary to enhance their utility.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yichi Zhang , Yinpeng Dong , Siyuan Zhang , Tianzan Min , Hang Su , Jun Zhu

In AI-generated image detection, current cutting-edge methods typically adapt pre-trained foundation models through partial-parameter fine-tuning. However, these approaches often struggle to generalize to forgeries from unseen generators,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Yiheng Li , Zichang Tan , Guoqing Xu , Zhen Lei , Xu Zhou , Yang Yang

Industrial Anomaly Detection (IAD) is critical for quality control, but existing methods struggle with subtle, geometric defects. Standard 2D (RGB) images are sensitive to texture and lighting but often miss fine geometric anomalies. While…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Wenbing Zhu , Jianing Liang , Linjie Cheng , Yurui Pan , Zhuhao Chen , Qingwang Yan , Yudong Cheng , Jianghui Zhang , Mingmin Chi , Bo Peng

Few-shot anomaly detection (FSAD) methods identify anomalous regions with few known normal samples. Most existing methods rely on the generalization ability of pre-trained vision-language models (VLMs) to recognize potentially anomalous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yuanting Fan , Jun Liu , Xiaochen Chen , Bin-Bin Gao , Jian Li , Yong Liu , Jinlong Peng , Chengjie Wang

Text-based person anomaly retrieval has emerged as a challenging task, with most existing approaches relying on complex deep-learning techniques. This raises a research question: How can the model be optimized to achieve greater…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tien-Huy Nguyen , Huu-Loc Tran , Huu-Phong Phan-Nguyen , Quang-Vinh Dinh

Despite the significant progress in multimodal large language models (MLLMs), their high computational cost remains a barrier to real-world deployment. Inspired by the mixture of depths (MoDs) in natural language processing, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yaxin Luo , Gen Luo , Jiayi Ji , Yiyi Zhou , Xiaoshuai Sun , Zhiqiang Shen , Rongrong Ji

Additive manufacturing enables the fabrication of complex designs while minimizing waste, but faces challenges related to defects and process anomalies. This study presents a novel multimodal Retrieval-Augmented Generation-based framework…

Artificial Intelligence · Computer Science 2025-05-21 Kiarash Naghavi Khanghah , Zhiling Chen , Lela Romeo , Qian Yang , Rajiv Malhotra , Farhad Imani , Hongyi Xu

Video Anomaly Detection (VAD) is crucial for applications such as security surveillance and autonomous driving. However, existing VAD methods provide little rationale behind detection, hindering public trust in real-world deployments. In…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuchen Yang , Kwonjoon Lee , Behzad Dariush , Yinzhi Cao , Shao-Yuan Lo

In this paper, we introduce a Multimodal Large Language Model-based Generation Assistant (LLMGA), leveraging the vast reservoir of knowledge and proficiency in reasoning, comprehension, and response inherent in Large Language Models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bin Xia , Shiyin Wang , Yingfan Tao , Yitong Wang , Jiaya Jia

In the pursuit of efficient automated content creation, procedural generation, leveraging modifiable parameters and rule-based systems, emerges as a promising approach. Nonetheless, it could be a demanding endeavor, given its intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Chunyi Sun , Junlin Han , Weijian Deng , Xinlong Wang , Zishan Qin , Stephen Gould

Zero-shot anomaly detection (ZSAD) requires detection models trained using auxiliary data to detect anomalies without any training sample in a target dataset. It is a crucial task when training data is not accessible due to various…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Qihang Zhou , Guansong Pang , Yu Tian , Shibo He , Jiming Chen

Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impressive detection performance across various datasets. Nevertheless, they require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yi Zhang , Jiawen Zhu , Lele Fu , Guansong Pang

Unsupervised Continuous Anomaly Detection (UCAD) is gaining attention for effectively addressing the catastrophic forgetting and heavy computational burden issues in traditional Unsupervised Anomaly Detection (UAD). However, existing UCAD…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Mingle Zhou , Jiahui Liu , Jin Wan , Gang Li , Min Li

Software vulnerability detection is generally supported by automated static analysis tools, which have recently been reinforced by deep learning (DL) models. However, despite the superior performance of DL-based approaches over rule-based…

Software Engineering · Computer Science 2024-05-03 Yanjing Yang , Xin Zhou , Runfeng Mao , Jinwei Xu , Lanxin Yang , Yu Zhangm , Haifeng Shen , He Zhang