中文
相关论文

相关论文: IAD-GPT: Advancing Visual Knowledge in Multimodal …

200 篇论文

Although vision models such as Contrastive Language-Image Pre-Training (CLIP) show impressive generalization performance, their zero-shot robustness is still limited under Out-of-Distribution (OOD) scenarios without fine-tuning. Instead of…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Zhuo Huang , Chang Liu , Yinpeng Dong , Hang Su , Shibao Zheng , Tongliang Liu

This paper explores the potential of Large Language Models(LLMs) in zero-shot anomaly detection for safe visual navigation. With the assistance of the state-of-the-art real-time open-world object detection model Yolo-World and specialized…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Hao Wang , Jiayou Qin , Ashish Bastola , Xiwen Chen , John Suchanek , Zihao Gong , Abolfazl Razi

Logical anomaly detection in industrial inspection remains challenging due to variations in visual appearance (e.g., background clutter, illumination shift, and blur), which often distract vision-centric detectors from identifying…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Hiroto Nakata , Yawen Zou , Shunsuke Sakai , Shun Maeda , Chunzhi Gu , Yijin Wei , Shangce Gao , Chao Zhang

Recent advancements in reasoning capability of Multimodal Large Language Models (MLLMs) demonstrate its effectiveness in tackling complex visual tasks. However, existing MLLM-based Video Anomaly Detection (VAD) methods remain limited to…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Chao Huang , Benfeng Wang , Jie Wen , Chengliang Liu , Wei Wang , Li Shen , Xiaochun Cao

Multimodal large language models (MLLMs) have emerged as pivotal tools in enhancing human-computer interaction. In this paper we focus on the application of MLLMs in the field of graphical user interface (GUI) elements structuring, where…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Yi Xu , Yesheng Zhang , Jiajia Liu , Jingdong Chen

Group activity detection (GAD) aims to simultaneously identify group members and categorize their collective activities within video sequences. Existing deep learning-based methods develop specialized architectures (e.g., transformer…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Jihua Peng , Qianxiong Xu , Yichen Liu , Chenxi Liu , Cheng Long , Rui Zhao , Ziyue Li

Prototype-based reconstruction methods for unsupervised anomaly detection utilize a limited set of learnable prototypes which only aggregates insufficient normal information, resulting in undesirable reconstruction. However, increasing the…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Ziqing Zhou , Yurui Pan , Lidong Wang , Wenbing Zhu , Mingmin Chi , Dong Wu , Bo Peng

We propose a novel inference-time out-of-domain (OOD) detection algorithm for specialized large language models (LLMs). Despite achieving state-of-the-art performance on in-domain tasks through fine-tuning, specialized LLMs remain…

计算与语言 · 计算机科学 2025-09-17 Ayush Gupta , Ramneet Kaur , Anirban Roy , Adam D. Cobb , Rama Chellappa , Susmit Jha

Existing multimodal UAV object detection methods often overlook the impact of semantic gaps between modalities, which makes it difficult to achieve accurate semantic and spatial alignments, limiting detection performance. To address this…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Wentao Wu , Chenglong Li , Xiao Wang , Bin Luo , Qi Liu

Multi-modal large language models (MLLMs), such as GPT-4o, excel at integrating text and visual data but face systematic challenges when interpreting ambiguous or incomplete visual stimuli. This study leverages statistical modeling to…

机器学习 · 计算机科学 2024-12-09 Ching-Yi Wang

Existing Medical Large Vision-Language Models (Med-LVLMs), encapsulating extensive medical knowledge, demonstrate excellent capabilities in understanding medical images. However, there remain challenges in visual localization in medical…

计算与语言 · 计算机科学 2025-06-03 Yucheng Zhou , Lingran Song , Jianbing Shen

Industrial machine fault diagnosis is a critical component of operational efficiency and safety in manufacturing environments. Traditional methods rely heavily on expert knowledge and specific machine learning models, which can be limited…

计算与语言 · 计算机科学 2024-10-07 Apiradee Boonmee , Kritsada Wongsuwan , Pimchanok Sukjai

The development of Audio Description (AD) has been a pivotal step forward in making video content more accessible and inclusive. Traditionally, AD production has demanded a considerable amount of skilled labor, while existing automated…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Peng Chu , Jiang Wang , Andre Abrantes

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

软件工程 · 计算机科学 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

计算与语言 · 计算机科学 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

Industrial anomaly detection (IAD) is critical for manufacturing quality control, but conventionally requires significant manual effort for various application scenarios. This paper introduces AutoIAD, a multi-agent collaboration framework,…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Dongwei Ji , Bingzhang Hu , Yi Zhou

Video Anomaly Detection (VAD) aims to locate events that deviate from normal patterns in videos. Traditional approaches often rely on extensive labeled data and incur high computational costs. Recent tuning-free methods based on Multimodal…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Zhaolin Cai , Fan Li , Ziwei Zheng , Haixia Bi , Lijun He

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Yanxin Long , Jianhua Han , Runhui Huang , Xu Hang , Yi Zhu , Chunjing Xu , Xiaodan Liang

This comprehensive review delves into the pivotal role of prompt engineering in unleashing the capabilities of Large Language Models (LLMs). The development of Artificial Intelligence (AI), from its inception in the 1950s to the emergence…

计算与语言 · 计算机科学 2025-06-18 Banghao Chen , Zhaofeng Zhang , Nicolas Langrené , Shengxin Zhu

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang