English
Related papers

Related papers: EMIT: Enhancing MLLMs for Industrial Anomaly Detec…

200 papers

Due to the scarcity and unpredictable nature of defect samples, industrial anomaly detection (IAD) predominantly employs unsupervised learning. However, all unsupervised IAD methods face a common challenge: the inherent bias in normal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Xin Chen , Liujuan Cao , Shengchuan Zhang , Xiewu Zheng , Yan Zhang

As the field of Multimodal Large Language Models (MLLMs) continues to evolve, their potential to revolutionize artificial intelligence is particularly promising, especially in addressing mathematical reasoning tasks. Current mathematical…

Multimodal large language models (MLLMs) have achieved remarkable progress on various visual question answering and reasoning tasks leveraging instruction fine-tuning specific datasets. They can also learn from preference data annotated by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yongxin Wang , Meng Cao , Haokun Lin , Mingfei Han , Liang Ma , Jin Jiang , Yuhao Cheng , Xiaodan Liang

In the domain of anomaly detection, methods often excel in either high-level semantic or low-level industrial benchmarks, rarely achieving cross-domain proficiency. Semantic anomalies are novelties that differ in meaning from the training…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Luc P. J. Sträter , Mohammadreza Salehi , Efstratios Gavves , Cees G. M. Snoek , Yuki M. Asano

Recent Multimodal Large Language Models (MLLMs) excel in vision-language understanding but face challenges in adapting to dynamic real-world scenarios that require continuous integration of new knowledge and skills. While continual learning…

Computation and Language · Computer Science 2025-10-02 Hongbo Zhao , Fei Zhu , Haiyang Guo , Meng Wang , Rundong Wang , Gaofeng Meng , Zhaoxiang Zhang

In this work we focus on improving language models' understanding for asset maintenance to guide the engineer's decisions and minimize asset downtime. Given a set of tasks expressed in natural language for Industry 4.0 domain, each…

Computation and Language · Computer Science 2025-06-17 Christodoulos Constantinides , Shuxin Lin , Dhaval Patel

Group activity detection (GAD) aims to simultaneously identify group members and categorize their collective activities within video sequences. Existing deep learning-based methods develop specialized architectures (e.g., transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Jihua Peng , Qianxiong Xu , Yichen Liu , Chenxi Liu , Cheng Long , Rui Zhao , Ziyue Li

Anomaly detection (AD) aims to identify defective images and localize their defects (if any). Ideally, AD models should be able to detect defects over many image classes; without relying on hard-coded class names that can be uninformative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Chih-Hui Ho , Kuan-Chuan Peng , Nuno Vasconcelos

The rise of large language models (LLMs) offers new opportunities for automatic error detection in education, particularly for math word problems (MWPs). While prior studies demonstrate the promise of LLMs as error detectors, they overlook…

Computation and Language · Computer Science 2024-12-24 Hang Li , Tianlong Xu , Kaiqi Yang , Yucheng Chu , Yanling Chen , Yichi Song , Qingsong Wen , Hui Liu

Context: Software vulnerabilities pose a significant threat to modern software systems, as evidenced by the growing number of reported vulnerabilities and cyberattacks. These escalating trends underscore the urgent need for effective…

Software Engineering · Computer Science 2025-07-01 Siyu Chen , Jiongyi Yang , Xiang Chen , Menglin Zheng , Minnan Wei , Xiaolin Ju

Recent advancements have enhanced the capability of Multimodal Large Language Models (MLLMs) to comprehend multi-image information. However, existing benchmarks primarily evaluate answer correctness, overlooking whether models genuinely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Pengfei Wang , Guohai Xu , Weinong Wang , Junjie Yang , Jie Lou , Yunhua Xue

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Unsupervised anomaly detection (AD) is critical for a wide range of practical applications, from network security to health and medical tools. Due to the diversity of problems, no single algorithm has been found to be superior for all AD…

Machine Learning · Computer Science 2023-05-18 Małgorzata Gutowska , Suzanne Little , Andrew McCarren

The rapid expansion of Internet of Things (IoT) devices has introduced critical security challenges, underscoring the need for accurate anomaly detection. Although numerous studies have proposed machine learning (ML) methods for this…

Machine Learning · Computer Science 2025-05-23 Mohammed Al-Qudah , Fadi AlMahamid

Reinforcement Learning with Verifiable Rewards (RLVR) and Group Relative Policy Optimization (GRPO) have significantly advanced the reasoning capabilities of large language models. Extending these methods to multimodal settings, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Jinghan Li , Junfeng Fang , Jinda Lu , Yuan Wang , Xiaoyan Guo , Tianyu Zhang , Xiang Wang , Xiangnan He

Automatic visual inspection using machine learning plays a key role in achieving zero-defect policies in industry. Research on anomaly detection is constrained by the availability of datasets that capture complex defect appearances and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Paul J. Krassnig , Dieter P. Gruber

Despite the significant progress in multimodal large language models (MLLMs), their high computational cost remains a barrier to real-world deployment. Inspired by the mixture of depths (MoDs) in natural language processing, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yaxin Luo , Gen Luo , Jiayi Ji , Yiyi Zhou , Xiaoshuai Sun , Zhiqiang Shen , Rongrong Ji

Large Language Models (LLMs) have made remarkable progress in enhancing step-by-step reasoning through reinforcement learning. However, the Group Relative Policy Optimization (GRPO) algorithm, which relies on sparse reward rules, often…

Artificial Intelligence · Computer Science 2025-07-30 Xingjian Zhang , Siwei Wen , Wenjun Wu , Lei Huang

Artificial intelligence (AI) has gained significant attention in healthcare consultation due to its potential to improve clinical workflow and enhance medical communication. However, owing to the complex nature of medical information, large…

Computation and Language · Computer Science 2024-03-05 Xiaolan Chen , Ziwei Zhao , Weiyi Zhang , Pusheng Xu , Le Gao , Mingpu Xu , Yue Wu , Yinwen Li , Danli Shi , Mingguang He

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan