English
Related papers

Related papers: MMAD: A Comprehensive Benchmark for Multimodal Lar…

200 papers

Automatic vision inspection holds significant importance in industry inspection. While multimodal large language models (MLLMs) exhibit strong language understanding capabilities and hold promise for this task, their performance remains…

Information Retrieval · Computer Science 2026-04-06 Kai Zhang , Zekai Zhang , Xihe Sun , Anpeng Wang , Jingmeng Nie , Qinghui Chen , Han Hao , Jianyuan Guo , Jinglin Zhang

Large language models (LLMs) have gained increasing attention in power grids for their general-purpose capabilities. Meanwhile, anomaly detection (AD) remains critical for grid resilience, requiring accurate and interpretable decisions…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Yichen Liu , Hongyu Wu , Bo Liu

Industrial machine fault diagnosis is a critical component of operational efficiency and safety in manufacturing environments. Traditional methods rely heavily on expert knowledge and specific machine learning models, which can be limited…

Computation and Language · Computer Science 2024-10-07 Apiradee Boonmee , Kritsada Wongsuwan , Pimchanok Sukjai

Detecting anomalies in general ledger data is of utmost importance to ensure trustworthiness of financial records. Financial audits increasingly rely on machine learning (ML) algorithms to identify irregular or potentially fraudulent…

Machine Learning · Computer Science 2025-09-30 Alexander Bakumenko , Kateřina Hlaváčková-Schindler , Claudia Plant , Nina C. Hubig

Multimodal large language models (MLLMs) are increasingly deployed in open-ended, real-world environments where inputs are messy, underspecified, and not always trustworthy. Unlike curated benchmarks, these settings frequently involve…

Artificial Intelligence · Computer Science 2025-08-26 Qianqi Yan , Hongquan Li , Shan Jiang , Yang Zhao , Xinze Guan , Ching-Chen Kuo , Xin Eric Wang

The remarkable advancements in Multimodal Large Language Models (MLLMs) have not rendered them immune to challenges, particularly in the context of handling deceptive information in prompts, thus producing hallucinated responses under such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yusu Qian , Haotian Zhang , Yinfei Yang , Zhe Gan

Industrial anomaly detection has been significantly advanced by Large Multimodal Models (LMMs), enabling diverse human instructions beyond detection, particularly through visually grounded reasoning for better image understanding. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hyunju Kang , Woohyun Lee , Jaewon Kim , Hogun Park

Multimodal large language models (MLLMs), which integrate language and visual cues for problem-solving, are crucial for advancing artificial general intelligence (AGI). However, current benchmarks for measuring the intelligence of MLLMs…

Industrial anomaly detection demands precise reasoning over fine-grained defect patterns. However, existing multimodal large language models (MLLMs), pretrained on general-domain data, often struggle to capture category-specific anomalies,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Peng Chen , Chao Huang , Yunkang Cao , Chengliang Liu , Wei Wang , Wenqiang Wang , Mingbo Yang , Li Shen , Wenqi Ren , Xiaochun Cao

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

Industrial Anomaly Detection (IAD) is critical to ensure product quality during manufacturing. Although existing zero-shot defect segmentation and detection methods have shown effectiveness, they cannot provide detailed descriptions of the…

Artificial Intelligence · Computer Science 2025-05-19 Zongyun Zhang , Jiacheng Ruan , Xian Gao , Ting Liu , Yuzhuo Fu

This study aims to comprehensively review and empirically evaluate the application of multimodal large language models (MLLMs) and Large Vision Models (VLMs) in object detection for transportation systems. In the first fold, we provide a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Huthaifa I. Ashqar , Ahmed Jaber , Taqwa I. Alhadidi , Mohammed Elhenawy

Recent advancements in Artificial Intelligence have led to the development of Multimodal Large Language Models (MLLMs). However, adapting these pre-trained models to dynamic data distributions and various tasks efficiently remains a…

Machine Learning · Computer Science 2025-03-05 Yukang Huo , Hao Tang

Materials characterization is fundamental to acquiring materials information, revealing the processing-microstructure-property relationships that guide material design and optimization. While multimodal large language models (MLLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Zhengzhao Lai , Youbin Zheng , Zhenyang Cai , Haonan Lyu , Jinpu Yang , Hongqing Liang , Yan Hu , Benyou Wang

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

The rapidly developing field of large multimodal models (LMMs) has led to the emergence of diverse models with remarkable capabilities. However, existing benchmarks fail to comprehensively, objectively and accurately evaluate whether LMMs…

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman