中文
相关论文

相关论文: MMAD: A Comprehensive Benchmark for Multimodal Lar…

200 篇论文

The popularity of multimodal large language models (MLLMs) has triggered a recent surge in research efforts dedicated to evaluating these models. Nevertheless, existing evaluation studies of MLLMs primarily focus on the comprehension and…

计算与语言 · 计算机科学 2023-10-16 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

Multimodal large language models (MLLMs), which bridge the gap between audio-visual and natural language processing, achieve state-of-the-art performance on several audio-visual tasks. Despite the superior performance of MLLMs, the scarcity…

密码学与安全 · 计算机科学 2025-06-16 Jinming Wen , Xinyi Wu , Shuai Zhao , Yanhao Jia , Yuwen Li

In the advancement of industrial informatization, unsupervised anomaly detection technology effectively overcomes the scarcity of abnormal samples and significantly enhances the automation and reliability of smart manufacturing. As an…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Yuxuan Lin , Yang Chang , Xuan Tong , Jiawen Yu , Antonio Liotta , Guofan Huang , Wei Song , Deyu Zeng , Zongze Wu , Yan Wang , Wenqiang Zhang

Anomaly detection from images captured using camera sensors is one of the mainstream applications at the industrial level. Particularly, it maintains the quality and optimizes the efficiency in production processes across diverse industrial…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Abdelrahman Alzarooni , Ehtesham Iqbal , Samee Ullah Khan , Sajid Javed , Brain Moyo , Yusra Abdulrahman

The rapid evolution of large language models (LLMs) has pushed their boundaries to many applications in various domains. Recently, the research community has started to evaluate their potential adoption in autonomous vehicles and especially…

机器人学 · 计算机科学 2025-09-09 Petros Loukas , David Bassir , Savvas Chatzichristofis , Angelos Amanatiadis

Large Language Models (LLMs) have demonstrated strong performance across various natural language processing tasks, yet their proficiency in mathematical reasoning remains a key challenge. Addressing the gap between natural and mathematical…

人工智能 · 计算机科学 2025-02-18 Xuhan Huang , Qingning Shen , Yan Hu , Anningzhe Gao , Benyou Wang

The application of Multi-modal Large Language Models (MLLMs) in Autonomous Driving (AD) faces significant challenges due to their limited training on traffic-specific data and the absence of dedicated benchmarks for spatiotemporal…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Korawat Charoenpitaks , Van-Quang Nguyen , Masanori Suganuma , Kentaro Arai , Seiji Totsuka , Hiroshi Ino , Takayuki Okatani

Multi-modal large language models (MLLMs), such as GPT-4o, excel at integrating text and visual data but face systematic challenges when interpreting ambiguous or incomplete visual stimuli. This study leverages statistical modeling to…

机器学习 · 计算机科学 2024-12-09 Ching-Yi Wang

Multimodal Large Language Models (MLLMs) show reasoning promise, yet their visual perception is a critical bottleneck. Strikingly, MLLMs can produce correct answers even while misinterpreting crucial visual elements, masking these…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Aditya Kanade , Tanuja Ganu

System log anomaly detection is critical for maintaining the reliability of large-scale software systems, yet traditional methods struggle with the heterogeneous and evolving nature of modern log data. Recent advances in Large Language…

机器学习 · 计算机科学 2026-04-15 Disha Patel

Anomaly detection on text-rich graphs is widely prevalent in real life, such as detecting incorrectly assigned academic papers to authors and detecting bots in social networks. The remarkable capabilities of large language models (LLMs)…

计算与语言 · 计算机科学 2025-08-08 Yunhe Pang , Bo Chen , Fanjin Zhang , Yanghui Rao , Evgeny Kharlamov , Jie Tang

Multi-modal Large Language Models (MLLMs) are increasingly prominent in the field of artificial intelligence. These models not only excel in traditional vision-language tasks but also demonstrate impressive performance in contemporary…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Xiaotian Han , Quanzeng You , Yongfei Liu , Wentao Chen , Huangjie Zheng , Khalil Mrini , Xudong Lin , Yiqi Wang , Bohan Zhai , Jianbo Yuan , Heng Wang , Hongxia Yang

While Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have shown strong generalisation in detecting image and video deepfakes, their use for audio deepfake detection remains largely unexplored. In this work, we…

声音 · 计算机科学 2026-01-05 Akanksha Chuchra , Shukesh Reddy , Sudeepta Mishra , Abhijit Das , Abhinav Dhall

Semantic segmentation networks have achieved significant success under the assumption of independent and identically distributed data. However, these networks often struggle to detect anomalies from unknown semantic classes due to the…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Liangyu Zhong , Joachim Sicking , Fabian Hüger , Hanno Gottschalk

This paper proposes one of the first clinical applications of multimodal large language models (LLMs) as an assistant for radiologists to check errors in their reports. We created an evaluation dataset from real-world radiology datasets…

Logical image understanding involves interpreting and reasoning about the relationships and consistency within an image's visual content. This capability is essential in applications such as industrial inspection, where logical anomaly…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Er Jin , Qihui Feng , Yongli Mou , Stefan Decker , Gerhard Lakemeyer , Oliver Simons , Johannes Stegmaier

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

计算与语言 · 计算机科学 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Binary analysis remains pivotal in software security, offering insights into compiled programs without source code access. As large language models (LLMs) continue to excel in diverse language understanding and generation tasks, their…

软件工程 · 计算机科学 2025-05-13 Xiuwei Shang , Guoqiang Chen , Shaoyin Cheng , Benlong Wu , Li Hu , Gangyang Li , Weiming Zhang , Nenghai Yu

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

In the past year, MultiModal Large Language Models (MM-LLMs) have undergone substantial advancements, augmenting off-the-shelf LLMs to support MM inputs or outputs via cost-effective training strategies. The resulting models not only…

计算与语言 · 计算机科学 2024-05-29 Duzhen Zhang , Yahan Yu , Jiahua Dong , Chenxing Li , Dan Su , Chenhui Chu , Dong Yu