English
Related papers

Related papers: M-ArtAgent: Evidence-Based Multimodal Agent for Im…

200 papers

Understanding artworks requires multi-step reasoning over visual content and cultural, historical, and stylistic context. While recent multimodal large language models show promise in artwork explanation, they rely on implicit reasoning and…

Artificial Intelligence · Computer Science 2026-04-22 Shuai Wang , Hongyi Zhu , Jia-Hong Huang , Yixian Shen , Chengxi Zeng , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

Despite recent advances in multimodal large language models (MLLMs), their ability to understand and interact with music remains limited. Music understanding requires grounded reasoning over symbolic scores and expressive performance audio,…

Multimedia · Computer Science 2026-01-21 Qihao Zhao , Yunqi Cao , Yangyu Huang , Hui Yi Leong , Fan Zhang , Kim-Hui Yap , Wei Hu

Considering the huge amount of art pieces that exist, there is valuable information to be discovered. Examining a painting, an expert can determine its style, genre, and the time period that the painting belongs. One important task for art…

Computer Vision and Pattern Recognition · Computer Science 2014-08-15 Babak Saleh , Kanako Abe , Ravneet Singh Arora , Ahmed Elgammal

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

The rapid spread of misinformation in the digital era poses significant challenges to public discourse, necessitating robust and scalable fact-checking solutions. Traditional human-led fact-checking methods, while credible, struggle with…

Artificial Intelligence · Computer Science 2025-06-24 Tam Trinh , Manh Nguyen , Truong-Son Hy

Despite recent advances in diffusion models, AI generated images still often contain visual artifacts that compromise realism. Although more thorough pre-training and bigger models might reduce artifacts, there is no assurance that they can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jaehyun Park , Minyoung Ahn , Minkyu Kim , Jonghyun Lee , Jae-Gil Lee , Dongmin Park

While interpretable prototype networks offer compelling case-based reasoning for clinical diagnostics, their raw continuous outputs lack the semantic structure required for medical documentation. Bridging this gap via standard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Alvaro Lopez Pellicer , Plamen Angelov , Marwan Bukhari , Yi Li , Eduardo Soares , Jemma Kerns

Mathematical error detection in educational settings presents a significant challenge for Multimodal Large Language Models (MLLMs), requiring a sophisticated understanding of both visual and textual mathematical content along with complex…

Computation and Language · Computer Science 2025-05-21 Yibo Yan , Shen Wang , Jiahao Huo , Philip S. Yu , Xuming Hu , Qingsong Wen

This paper presents our submission to the ACMMM25 - Grand Challenge on Multimedia Verification. We developed a multi-agent verification system that combines Multimodal Large Language Models (MLLMs) with specialized verification tools to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Huy Hoan Le , Van Sy Thinh Nguyen , Thi Le Chi Dang , Vo Thanh Khang Nguyen , Truong Thanh Hung Nguyen , Hung Cao

Automatic art analysis aims to classify and retrieve artistic representations from a collection of images by using computer vision and machine learning techniques. In this work, we propose to enhance visual representations from neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Noa Garcia , Benjamin Renoust , Yuta Nakashima

The rapid spread of memes makes harmful content detection increasingly crucial, as effective identification can curb the circulation of misinformation. However, existing methods rely heavily on high-volume annotated data, which leads to…

Machine Learning · Computer Science 2026-05-06 Zihan Ding , Ziyuan Yang , Yi Zhang

With the rapid advancement of commercial multi-modal models, image editing has garnered significant attention due to its widespread applicability in daily life. Despite impressive progress, existing image editing systems, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yiran Zhao , Yaoqi Ye , Xiang Liu , Michael Qizhe Shieh , Trung Bui

The detection and grounding of multimedia manipulation has emerged as a critical challenge in combating AI-generated disinformation. While existing methods have made progress in recent years, we identify two fundamental limitations in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuchen Zhang , Yaxiong Wang , Yujiao Wu , Lianwei Wu , Li Zhu , Zhedong Zheng

Amodal completion, generating invisible parts of occluded objects, is vital for applications like image editing and AR. Prior methods face challenges with data needs, generalization, or error accumulation in progressive pipelines. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hongxing Fan , Lipeng Wang , Haohua Chen , Zehuan Huang , Jiangtao Wu , Lu Sheng

Ancient artifacts are an important medium for cultural preservation and restoration. However, many physical copies of artifacts are either damaged or lost, leaving a blank space in archaeological and historical studies that calls for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Shengguang Wu , Zhenglun Chen , Qi Su

Analyzing whole-slide images (WSIs) requires an iterative, evidence-driven reasoning process that parallels how pathologists dynamically zoom, refocus, and self-correct while collecting the evidence. However, existing computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jingyun Chen , Linghan Cai , Zhikang Wang , Yi Huang , Songhan Jiang , Shenjin Huang , Hongpeng Wang , Yongbing Zhang

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Explanations for AI models in high-stakes domains like medicine often lack verifiability, which can hinder trust. To address this, we propose an interactive agent that produces explanations through an auditable sequence of actions. The…

Artificial Intelligence · Computer Science 2025-11-04 Yuhang Huang , Zekai Lin , Fan Zhong , Lei Liu

Flowcharts are a critical tool for visualizing decision-making processes. However, their non-linear structure and complex visual-textual relationships make it challenging to interpret them using LLMs, as vision-language models frequently…

Computation and Language · Computer Science 2025-06-03 Manan Suri , Puneet Mathur , Nedim Lipka , Franck Dernoncourt , Ryan A. Rossi , Vivek Gupta , Dinesh Manocha
‹ Prev 1 2 3 10 Next ›