English
Related papers

Related papers: Reasoning-Driven Amodal Completion: Collaborative …

200 papers

Visual grounding, the task of linking textual queries to specific regions within images, plays a pivotal role in vision-language integration. Existing methods typically rely on extensive task-specific annotations and fine-tuning, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Liqin Luo , Guangyao Chen , Xiawu Zheng , Yongxing Dai , Yixiong Zou , Yonghong Tian

Robotic agents performing domestic chores by natural language directives are required to master the complex job of navigating environment and interacting with objects in the environments. The tasks given to the agents are often composite…

Robotics · Computer Science 2024-03-14 Suvaansh Bhambri , Byeonghwi Kim , Jonghyun Choi

Multimodal Small-to-Medium sized Language Models (MSLMs) have demonstrated strong capabilities in integrating visual and textual information but still face significant limitations in visual comprehension and mathematical reasoning,…

Machine Learning · Computer Science 2026-01-27 Ashutosh Bajpai , Akshat Bhandari , Akshay Nambi , Tanmoy Chakraborty

Detecting AI-generated images with multimodal large language models (MLLMs) has gained increasing attention, due to their rich world knowledge, common-sense reasoning, and potential for explainability. However, naively applying those MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Kaiqing Lin , Zhiyuan Yan , Ruoxin Chen , Junyan Ye , Ke-Yue Zhang , Yue Zhou , Peng Jin , Bin Li , Taiping Yao , Shouhong Ding

Unified multimodal models (UMMs) have emerged as a powerful paradigm for seamlessly unifying text and image understanding and generation. However, prevailing evaluations treat these abilities in isolation, such that tasks with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yongyuan Liang , Wei Chow , Feng Li , Ziqiao Ma , Xiyao Wang , Jiageng Mao , Jiuhai Chen , Jiatao Gu , Yue Wang , Furong Huang

Intrinsic image decomposition aims to separate images into physical components such as albedo, depth, normals, and illumination. While recent diffusion- and transformer-based models benefit from paired supervision from synthetic datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Alara Dirik , Tuanfeng Wang , Duygu Ceylan , Stefanos Zafeiriou , Anna Frühstück

With the continuous expansion of Large Language Models (LLMs) and advances in reinforcement learning, LLMs have demonstrated exceptional reasoning capabilities, enabling them to address a wide range of complex problems. Inspired by these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hongrui Jia , Chaoya Jiang , Shikun Zhang , Wei Ye

Recent advances in Large Multi-modal Models (LMMs) have demonstrated their remarkable success as general-purpose multi-modal assistants, with particular focuses on holistic image- and video-language understanding. Conversely, less attention…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ye Liu , Zongyang Ma , Junfu Pu , Zhongang Qi , Yang Wu , Ying Shan , Chang Wen Chen

Legal reasoning requires both precise interpretation of statutory language and consistent application of complex rules, presenting significant challenges for AI systems. This paper introduces a modular multi-agent framework that decomposes…

Artificial Intelligence · Computer Science 2025-11-11 Albert Sadowski , Jarosław A. Chudziak

Recent research on medical MLLMs has gradually shifted its focus from image-level understanding to fine-grained, pixel-level comprehension. Although segmentation serves as the foundation for pixel-level understanding, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yankai Jiang , Qiaoru Li , Binlu Xu , Haoran Sun , Chao Ding , Junting Dong , Yuxiang Cai , Xuhong Zhang , Jianwei Yin

Can LLM agents explore codebases and reason about code semantics without executing the code? We study this capability, which we call agentic code reasoning, and introduce semi-formal reasoning: a structured prompting methodology that…

Software Engineering · Computer Science 2026-03-05 Shubham Ugare , Satish Chandra

Recent advances in multimodal question answering have primarily focused on combining heterogeneous modalities or fine-tuning multimodal large language models. While these approaches have shown strong performance, they often rely on a…

Computation and Language · Computer Science 2026-04-22 Krishna Singh Rajput , Tejas Anvekar , Chitta Baral , Vivek Gupta

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

Multimodal empathetic response generation (MERG) aims to generate emotionally engaging and empathetic responses based on users' multimodal contexts. Existing approaches usually rely on an implicit one-pass generation paradigm from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Liping Wang , Cheng Ye , Weidong Chen , Peipei Song , Bo Hu , Zhendong Mao

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

While anomaly detection has made significant progress, generating detailed analyses that incorporate industrial knowledge remains a challenge. To address this gap, we introduce OmniAD, a novel framework that unifies anomaly detection and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Shifang Zhao , Yiheng Lin , Lu Han , Yao Zhao , Yunchao Wei

Reasoning benchmarks such as the Abstraction and Reasoning Corpus (ARC) and ARC-AGI are widely used to assess progress in artificial intelligence and are often interpreted as probes of core, so-called ``fluid'' reasoning abilities. Despite…

Computation and Language · Computer Science 2026-01-12 Xinhe Wang , Jin Huang , Xingjian Zhang , Tianhao Wang , Jiaqi W. Ma

For human cognitive process, spatial reasoning and perception are closely entangled, yet the nature of this interplay remains underexplored in the evaluation of multimodal large language models (MLLMs). While recent MLLM advancements show…

Computation and Language · Computer Science 2025-08-28 Chengzu Li , Wenshan Wu , Huanyu Zhang , Qingtao Li , Zeyu Gao , Yan Xia , José Hernández-Orallo , Ivan Vulić , Furu Wei

Real-world multimodal applications often require any-to-any capabilities, enabling both understanding and generation across modalities including text, image, audio, and video. However, integrating the strengths of autoregressive language…

Machine Learning · Computer Science 2025-08-15 Jiulin Li , Ping Huang , Yexin Li , Shuo Chen , Juewen Hu , Ye Tian

Recent advancements in visual generative models have enabled high-quality image and video generation, opening diverse applications. However, evaluating these models often demands sampling hundreds or thousands of images or videos, making…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Fan Zhang , Shulin Tian , Ziqi Huang , Yu Qiao , Ziwei Liu
‹ Prev 1 3 4 5 6 7 10 Next ›