中文
相关论文

相关论文: MMGR: Multi-Modal Generative Reasoning

200 篇论文

Multi-image reasoning and grounding require understanding complex cross-image relationships at both object levels and image levels. Current Large Visual Language Models (LVLMs) face two critical challenges: the lack of cross-image reasoning…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Lihao Zheng , Jiawei Chen , Xintian Shen , Hao Ma , Tao Wei

AI models have achieved state-of-the-art results in textual reasoning; however, their ability to reason over spatial and relational structures remains a critical bottleneck -- particularly in early-grade maths, which relies heavily on…

While multimodal large language models (MLLMs) exhibit strong performance on single-video tasks (e.g., video question answering), their capability for spatiotemporal pattern reasoning across multiple videos remains a critical gap in pattern…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Nannan Zhu , Yonghao Dong , Teng Wang , Xueqian Li , Shengjun Deng , Yijia Wang , Zheng Hong , Tiantian Geng , Guo Niu , Hanyan Huang , Xiongfei Yao , Shuaiwei Jiao

Multimodal Language Language Models (MLLMs) demonstrate the emerging abilities of "world models" -- interpreting and reasoning about complex real-world dynamics. To assess these abilities, we posit videos are the ideal medium, as they…

计算机视觉与模式识别 · 计算机科学 2024-07-31 Xuehai He , Weixi Feng , Kaizhi Zheng , Yujie Lu , Wanrong Zhu , Jiachen Li , Yue Fan , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Kevin Lin , William Yang Wang , Lijuan Wang , Xin Eric Wang

As reasoning models scale rapidly, the essential role of multimodality in human cognition has come into sharp relief, driving a growing need to probe vision-centric cognitive behaviors. Yet, existing multimodal benchmarks either…

Large vision-and-language models (VLMs) trained to match images with text on large-scale datasets of image-text pairs have shown impressive generalization ability on several vision and language tasks. Several recent works, however, showed…

计算机视觉与模式识别 · 计算机科学 2024-03-07 Navid Rajabi , Jana Kosecka

The fusion of Large Language Models with vision models is pioneering new possibilities in user-interactive vision-language tasks. A notable application is reasoning segmentation, where models generate pixel-level segmentation masks by…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Donggon Jang , Yucheol Cho , Suin Lee , Taehyeon Kim , Dae-Shik Kim

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

A critical aspect of human visual perception is the ability to parse visual scenes into individual objects and further into object parts, forming part-whole hierarchies. Such composite structures could induce a rich set of semantic concepts…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Yining Hong , Li Yi , Joshua B. Tenenbaum , Antonio Torralba , Chuang Gan

Recent advances in video generation have enabled the synthesis of videos with strong temporal consistency and impressive visual quality, marking a crucial step toward vision foundation models. To evaluate these video generation models,…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Xuming He , Zehao Fan , Hengjia Li , Fan Zhuo , Hankun Xu , Senlin Cheng , Di Weng , Haifeng Liu , Can Ye , Boxi Wu

Spatial perception and reasoning are core components of human cognition, encompassing object recognition, spatial relational understanding, and dynamic reasoning. Despite progress in computer vision, existing benchmarks reveal significant…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Chonghan Liu , Haoran Wang , Felix Henry , Pu Miao , Yajie Zhang , Yu Zhao , Peiran Wu

Recent text-to-video generation models have made remarkable progress in visual realism, motion fidelity, and text-video alignment, yet they still struggle to produce socially coherent behavior. Unlike humans, who readily infer intentions,…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Wenshuo Peng , Gongxuan Wang , Tianmeng Yang , Chuanhao Li , Xiaojie Xu , Hui He , Kaipeng Zhang

In this paper, we introduce Motion-Grounded Video Reasoning, a new motion understanding task that requires generating visual answers (video segmentation masks) according to the input question, and hence needs implicit spatiotemporal…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Andong Deng , Tongjia Chen , Shoubin Yu , Taojiannan Yang , Lincoln Spencer , Yapeng Tian , Ajmal Saeed Mian , Mohit Bansal , Chen Chen

Visual commonsense reasoning (VCR) is a challenging multi-modal task, which requires high-level cognition and commonsense reasoning ability about the real world. In recent years, large-scale pre-training approaches have been developed and…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Cheng Yang , Rui Xu , Ye Guo , Peixiang Huang , Yiru Chen , Wenkui Ding , Zhongyuan Wang , Hong Zhou

Spatial understanding over continuous visual input is crucial for MLLMs to evolve into general-purpose assistants in physical environments. Yet there is still no comprehensive benchmark that holistically assesses the progress toward this…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Jingli Lin , Runsen Xu , Shaohao Zhu , Sihan Yang , Peizhou Cao , Yunlong Ran , Miao Hu , Chenming Zhu , Yiman Xie , Yilin Long , Wenbo Hu , Dahua Lin , Tai Wang , Jiangmiao Pang

Reasoning over dynamic visual content remains a central challenge for multimodal large language models. Recent thinking models generate explicit reasoning traces for interpretability; however, their reasoning often appears convincing while…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Muhammad Maaz , Hanoona Rasheed , Fahad Shahbaz Khan , Salman Khan

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

人工智能 · 计算机科学 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Accurate and interpretable detection of AI-generated images is essential for mitigating risks associated with AI misuse. However, the substantial domain gap among generative models makes it challenging to develop a generalizable forgery…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Yueying Gao , Dongliang Chang , Bingyao Yu , Haotian Qin , Muxi Diao , Lei Chen , Kongming Liang , Zhanyu Ma

Most existing 3D referring expression segmentation (3DRES) methods rely on dense, high-quality point clouds, while real-world agents such as robots and mobile phones operate with only a few sparse RGB views and strict latency constraints.…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Changli Wu , Haodong Wang , Jiayi Ji , Yutian Yao , Chunsai Du , Jihua Kang , Yanwei Fu , Liujuan Cao

Multimodal Large Language Models (MLLMs) have showcased exceptional Chain-of-Thought (CoT) reasoning ability in complex textual inference tasks including causal reasoning. However, will these causalities remain straightforward when crucial…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Zhiyuan Li , Heng Wang , Dongnan Liu , Chaoyi Zhang , Ao Ma , Jieting Long , Weidong Cai