English
Related papers

Related papers: Mind-Brush: Integrating Agentic Cognitive Search a…

200 papers

Unified multimodal models (UMMs) have shown impressive capabilities in generating natural images and supporting multimodal reasoning. However, their potential in supporting computer-use planning tasks, which are closely related to our…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junxian Li , Kai Liu , Leyang Chen , Weida Wang , Zhixin Wang , Jiaqi Xu , Fan Li , Renjing Pei , Linghe Kong , Yulun Zhang

Agentic multimodal models should not only comprehend text and images, but also actively invoke external tools, such as code execution environments and web search, and integrate these operations into reasoning. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jack Hong , Chenxiao Zhao , ChengLin Zhu , Weiheng Lu , Guohai Xu , Xing Yu

Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jianjie Fang , Yingshan Lei , Qin Wan , Ziyou Wang , Yuchao Huang , Yongyan Xu , Baining Zhao , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Direct prompt-based editing often fails on complex transformations because vague and subjective prompts often require nuanced understanding of what should be changed in the image. Our core intuition is that leveraging compositional image…

Machine Learning · Computer Science 2026-03-10 Subhojyoti Mukherjee , Stefano Petrangeli , Branislav Kveton , Trung Bui , Franck Dernoncourt , Arko Mukherjee

Visual designers naturally draw inspiration from multiple visual references, combining diverse elements and aesthetic principles to create artwork. However, current image generative frameworks predominantly rely on single-source inputs --…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Ruoxi Chen , Dongping Chen , Siyuan Wu , Sinan Wang , Shiyun Lang , Petr Sushko , Gaoyang Jiang , Yao Wan , Ranjay Krishna

Autonomous AI is no longer a hard-to-reach concept, it enables the agents to move beyond executing tasks to independently addressing complex problems, adapting to change while handling the uncertainty of the environment. However, what makes…

Neurons and Cognition · Quantitative Biology 2025-05-12 Zinan Liu , Haoran Li , Jingyi Lu , Gaoyuan Ma , Xu Hong , Giovanni Iacca , Arvind Kumar , Shaojun Tang , Lin Wang

While Multimodal Large Language Models (MLLMs) excel at single-image understanding, they exhibit significantly degraded performance in multi-image reasoning scenarios. Multi-image reasoning presents fundamental challenges including complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jianghao Yin , Qingbin Li , Kun Sun , Cheng Ding , Jie Wang , Qin Chen , Jie Zhou , Nan Wang , Changqing Li , Pei Wu , Jian Xu , Zheming Yang , Liang He

Modern vision-language models (VLMs) deliver impressive predictive accuracy yet offer little insight into 'why' a decision is reached, frequently hallucinating facts, particularly when encountering out-of-distribution data. Neurosymbolic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Sanchit Sinha , Guangzhi Xiong , Zhenghao He , Aidong Zhang

Recent advances in diffusion models have enhanced multimodal-guided visual generation, enabling customized subject insertion that seamlessly "brushes" user-specified objects into a given image guided by textual prompts. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yu Xu , Fan Tang , You Wu , Lin Gao , Oliver Deussen , Hongbin Yan , Jintao Li , Juan Cao , Tong-Yee Lee

Benchmarks are paramount for gauging progress in the domain of Mobile GUI Agents. In practical scenarios, users frequently fail to articulate precise directives containing full task details at the onset, and their expressions are typically…

The emergence of Large Language Models (LLMs) has unified language generation tasks and revolutionized human-machine interaction. However, in the realm of image generation, a unified model capable of handling various tasks within a single…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Shitao Xiao , Yueze Wang , Junjie Zhou , Huaying Yuan , Xingrun Xing , Ruiran Yan , Chaofan Li , Shuting Wang , Tiejun Huang , Zheng Liu

A major challenge for world models in multi-agent systems is to understand interdependent agent dynamics, predict interactive multi-agent trajectories, and plan over long horizons with collective awareness, without centralized supervision…

Artificial Intelligence · Computer Science 2026-03-03 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishna

While recent advancements in vision-language models have had a transformative impact on multi-modal comprehension, the extent to which these models possess the ability to comprehend generated images remains uncertain. Synthetic images, in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Keqiang Sun , Junting Pan , Yuying Ge , Hao Li , Haodong Duan , Xiaoshi Wu , Renrui Zhang , Aojun Zhou , Zipeng Qin , Yi Wang , Jifeng Dai , Yu Qiao , Limin Wang , Hongsheng Li

Multimodal text-to-image generation remains constrained by the difficulty of maintaining semantic alignment and professional-level detail across diverse visual domains. We propose a multi-agent reinforcement learning framework that…

Artificial Intelligence · Computer Science 2025-10-14 Jiabao Shi , Minfeng Qi , Lefeng Zhang , Di Wang , Yingjie Zhao , Ziying Li , Yalong Xing , Ningran Li

Large Language Models (LLMs) have transformed how people interact with artificial intelligence (AI) systems, achieving state-of-the-art results in various tasks, including scientific discovery and hypothesis generation. However, the lack of…

Computation and Language · Computer Science 2024-11-06 Sikun Guo , Amir Hassan Shariatmadari , Guangzhi Xiong , Albert Huang , Eric Xie , Stefan Bekiranov , Aidong Zhang

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Unified Multimodal Models (UMMs) have shown remarkable progress in visual generation. Yet, existing benchmarks predominantly assess $\textit{Crystallized Intelligence}$, which relies on recalling accumulated knowledge and learned schemas.…

Machine Learning · Computer Science 2026-02-12 Ruichuan An , Sihan Yang , Ziyu Guo , Wei Dai , Zijun Shen , Haodong Li , Renrui Zhang , Xinyu Wei , Guopeng Li , Wenshan Wu , Wentao Zhang

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

Amodal completion, generating invisible parts of occluded objects, is vital for applications like image editing and AR. Prior methods face challenges with data needs, generalization, or error accumulation in progressive pipelines. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hongxing Fan , Lipeng Wang , Haohua Chen , Zehuan Huang , Jiangtao Wu , Lu Sheng

The rapid growth of the text-to-image (T2I) community has fostered a thriving online ecosystem of expert models, which are variants of pretrained diffusion models specialized for diverse generative abilities. Yet, existing model merging…

Artificial Intelligence · Computer Science 2026-03-24 Zhuoling Li , Hossein Rahmani , Jiarui Zhang , Yu Xue , Majid Mirmehdi , Jason Kuen , Jiuxiang Gu , Jun Liu