English
Related papers

Related papers: RealUnify: Do Unified Models Truly Benefit from Un…

200 papers

The pursuit of general-purpose embodied agents is hindered by fragmented evaluation protocols that isolate navigation skills and fixate on specific robot morphologies, failing to reflect real-world scenarios where agents must orchestrate…

The fashion domain encompasses a variety of real-world multimodal tasks, including multimodal retrieval and multimodal generation. The rapid advancements in artificial intelligence generated content, particularly in technologies like large…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiangyu Zhao , Yuehan Zhang , Wenlong Zhang , Xiao-Ming Wu

The remarkable success of diffusion models in text-to-image generation has sparked growing interest in expanding their capabilities to a variety of multi-modal tasks, including image understanding, manipulation, and perception. These tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xinyang Song , Libin Wang , Weining Wang , Shaozhen Liu , Dandan Zheng , Jingdong Chen , Qi Li , Zhenan Sun

We propose GeoUni, the first unified geometry expert model capable of generating problem solutions and diagrams within a single framework in a way that enables the creation of unique and individualized geometry problems. Traditionally,…

Machine Learning · Computer Science 2025-05-09 Jo-Ku Cheng , Zeren Zhang , Ran Chen , Jingyang Deng , Ziran Qin , Jinwen Ma

In this report, we present OpenUni, a simple, lightweight, and fully open-source baseline for unifying multimodal understanding and generation. Inspired by prevailing practices in unified model learning, we adopt an efficient training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Size Wu , Zhonghua Wu , Zerui Gong , Qingyi Tao , Sheng Jin , Qinyue Li , Wei Li , Chen Change Loy

Due to the difficulty of acquiring extensive real-world data, robot simulation has become crucial for parallel training and sim-to-real transfer, highlighting the importance of scalable simulated robotic tasks. Foundation models have…

Robotics · Computer Science 2024-10-11 Feng Chen , Botian Xu , Pu Hua , Peiqi Duan , Yanchao Yang , Yi Ma , Huazhe Xu

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Unified multimodal models for image generation and understanding represent a significant step toward AGI and have attracted widespread attention from researchers. The main challenge of this task lies in the difficulty in establishing an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Dian Zheng , Manyuan Zhang , Hongyu Li , Kai Zou , Hongbo Liu , Ziyu Guo , Kaituo Feng , Yexin Liu , Ying Luo , Hongsheng Li

Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a unified way…

In real-world multimodal applications, systems usually need to comprehend arbitrarily combined and interleaved multimodal inputs from users, while also generating outputs in any interleaved multimedia form. This capability defines the goal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yanlin Li , Minghui Guo , Kaiwen Zhang , Shize Zhang , Yiran Zhao , Haodong Li , Congyue Zhou , Weijie Zheng , Yushen Yan , Shengqiong Wu , Wei Ji , Lei Cui , Furu Wei , Hao Fei , Mong-Li Lee , Wynne Hsu

The physical world is not merely visual; it is governed by rigorous structural and procedural constraints. Yet, the evaluation of vision-language models (VLMs) remains heavily skewed toward perceptual realism, prioritizing the generation of…

Artificial Intelligence · Computer Science 2026-03-27 Luyu Yang , Yutong Dai , An Yan , Viraj Prabhu , Ran Xu , Zeyuan Chen

Autonomous driving (AD) systems struggle in long-tail scenarios due to limited world knowledge and weak visual dynamic modeling. Existing vision-language-action (VLA)-based methods cannot leverage unlabeled videos for visual causal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Hao Lu , Ziyang Liu , Guangfeng Jiang , Yuanfei Luo , Sheng Chen , Yangang Zhang , Ying-Cong Chen

Exams are a fundamental test of expert-level intelligence and require integrated understanding, reasoning, and generation. Existing exam-style benchmarks mainly focus on understanding and reasoning tasks, and current generation benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhaokai Wang , Penghao Yin , Xiangyu Zhao , Changyao Tian , Yu Qiao , Wenhai Wang , Jifeng Dai , Gen Luo

Unified multimodal models (UMMs) aim to integrate understanding and generation within a single architecture. However, it remains underexplored how to effectively coordinate these two capabilities for more effective and efficient reasoning.…

Multimedia · Computer Science 2026-05-13 Hayes Bai , Yinyi Luo , Wenwen Wang , Qingsong Wen , Jindong Wang

Real-world design tasks - such as picture book creation, film storyboard development using character sets, photo retouching, visual effects, and font transfer - are highly diverse and complex, requiring deep interpretation and extraction of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Chen Liang , Lianghua Huang , Jingwu Fang , Huanzhang Dou , Wei Wang , Zhi-Fan Wu , Yupeng Shi , Junge Zhang , Xin Zhao , Yu Liu

Effective financial reasoning demands not only textual understanding but also the ability to interpret complex visual data such as charts, tables, and trend graphs. This paper introduces a new benchmark designed to evaluate how well AI…

Artificial Intelligence · Computer Science 2025-06-10 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Chunhou Liu , Ciprian Doru Giurcuaneanu , Jiamou Liu

Vision-language models (VLMs) have demonstrated strong performance in 2D scene understanding and generation, but extending this unification to the physical world remains an open challenge. Existing 3D and 4D approaches typically embed scene…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Hanyu Zhou , Gim Hee Lee

Text-to-image generation has advanced rapidly with diffusion models, progressing from CLIP and T5 conditioning to unified systems where a single LLM backbone handles both visual understanding and generation. Despite the architectural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Sucheng Ren , Chen Chen , Zhenbang Wang , Liangchen Song , Xiangxin Zhu , Alan Yuille , Liang-Chieh Chen , Jiasen Lu

Generative AI systems achieve impressive performance on standard benchmarks yet fail to deliver real-world utility, a disconnect we identify across 28 deployment cases spanning education, healthcare, software engineering, and law. We argue…

Machine Learning · Computer Science 2026-05-12 Ishani Mondal , Shweta Bhardwaj
‹ Prev 1 4 5 6 7 8 10 Next ›