English
Related papers

Related papers: RealUnify: Do Unified Models Truly Benefit from Un…

200 papers

Recent large vision-language models (VLMs) remain fundamentally constrained by a persistent dichotomy: understanding and generation are treated as distinct problems, leading to fragmented architectures, cascaded pipelines, and misaligned…

Recent advances in unified multimodal models (UMM) have demonstrated remarkable progress in both understanding and generation tasks. However, whether these two capabilities are genuinely aligned and integrated within a single model remains…

Computation and Language · Computer Science 2026-02-03 Chenlong Wang , Yuhang Chen , Zhihan Hu , Dongping Chen , Wenhu Chen , Sarah Wiegreffe , Tianyi Zhou

Recognition and reasoning are two pillars of visual understanding. However, these tasks have an imbalance in focus; whereas recent advances in neural networks have shown strong empirical performance in visual recognition, there has been…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Calvin Luo , Boqing Gong , Ting Chen , Chen Sun

Current multimodal models aim to transcend the limitations of single-modality representations by unifying understanding and generation, often using text-to-image (T2I) tasks to calibrate semantic consistency. However, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Juanxi Tian , Siyuan Li , Conghui He , Lijun Wu , Cheng Tan

We introduce Generative Universal Verifier, a novel concept and plugin designed for next-generation multimodal reasoning in vision-language models and unified multimodal models, providing the fundamental capability of reflection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xinchen Zhang , Xiaoying Zhang , Youbin Wu , Yanbin Cao , Renrui Zhang , Ruihang Chu , Ling Yang , Yujiu Yang

Unifying diverse image generation tasks within a single framework remains a fundamental challenge in visual generation. While large language models (LLMs) achieve unification through task-agnostic data and generation, existing visual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yijing Lin , Mengqi Huang , Shuhan Zhuang , Zhendong Mao

Unified models (UMs) hold promise for their ability to understand and generate content across heterogeneous modalities. Compared to merely generating visual content, the use of UMs for interleaved cross-modal reasoning is more promising and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiachun Jin , Zetong Zhou , Xiao Yang , Hao Zhang , Pengfei Liu , Jun Zhu , Zhijie Deng

Recent advances in 3D vision have led to specialized models for either 3D understanding (e.g., shape classification, segmentation, reconstruction) or 3D generation (e.g., synthesis, completion, and editing). However, these tasks are often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Peng Huang , Yifeng Chen , Zeyu Zhang , Hao Tang

Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Current fusion methods are typically evaluated on a small selection of public datasets, a limited…

Machine Learning · Computer Science 2026-05-07 Leyan Xue , Changqing Zhang , Kecheng Xue , Xiaohong Liu , Guangyu Wang , Zongbo Han

Unified multimodal models have recently shown remarkable gains in both capability and versatility, yet most leading systems are still trained from scratch and require substantial computational resources. In this paper, we show that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeyu Wang , Zilong Chen , Chenhui Gou , Feng Li , Chaorui Deng , Deyao Zhu , Kunchang Li , Weihao Yu , Haoqin Tu , Haoqi Fan , Cihang Xie

The emergence of unified multimodal understanding and generation models is rapidly attracting attention because of their ability to enhance instruction-following capabilities while minimizing model redundancy. However, there is a lack of a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yi Li , Haonan Wang , Qixiang Zhang , Boyu Xiao , Chenchang Hu , Hualiang Wang , Xiaomeng Li

Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still struggle with handling diverse and complex image editing tasks that require implicit reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Yibin Wang , Chenglin Li , Zheming Liang , Dianyi Wang , Yang Jiao , Zhipeng Wei , Chao Gong , Cheng Jin , Jingjing Chen , Jiaqi Wang

The advent of Unified Multimodal Models (UMMs) signals a paradigm shift in artificial intelligence, moving from passive perception to active, cross-modal generation. Despite their unprecedented ability to synthesize information, a critical…

Artificial Intelligence · Computer Science 2026-01-15 Jingxuan Wei , Caijun Jia , Xi Bai , Xinglong Xu , Siyuan Li , Linzhuang Sun , Bihui Yu , Conghui He , Lijun Wu , Cheng Tan

Unified multimodal models provide a natural and promising architecture for understanding diverse and complex real-world knowledge while generating high-quality images. However, they still rely primarily on frozen parametric knowledge, which…

Image degradation from blur, noise, compression, and poor illumination severely undermines multimodal understanding in real-world settings. Unified multimodal models that combine understanding and generation within a single architecture are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xiangzhao Hao , Zefeng Zhang , Zhenyu Zhang , Linhao Yu , Yao Chen , Yiqian Zhang , Haiyun Guo , Shuohuan Wang , Yu Sun

Despite impressive progress in high-fidelity image synthesis, generative models still struggle with logic-intensive instruction following, exposing a persistent reasoning--execution gap. Meanwhile, closed-source systems (e.g., Nano Banana)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Sashuai Zhou , Qiang Zhou , Jijin Hu , Hanqing Yang , Yue Cao , Junpeng Ma , Yinchao Ma , Jun Song , Tiezheng Ge , Cheng Yu , Bo Zheng , Zhou Zhao

While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Le Zhuo , Songhao Han , Yuandong Pu , Boxiang Qiu , Sayak Paul , Yue Liao , Yihao Liu , Jie Shao , Xi Chen , Si Liu , Hongsheng Li

In recent years, significant progress has been made in both image generation and generated image detection. Despite their rapid, yet largely independent, development, these two fields have evolved distinct architectural paradigms: the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yanran Zhang , Wenzhao Zheng , Yifei Li , Bingyao Yu , Yu Zheng , Lei Chen , Jiwen Lu , Jie Zhou

Existing reasoning evaluation paradigms suffer from different limitations: fixed benchmarks are increasingly saturated and vulnerable to contamination, while preference-based evaluations rely on subjective judgments. We argue that a core…

Artificial Intelligence · Computer Science 2026-05-19 Baoqing Yue , Zihan Zhu , Yutong Han , Brian Fan , Qian Sun , Jichen Feng , Hufei Yang , Yifan Zhang , Mengdi Wang

Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual representations. However, what remains unknown is which visual properties models actually converge on and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Florian P. Mahner , Johannes Roth , Ka Chun Lam , Michael F. Bonner , Francisco Pereira , Martin N. Hebart