中文
相关论文

相关论文: Have we unified image generation and understanding…

200 篇论文

Recently, the visual generation ability by GPT-4o(mni) has been unlocked by OpenAI. It demonstrates a very remarkable generation capability with excellent multimodal condition understanding and varied task instructions. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Pu Cao , Feng Zhou , Junyi Ji , Qingye Kong , Zhixiang Lv , Mingjian Zhang , Xuekun Zhao , Siqi Wu , Yinghui Lin , Qing Song , Lu Yang

The landscape of image generation has rapidly evolved, from early GAN-based approaches to diffusion models and, most recently, to unified generative architectures that seek to bridge understanding and generation tasks. Recent advances,…

The recent breakthroughs in OpenAI's GPT4o model have demonstrated surprisingly good capabilities in image generation and editing, resulting in significant excitement in the community. This technical report presents the first-look…

计算机视觉与模式识别 · 计算机科学 2025-05-05 Zhiyuan Yan , Junyan Ye , Weijia Li , Zilong Huang , Shenghai Yuan , Xiangyang He , Kaiqing Lin , Jun He , Conghui He , Li Yuan

The performance of unified multimodal models for image generation and editing is fundamentally constrained by the quality and comprehensiveness of their training data. While existing datasets have covered basic tasks like style transfer and…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zhihong Chen , Xuehai Bai , Yang Shi , Chaoyou Fu , Huanyu Zhang , Haotian Wang , Xiaoyan Sun , Zhang Zhang , Liang Wang , Yuanxing Zhang , Pengfei Wan , Yi-Fan Zhang

Although existing unified models achieve strong performance in vision-language understanding and text-to-image generation, they remain limited in addressing image perception and manipulation -- capabilities increasingly demanded in…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Bin Lin , Zongjian Li , Xinhua Cheng , Yuwei Niu , Yang Ye , Xianyi He , Shenghai Yuan , Wangbo Yu , Shaodong Wang , Yunyang Ge , Yatian Pang , Li Yuan

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

As large language models (LLMs) continue to advance, evaluating their comprehensive capabilities becomes significant for their application in various fields. This research study comprehensively evaluates the language, vision, speech, and…

Recently, GPT-4o has garnered significant attention for its strong performance in image generation, yet open-source models still lag behind. Several studies have explored distilling image data from GPT-4o to enhance open-source models,…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Junyan Ye , Dongzhi Jiang , Zihao Wang , Leqi Zhu , Zhenghao Hu , Zilong Huang , Jun He , Zhiyuan Yan , Jinghua Yu , Hongsheng Li , Conghui He , Weijia Li

Recent years have seen remarkable progress in both multimodal understanding models and image generation models. Despite their respective successes, these two domains have evolved independently, leading to distinct architectural paradigms:…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Shanshan Zhao , Xinjie Zhang , Jintao Guo , Jiakui Hu , Lunhao Duan , Minghao Fu , Yong Xien Chng , Guo-Hua Wang , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

CG (Computer Graphics) is a popular field of CS (Computer Science), but many students find this topic difficult due to it requiring a large number of skills, such as mathematics, programming, geometric reasoning, and creativity. Over the…

人工智能 · 计算机科学 2024-10-23 Tony Haoran Feng , Paul Denny , Burkhard C. Wünsche , Andrew Luxton-Reilly , Jacqueline Whalley

This paper explores the image synthesis capabilities of GPT-4, a leading multi-modal large language model. We establish a benchmark for evaluating the fidelity of texture features in images generated by GPT-4, comprising manually painted…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Wentao Wang , Xuanyao Huang , Tianyang Wang , Swalpa Kumar Roy

The rapid development of AIGC foundation models has revolutionized the paradigm of image compression, which paves the way for the abandonment of most pixel-level transform and coding, compelling us to ask: why compress what you can generate…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Yixin Gao , Xiaohan Pan , Xin Li , Zhibo Chen

Recent advances in OpenAI's GPT-series multimodal generation models have shown remarkable capabilities in producing visually compelling images. In this work, we investigate its potential impact on the image restoration community. We…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Hao Yang , Yan Yang , Ruikun Zhang , Liyuan Pan

The transition from task-specific artificial intelligence toward general-purpose foundation models raises fundamental questions about their capacity to support the integrated reasoning required in clinical medicine, where diagnosis demands…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Alexandru Florea , Shansong Wang , Mingzhe Hu , Qiang Li , Zach Eidex , Luke del Balzo , Mojtaba Safari , Xiaofeng Yang

Recent advances in multimodal generative models have unlocked photorealistic, instruction-aligned image generation, yet leading systems like GPT-4o-Image remain proprietary and inaccessible. To democratize these capabilities, we present…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Junying Chen , Zhenyang Cai , Pengcheng Chen , Shunian Chen , Ke Ji , Xidong Wang , Yunjin Yang , Benyou Wang

Multimodal foundation models (MFMs), such as GPT-4o, have recently made remarkable progress. However, their detailed visual understanding beyond question answering remains unclear. In this paper, we benchmark popular MFMs (GPT-4o, o4-mini,…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Rahul Ramachandran , Ali Garjani , Roman Bachmann , Andrei Atanov , Oğuzhan Fatih Kar , Amir Zamir

This study extends previous research on spatial representations in multimodal AI systems. Although current models demonstrate a rich understanding of spatial information from images, this information is rooted in propositional…

人工智能 · 计算机科学 2024-09-24 Bridget Leonard , Kristin Woodard , Scott O. Murray

Unified multimodal models often struggle with complex synthesis tasks that demand deep reasoning, and typically treat text-to-image generation and image editing as isolated capabilities rather than interconnected reasoning steps. To address…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Dianyi Wang , Chaofan Ma , Feng Han , Size Wu , Wei Song , Yibin Wang , Zhixiong Zhang , Tianhang Wang , Siyuan Wang , Zhongyu Wei , Jiaqi Wang

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for producing…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Daoan Zhang , Che Jiang , Ruoshi Xu , Biaoxiang Chen , Zijian Jin , Yutian Lu , Jianguo Zhang , Liang Yong , Jiebo Luo , Shengda Luo

The recent GPT-4 has demonstrated extraordinary multi-modal abilities, such as directly generating websites from handwritten text and identifying humorous elements within images. These features are rarely observed in previous…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Deyao Zhu , Jun Chen , Xiaoqian Shen , Xiang Li , Mohamed Elhoseiny
‹ 上一页 1 2 3 10 下一页 ›