English
Related papers

Related papers: OpenGPT-4o-Image: A Comprehensive Dataset for Adva…

200 papers

Current instruction-based image editing (IBIE) methods struggle with challenging editing tasks, as both editing types and sample counts of existing datasets are limited. Moreover, traditional dataset construction often contains noisy…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Mingsong Li , Lin Liu , Hongjun Wang , Haoxing Chen , Xijun Gu , Shizhan Liu , Dong Gong , Junbo Zhao , Zhenzhong Lan , Jianguo Li

Ultra-high-resolution image synthesis holds significant potential, yet remains an underexplored challenge due to the absence of standardized benchmarks and computational constraints. In this paper, we establish Aesthetic-4K, a meticulously…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jinjin Zhang , Qiuyu Huang , Junjie Liu , Xiefan Guo , Di Huang

Driven by the remarkable progress in diffusion models, text-to-image generation has made significant strides, creating a pressing demand for automatic quality evaluation of generated images. Current state-of-the-art automatic evaluation…

Computation and Language · Computer Science 2024-11-26 Rong-Cheng Tu , Zi-Ao Ma , Tian Lan , Yuehao Zhao , Heyan Huang , Xian-Ling Mao

As large language models (LLMs) continue to advance, evaluating their comprehensive capabilities becomes significant for their application in various fields. This research study comprehensively evaluates the language, vision, speech, and…

Recent progress in unified models for image understanding and generation has been impressive, yet most approaches remain limited to single-modal generation conditioned on multiple modalities. In this paper, we present Mogao, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chao Liao , Liyang Liu , Xun Wang , Zhengxiong Luo , Xinyu Zhang , Wenliang Zhao , Jie Wu , Liang Li , Zhi Tian , Weilin Huang

Recent advances in OpenAI's GPT-series multimodal generation models have shown remarkable capabilities in producing visually compelling images. In this work, we investigate its potential impact on the image restoration community. We…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hao Yang , Yan Yang , Ruikun Zhang , Liyuan Pan

The scarcity of high-quality data remains a primary bottleneck in adapting multimodal generative models for medical image editing. Existing medical image editing datasets often suffer from limited diversity, neglect of medical image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yongfan Lai , Wen Qian , Bo Liu , Hongyan Li , Hao Luo , Fan Wang , Bohan Zhuang , Shenda Hong

The rapid advancement of generative AI has raised concerns about the authenticity of digital images, as highly realistic fake images can now be generated at low cost, potentially increasing societal risks. In response, several datasets have…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Hanzhe Yu , Yun Ye , Jintao Rong , Qi Xuan , Chen Ma

AI-generated content is becoming increasingly prevalent in the real world, leading to serious ethical and societal concerns. For instance, adversaries might exploit large multimodal models (LMMs) to create images that violate ethical or…

Computation and Language · Computer Science 2025-04-14 Hongchao Fang , Yixin Liu , Jiangshu Du , Can Qin , Ran Xu , Feng Liu , Lichao Sun , Dongwon Lee , Lifu Huang , Wenpeng Yin

Deep generative models, which target reproducing the given data distribution to produce novel samples, have made unprecedented advancements in recent years. Their technical breakthroughs have enabled unparalleled quality in the synthesis of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Mengping Yang , Zhe Wang

Unifying image understanding and generation has gained growing attention in recent research on multimodal models. Although design choices for image understanding have been extensively studied, the optimal model architecture and training…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jiuhai Chen , Zhiyang Xu , Xichen Pan , Yushi Hu , Can Qin , Tom Goldstein , Lifu Huang , Tianyi Zhou , Saining Xie , Silvio Savarese , Le Xue , Caiming Xiong , Ran Xu

Generative AI (GenAI) holds significant promise for automating everyday image editing tasks, especially following the recent release of GPT-4o on March 25, 2025. However, what subjects do people most often want edited? What kinds of editing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Mohammad Reza Taesiri , Brandon Collins , Logan Bolton , Viet Dac Lai , Franck Dernoncourt , Trung Bui , Anh Totti Nguyen

Currently, enhancing Unified Multimodal Models (UMMs) with image understanding, generation, and editing capabilities mainly relies on mixed multi-task training. Due to inherent task conflicts, such strategy requires complex multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Dian Zheng , Manyuan Zhang , Hongyu Li , Hongbo Liu , Kai Zou , Kaituo Feng , Hongsheng Li

This study introduces HQ-Edit, a high-quality instruction-based image editing dataset with around 200,000 edits. Unlike prior approaches relying on attribute guidance or human feedback on building datasets, we devise a scalable data…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mude Hui , Siwei Yang , Bingchen Zhao , Yichun Shi , Heng Wang , Peng Wang , Yuyin Zhou , Cihang Xie

Generating images conditioned on multiple visual references is critical for real-world applications such as multi-subject composition, narrative illustration, and novel view synthesis, yet current models suffer from severe performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhekai Chen , Yuqing Wang , Manyuan Zhang , Xihui Liu

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Qifan Yu , Wei Chow , Zhongqi Yue , Kaihang Pan , Yang Wu , Xiaoyang Wan , Juncheng Li , Siliang Tang , Hanwang Zhang , Yueting Zhuang

With the rapid advancement of large language models, there has been a growing interest in their capabilities in mathematical reasoning. However, existing research has primarily focused on text-based algebra problems, neglecting the study of…

Machine Learning · Computer Science 2024-09-17 Zihan Huang , Tao Wu , Wang Lin , Shengyu Zhang , Jingyuan Chen , Fei Wu

Thanks to the recent development of deep generative models, it is becoming possible to generate high-quality images with both fidelity and diversity. However, the training of such generative models requires a large dataset. To reduce the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Atsuhiro Noguchi , Tatsuya Harada

In this report, we introduce Ovis-U1, a 3-billion-parameter unified model that integrates multimodal understanding, text-to-image generation, and image editing capabilities. Building on the foundation of the Ovis series, Ovis-U1…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Guo-Hua Wang , Shanshan Zhao , Xinjie Zhang , Liangfu Cao , Pengxin Zhan , Lunhao Duan , Shiyin Lu , Minghao Fu , Xiaohao Chen , Jianshan Zhao , Yang Li , Qing-Guo Chen

Unified multimodal generative models aim to integrate image understanding and generation abilities, offering significant advantages in harnessing multimodal corpora, particularly interleaved text-image data. However, existing unified models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Hong Zhang , Zhongjie Duan , Xingjun Wang , Yuze Zhao , Weiyi Lu , Zhipeng Di , Yixuan Xu , Yingda Chen , Yu Zhang