中文
相关论文

相关论文: MultiBanana: A Challenging Benchmark for Multi-Ref…

200 篇论文

Multimodal text-to-image generation remains constrained by the difficulty of maintaining semantic alignment and professional-level detail across diverse visual domains. We propose a multi-agent reinforcement learning framework that…

人工智能 · 计算机科学 2025-10-14 Jiabao Shi , Minfeng Qi , Lefeng Zhang , Di Wang , Yingjie Zhao , Ziying Li , Yalong Xing , Ningran Li

Text-to-image generative models are capable of producing high-quality images that often faithfully depict concepts described using natural language. In this work, we comprehensively evaluate a range of text-to-image models on numerical…

Real-world design tasks - such as picture book creation, film storyboard development using character sets, photo retouching, visual effects, and font transfer - are highly diverse and complex, requiring deep interpretation and extraction of…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Chen Liang , Lianghua Huang , Jingwu Fang , Huanzhang Dou , Wei Wang , Zhi-Fan Wu , Yupeng Shi , Junge Zhang , Xin Zhao , Yu Liu

As the use of text-to-image generative models increases, so does the adoption of automatic benchmarking methods used in their evaluation. However, while metrics and datasets abound, there are few unified benchmarking libraries that provide…

Generative models have driven significant progress in a variety of AI tasks, including text-to-video generation, where models like Video LDM and Stable Video Diffusion can produce realistic, movie-level videos from textual instructions.…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Xuyang Guo , Zekai Huang , Jiayan Huo , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang

Pre-training backbone networks on a general annotated dataset (e.g., ImageNet) that comprises numerous manually collected images with category annotations has proven to be indispensable for enhancing the generalization capacity of…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Dengyang Jiang , Haoyu Wang , Lei Zhang , Wei Wei , Guang Dai , Mengmeng Wang , Jingdong Wang , Yanning Zhang

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story, where the images should be realistic and keep global consistency across dynamic scenes and characters. Current works face the…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Bowen Li , Thomas Lukasiewicz

Diffusion models have shown impressive performance in many visual generation and manipulation tasks. Many existing methods focus on training a model for a specific task, especially, text-to-video (T2V) generation, while many other works…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Ruibin Li , Tao Yang , Yangming Shi , Weiguo Feng , Shilei Wen , Bingyue Peng , Lei Zhang

In the current research landscape, multimodal autoregressive (AR) models have shown exceptional capabilities across various domains, including visual understanding and generation. However, complex tasks such as style-aligned text-to-image…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Yi Wu , Lingting Zhu , Shengju Qian , Lei Liu , Wandi Qiao , Lequan Yu , Bin Li

Visual narrative generation transforms textual narratives into sequences of images illustrating the content of the text. However, generating visual narratives that are faithful to the input text and self-consistent across generated images…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Silin Gao , Sheryl Mathew , Li Mi , Sepideh Mamooler , Mengjie Zhao , Hiromi Wakaki , Yuki Mitsufuji , Syrielle Montariol , Antoine Bosselut

Deep generative models have led to significant advances in cross-modal generation such as text-to-image synthesis. Training these models typically requires paired data with direct correspondence between modalities. We introduce the novel…

计算机视觉与模式识别 · 计算机科学 2019-08-21 Shuang Ma , Daniel McDuff , Yale Song

In this work, we introduce OmniGen2, a versatile and open-source generative model designed to provide a unified solution for diverse generation tasks, including text-to-image, image editing, and in-context generation. Unlike OmniGen v1,…

Text-to-image (T2I) generation aims to synthesize images from textual prompts, which jointly specify what must be shown and imply what can be inferred, which thus correspond to two core capabilities: \textbf{\textit{composition}} and…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Ouxiang Li , Yuan Wang , Xinting Hu , Huijuan Huang , Rui Chen , Jiarong Ou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Fuli Feng

Natural language often contains ambiguities that can lead to misinterpretation and miscommunication. While humans can handle ambiguities effectively by asking clarifying questions and/or relying on contextual cues and common-sense…

Recent advancements in image generation have made significant progress, yet existing models present limitations in perceiving and generating an arbitrary number of interrelated images within a broad context. This limitation becomes…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Ying Shen , Yizhe Zhang , Shuangfei Zhai , Lifu Huang , Joshua M. Susskind , Jiatao Gu

Multi-image Interleaved Reasoning aims to improve Multi-modal Large Language Models (MLLMs) ability to jointly comprehend and reason across multiple images and their associated textual contexts, introducing unique challenges beyond…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Hang Du , Jiayang Zhang , Guoshun Nan , Wendi Deng , Zhenyan Chen , Chenyang Zhang , Wang Xiao , Shan Huang , Yuqi Pan , Tao Qi , Sicong Leng

Benchmarks for large multimodal language models (MLMs) now serve to simultaneously assess the general capabilities of models instead of evaluating for a specific capability. As a result, when a developer wants to identify which models to…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Jieyu Zhang , Weikai Huang , Zixian Ma , Oscar Michel , Dong He , Tanmay Gupta , Wei-Chiu Ma , Ali Farhadi , Aniruddha Kembhavi , Ranjay Krishna

Recent advances in generative AI raise the question of whether general-purpose image editing models can serve as unified solutions for image restoration. We conduct a systematic evaluation of Nano Banana 2 across diverse scenes and…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Weixiong Sun , Xiang Yin , Chao Dong

Existing vision-language understanding benchmarks largely consist of images of objects in their usual contexts. As a consequence, recent multimodal large language models can perform well with only a shallow visual understanding by relying…