English
Related papers

Related papers: HunyuanImage 3.0 Technical Report

200 papers

Recently, it has become progressively more evident that classic diagnostic labels are unable to reliably describe the complexity and variability of several clinical phenotypes. This is particularly true for a broad range of neuropsychiatric…

Machine Learning · Computer Science 2024-02-28 Giovanna Maria Dimitri , Simeon Spasov , Andrea Duggento , Luca Passamonti , Pietro Li`o , Nicola Toschi

We present CM3Leon (pronounced "Chameleon"), a retrieval-augmented, token-based, decoder-only multi-modal language model capable of generating and infilling both text and images. CM3Leon uses the CM3 multi-modal architecture but…

Pre-trained language models have achieved state-of-the-art results in various Natural Language Processing (NLP) tasks. GPT-3 has shown that scaling up pre-trained language models can further exploit their enormous potential. A unified…

We present Qwen-Image-VAE-2.0, a suite of high-compression Variational Autoencoders (VAEs) that achieve significant advances in both reconstruction fidelity and diffusability. To address the reconstruction bottlenecks of high compression,…

The rapid advancement of AI-generated image (AIGI) models presents new challenges for evaluating image quality, particularly across three aspects: perceptual quality, prompt correspondence, and authenticity. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Chuan Cui , Kejiang Chen , Zhihua Wei , Wen Shen , Weiming Zhang , Nenghai Yu

We introduce UEval, a benchmark to evaluate unified models, i.e., models capable of generating both images and text. UEval comprises 1,000 expert-curated questions that require both images and text in the model output, sourced from 8…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Bo Li , Yida Yin , Wenhao Chai , Xingyu Fu , Zhuang Liu

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

We introduce Unimotion, the first unified multi-task human motion model capable of both flexible motion control and frame-level motion understanding. While existing works control avatar motion with global text conditioning, or with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Chuqiao Li , Julian Chibane , Yannan He , Naama Pearl , Andreas Geiger , Gerard Pons-moll

Recent advances in large language models (LLMs) have enabled multimodal foundation models to tackle both image understanding and generation within a unified framework. Despite these gains, unified models often underperform compared to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Zhiyang Xu , Jiuhai Chen , Zhaojiang Lin , Xichen Pan , Lifu Huang , Tianyi Zhou , Madian Khabsa , Qifan Wang , Di Jin , Michihiro Yasunaga , Lili Yu , Xi Victoria Lin , Shaoliang Nie

Recent advancements in Large Multimodal Models (LMMs) have significantly improved multimodal understanding and generation. However, these models still struggle to generate tightly interleaved image-text outputs, primarily due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yukang Feng , Jianwen Sun , Chuanhao Li , Zizhen Li , Jiaxin Ai , Fanrui Zhang , Yifan Chang , Sizhuo Zhou , Shenglin Zhang , Yu Dai , Kaipeng Zhang

Recently, unified multimodal models (UMMs) have made remarkable progress in integrating visual understanding and generation, demonstrating strong potential for complex text-to-image (T2I) tasks. Despite their theoretical promise, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jiadong Pan , Liang Li , Yuxin Peng , Yu-Ming Tang , Shuohuan Wang , Yu Sun , Hua Wu , Qingming Huang , Haifeng Wang

As information exists in various modalities in real world, effective interaction and fusion among multimodal information plays a key role for the creation and perception of multimodal data in computer vision and deep learning research. With…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Shijian Lu , Lingjie Liu , Adam Kortylewski , Christian Theobalt , Eric Xing

Unifying multimodal understanding and generation has shown impressive capabilities in cutting-edge proprietary systems. However, evaluations of unified multimodal models (UMMs) remain decoupled, assessing their understanding and generation…

Artificial Intelligence · Computer Science 2025-12-22 Kai Liu , Leyang Chen , Wenbo Li , Zhikai Chen , Zhixin Wang , Renjing Pei , Linghe Kong , Yulun Zhang

In this work, we share the insights for achieving state-of-the-art quality in our text-to-image anime image generative model, called Illustrious. To achieve high resolution, dynamic color range images, and high restoration ability, we focus…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Sang Hyun Park , Jun Young Koh , Junha Lee , Joy Song , Dongha Kim , Hoyeon Moon , Hyunju Lee , Min Song

With the rapid growth of e-commerce, exploring general representations rather than task-specific ones has attracted increasing attention. Although recent multimodal large language models (MLLMs) have driven significant progress in product…

Machine Learning · Computer Science 2026-04-03 Junxian Wu , Chenghan Fu , Zhanheng Nie , Daoze Zhang , Bowen Wan , Wanxian Guan , Chuan Yu , Jian Xu , Bo Zheng

This article introduces a benchmark designed to evaluate the capabilities of multimodal models in analyzing and interpreting images. The benchmark focuses on seven key visual aspects: main object, additional objects, background, detail,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Evgenii Evstafev

Instruction-based video editing is a natural way to control video content with text, but adapting a video generation model into an editor usually appears data-hungry. At the same time, high-quality video editing data remains scarce. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhefan Rao , Bin Zou , Haoxuan Che , Xuanhua He , Chong Hou Choi , Yanheng Li , Rui Liu , Qifeng Chen

We introduce InternVL3, a significant advancement in the InternVL series featuring a native multimodal pre-training paradigm. Rather than adapting a text-only large language model (LLM) into a multimodal large language model (MLLM) that…

Diffusion models have demonstrated remarkable performance in generating unimodal data across various tasks, including image, video, and text generation. On the contrary, the joint generation of multimodal data through diffusion models is…

Machine Learning · Computer Science 2025-06-16 Kevin Rojas , Yuchen Zhu , Sichen Zhu , Felix X. -F. Ye , Molei Tao

Recent work has shown the possibility of training generative models of 3D content from 2D image collections on small datasets corresponding to a single object class, such as human faces, animal faces, or cars. However, these models struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Kyle Sargent , Jing Yu Koh , Han Zhang , Huiwen Chang , Charles Herrmann , Pratul Srinivasan , Jiajun Wu , Deqing Sun