中文
相关论文

相关论文: UniMC: Taming Diffusion Transformer for Unified Ke…

200 篇论文

Latent diffusion models (LDM) have revolutionized text-to-image generation, leading to the proliferation of various advanced models and diverse downstream applications. However, despite these significant advancements, current diffusion…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Jiacheng Zhang , Jie Wu , Yuxi Ren , Xin Xia , Huafeng Kuang , Pan Xie , Jiashi Li , Xuefeng Xiao , Weilin Huang , Shilei Wen , Lean Fu , Guanbin Li

Recent years have seen remarkable progress in both multimodal understanding models and image generation models. Despite their respective successes, these two domains have evolved independently, leading to distinct architectural paradigms:…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Shanshan Zhao , Xinjie Zhang , Jintao Guo , Jiakui Hu , Lunhao Duan , Minghao Fu , Yong Xien Chng , Guo-Hua Wang , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Unified multimodal models (UMMs) have emerged as a powerful paradigm in fundamental cross-modality research, demonstrating significant potential in both image understanding and generation. However, existing research in the face domain…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Junzhe Li , Sifan Zhou , Liya Guo , Xuerui Qiu , Linrui Xu , Delin Qu , Tingting Long , Chun Fan , Ming Li , Hehe Fan , Jun Liu , Shuicheng Yan

Latent diffusion models (LDMs) enable high-fidelity synthesis by operating in learned latent spaces. However, training state-of-the-art LDMs requires complex staging: a tokenizer must be trained first, before the diffusion model can be…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Shivam Duggal , Xingjian Bai , Zongze Wu , Richard Zhang , Eli Shechtman , Antonio Torralba , Phillip Isola , William T. Freeman

Multi-reference image generation aims to synthesize images from textual instructions while faithfully preserving subject identities from multiple reference images. Existing VLM-enhanced diffusion models commonly rely on decoupled visual…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Yiyan Xu , Qiulin Wang , Wenjie Wang , Yunyao Mao , Xintao Wang , Pengfei Wan , Kun Gai , Fuli Feng

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Multi-subject image generation aims to synthesize images that faithfully preserve the identities of multiple reference subjects while following textual instructions. However, existing methods often suffer from identity inconsistency and…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Yijia Xu , Zihao Wang , Jinshi Cui

Image fusion aims to integrate complementary information from multiple source images to produce a more informative and visually consistent representation, benefiting both human perception and downstream vision tasks. Despite recent…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Xingyuan Li , Songcheng Du , Yang Zou , HaoYuan Xu , Zhiying Jiang , Jinyuan Liu

Deep learning techniques have implemented many unconditional image generation (UIG) models, such as GAN, Diffusion model, etc. The extremely realistic images (also known as AI-Generated Content, AIGC for short) produced by these models…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Ruinan Ma , Yu-an Tan , Shangbo Wu , Tian Chen , Yajie Wang , Yuanzhang Li

Human motion synthesis in complex scenes presents a fundamental challenge, extending beyond conventional Text-to-Motion tasks by requiring the integration of diverse modalities such as static environments, movable objects, natural language…

图形学 · 计算机科学 2025-05-20 Zichen Geng , Zeeshan Hayder , Wei Liu , Ajmal Mian

Unified Multimodal Models (UMMs) integrate multimodal understanding and generation, yet they are limited to maintaining visual consistency and disambiguating visual cues when referencing details across multiple input images. In this work,…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Pengcheng Xu , Peng Tang , Donghao Luo , Xiaobin Hu , Weichu Cui , Qingdong He , Zhennan Chen , Jiangning Zhang , Charles Ling , Boyu Wang

Image restoration is essential for enhancing degraded images across computer vision tasks. However, most existing methods address only a single type of degradation (e.g., blur, noise, or haze) at a time, limiting their real-world…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Debabrata Mandal , Soumitri Chattopadhyay , Guansen Tong , Praneeth Chakravarthula

Recent years have witnessed the prevailing progress of Generative Adversarial Networks (GANs) in image-to-image translation. However, the success of these GAN models hinges on ponderous computational costs and labor-expensive training data.…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Yuxi Ren , Jie Wu , Peng Zhang , Manlin Zhang , Xuefeng Xiao , Qian He , Rui Wang , Min Zheng , Xin Pan

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Quantum computing is a transformative technology with wide-ranging applications, and efficient quantum circuit generation is crucial for unlocking its full potential. Current diffusion model approaches based on U-Net architectures, while…

机器学习 · 计算机科学 2025-01-29 Zhiwei Chen , Hao Tang

Existing defect/anomaly generation methods often rely on few-shot learning, which overfits to specific defect categories due to the lack of large-scale paired defect editing data. This issue is aggravated by substantial variations in defect…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Yuanting Fan , Jun Liu , Bin-Bin Gao , Xiaochen Chen , Yuhuan Lin , Zhewei Dai , Jiawei Zhan , Chengjie Wang

Text-to-image generation has greatly advanced content creation, yet accurately rendering visual text remains a key challenge due to blurred glyphs, semantic drift, and limited style control. Existing methods often rely on pre-rendered glyph…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Yuanrui Wang , Cong Han , Yafei Li , Zhipeng Jin , Xiawei Li , SiNan Du , Wen Tao , Yi Yang , Shuanglong Li , Chun Yuan , Liu Lin

Recent works have made notable advancements in enhancing unified models for text-to-image generation through the Chain-of-Thought (CoT). However, these reasoning methods separate the processes of understanding and generation, which limits…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Yuanhuiyi Lyu , Chi Kit Wong , Chenfei Liao , Lutao Jiang , Xu Zheng , Zexin Lu , Linfeng Zhang , Xuming Hu

In practical AI workflows, complex tasks often involve chaining multiple generative models, such as using a video or 3D generation model after a 2D image generator. However, distributional mismatches between the output of upstream models…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yujie Zhou , Pengyang Ling , Jiazi Bu , Bingjie Gao , Li Niu

While diffusion models are powerful in generating high-quality, diverse synthetic data for object-centric tasks, existing methods struggle with scene-aware tasks such as Visual Question Answering (VQA) and Human-Object Interaction (HOI)…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Minh-Quan Le , Gaurav Mittal , Tianjian Meng , A S M Iftekhar , Vishwas Suryanarayanan , Barun Patra , Dimitris Samaras , Mei Chen