中文
相关论文

相关论文: Magic-Me: Identity-Specific Video Customized Diffu…

200 篇论文

Recent years have witnessed the strong power of 3D generation models, which offer a new level of creative flexibility by allowing users to guide the 3D content generation process through a single image or natural language. However, it…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Fangfu Liu , Hanyang Wang , Weiliang Chen , Haowen Sun , Yueqi Duan

Text-to-video (T2V) generation has advanced rapidly, yet maintaining consistent character identities across scenes remains a major challenge. Existing personalization methods often focus on facial identity but fail to preserve broader…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Ziyang Mai , Yu-Wing Tai

Multi-view generation with camera pose control and prompt-based customization are both essential elements for achieving controllable generative models. However, existing multi-view generation models do not support customization with…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Minjung Shin , Hyunin Cho , Sooyeon Go , Jin-Hwa Kim , Youngjung Uh

Achieving fine-grained control over subject identity and semantic attributes (pose, style, lighting) in text-to-image generation, particularly for multiple subjects, often undermines the editability and coherence of Diffusion Transformers…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Bowen Chen , Mengyi Zhao , Haomiao Sun , Li Chen , Xu Wang , Kang Du , Xinglong Wu

Recent advances in generative AI have dramatically improved photorealistic image synthesis, yet they fall short for studio-level multi-object compositing. This task demands simultaneous (i) near-perfect preservation of each item's identity,…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Gemma Canet Tarrés , Manel Baradad , Francesc Moreno-Noguer , Yumeng Li

Portrait customization (PC) has recently garnered significant attention due to its potential applications. However, existing PC methods lack precise identity (ID) preservation and face control. To address these tissues, we propose Diff-PC,…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Yifang Xu , Benxiang Zhai , Chenyu Zhang , Ming Li , Yang Li , Sidan Du

Video virtual try-on aims to generate realistic sequences that maintain garment identity and adapt to a person's pose and body shape in source videos. Traditional image-based methods, relying on warping and blending, struggle with complex…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Zijian He , Peixin Chen , Guangrun Wang , Guanbin Li , Philip H. S. Torr , Liang Lin

Benefiting from the rapid development of 2D diffusion models, 3D content generation has witnessed significant progress. One promising solution is to finetune the pre-trained 2D diffusion models to produce multi-view images and then…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Fan Yang , Jianfeng Zhang , Yichun Shi , Bowen Chen , Chenxu Zhang , Huichao Zhang , Xiaofeng Yang , Xiu Li , Jiashi Feng , Guosheng Lin

Diffusion-based methods can generate realistic images and videos, but they struggle to edit existing objects in a video while preserving their appearance over time. This prevents diffusion models from being applied to natural video editing…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Wenhao Chai , Xun Guo , Gaoang Wang , Yan Lu

Text-guided image-to-video (I2V) generation aims to generate a coherent video that preserves the identity of the input image and semantically aligns with the input prompt. Existing methods typically augment pretrained text-to-video (T2V)…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Xun Guo , Mingwu Zheng , Liang Hou , Yuan Gao , Yufan Deng , Pengfei Wan , Di Zhang , Yufan Liu , Weiming Hu , Zhengjun Zha , Haibin Huang , Chongyang Ma

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

Customized video generation aims to produce videos featuring specific subjects under flexible user-defined conditions, yet existing methods often struggle with identity consistency and limited input modalities. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Teng Hu , Zhentao Yu , Zhengguang Zhou , Sen Liang , Yuan Zhou , Qin Lin , Qinglin Lu

Recently, 3D generation methods have shown their powerful ability to automate 3D model creation. However, most 3D generation methods only rely on an input image or a text prompt to generate a 3D model, which lacks the control of each…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Peng Li , Suizhi Ma , Jialiang Chen , Yuan Liu , Congyi Zhang , Wei Xue , Wenhan Luo , Alla Sheffer , Wenping Wang , Yike Guo

Existing video generation models struggle to follow complex text prompts and synthesize multiple objects, raising the need for additional grounding input for improved controllability. In this work, we propose to decompose videos into visual…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Weixi Feng , Chao Liu , Sifei Liu , William Yang Wang , Arash Vahdat , Weili Nie

The diversity, quantity, and quality of manipulation data are critical for training effective robot policies. However, due to hardware and physical setup constraints, collecting large-scale real-world manipulation data remains difficult to…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Boyang Wang , Haoran Zhang , Shujie Zhang , Jinkun Hao , Mingda Jia , Qi Lv , Yucheng Mao , Zhaoyang Lyu , Jia Zeng , Xudong Xu , Jiangmiao Pang

Despite significant advancements in customizing text-to-image and video generation models, generating images and videos that effectively integrate multiple personalized concepts remains a challenging task. To address this, we present…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Gihyun Kwon , Jong Chul Ye

Controllable video generation has attracted significant attention, largely due to advances in video diffusion models. In domains such as autonomous driving, it is essential to develop highly accurate predictions for object motions. This…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Ge Ya Luo , Zhi Hao Luo , Anthony Gosselin , Alexia Jolicoeur-Martineau , Christopher Pal

Text-to-image (T2I) models have significantly advanced the development of artificial intelligence, enabling the generation of high-quality images in diverse contexts based on specific text prompts. However, existing T2I-based methods often…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Salaheldin Mohamed , Dong Han , Yong Li

Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zeren Xiong , Yue Yu , Zedong Zhang , Shuo Chen , Jian Yang , Jun Li