English
Related papers

Related papers: 3DreamBooth: High-Fidelity 3D Subject-Driven Video…

200 papers

Generating customized content in videos has received increasing attention recently. However, existing works primarily focus on customized text-to-video generation for single subject, suffering from subject-missing and attribute-binding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hong Chen , Xin Wang , Yipeng Zhang , Yuwei Zhou , Zeyang Zhang , Siao Tang , Wenwu Zhu

Despite the promising progress in subject-driven image generation, current models often deviate from the reference identities and struggle in complex scenes with multiple subjects. To address this challenge, we introduce OpenSubject, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yexin Liu , Manyuan Zhang , Yueze Wang , Hongyu Li , Dian Zheng , Weiming Zhang , Changsheng Lu , Xunliang Cai , Yan Feng , Peng Pei , Harry Yang

The continuous development of foundational models for video generation is evolving into various applications, with subject-consistent video generation still in the exploratory stage. We refer to this as Subject-to-Video, which extracts…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Lijie Liu , Tianxiang Ma , Bingchuan Li , Zhuowei Chen , Jiawei Liu , Gen Li , Siyu Zhou , Qian He , Xinglong Wu

With the rapid advancement of 3D representation techniques and generative models, substantial progress has been made in reconstructing full-body 3D avatars from a single image. However, this task remains fundamentally ill-posedness due to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Gaofeng Liu , Hengsen Li , Ruoyu Gao , Xuetong Li , Zhiyuan Ma , Tao Fang

Due to the demand for personalizing image generation, subject-driven text-to-image generation method, which creates novel renditions of an input subject based on text prompts, has received growing research interest. Existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Shang Chai , Zihang Lin , Min Zhou , Xubin Li , Liansheng Zhuang , Houqiang Li

Personalization has emerged as a prominent aspect within the field of generative AI, enabling the synthesis of individuals in diverse contexts and styles, while retaining high-fidelity to their identities. However, the process of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Wei Wei , Tingbo Hou , Yael Pritch , Neal Wadhwa , Michael Rubinstein , Kfir Aberman

Generative models for 3D object synthesis have seen significant advancements with the incorporation of prior knowledge distilled from 2D diffusion models. Nevertheless, challenges persist in the form of multi-view geometric inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Lincong Feng , Muyu Wang , Maoyu Wang , Kuo Xu , Xiaoli Liu

This paper introduces MultiBooth, a novel and efficient technique for multi-concept customization in image generation from text. Despite the significant advancements in customized generation methods, particularly with the success of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Chenyang Zhu , Kai Li , Yue Ma , Chunming He , Xiu Li

Recent advances in subject-driven image generation using diffusion models have attracted considerable attention for their remarkable capabilities in producing high-quality images. Nevertheless, the potential of Visual Autoregressive (VAR)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xin Jiang , Jingwen Chen , Yehao Li , Yingwei Pan , Kezhou Chen , Zechao Li , Ting Yao , Tao Mei

3D assets are essential in the digital age. While automatic 3D generation, such as image-to-3d, has made significant strides in recent years, it often struggles to achieve fast, detailed, and high-fidelity generation simultaneously. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Huanning Dong , Yinuo Huang , Fan Li , Ping Kuang

Relational video customization refers to the creation of personalized videos that depict user-specified relations between two subjects, a crucial task for comprehending real-world visual content. While existing methods can personalize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yujie Wei , Shiwei Zhang , Hangjie Yuan , Biao Gong , Longxiang Tang , Xiang Wang , Haonan Qiu , Hengjia Li , Shuai Tan , Yingya Zhang , Hongming Shan

Storyboard synthesis plays a crucial role in visual storytelling, aiming to generate coherent shot sequences that visually narrate cinematic events with consistent characters, scenes, and transitions. However, existing approaches are mostly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junjia Huang , Binbin Yang , Pengxiang Yan , Jiyang Liu , Bin Xia , Zhao Wang , Yitong Wang , Liang Lin , Guanbin Li

The "one-shot" technique represents a distinct and sophisticated aesthetic in filmmaking. However, its practical realization is often hindered by prohibitive costs and complex real-world constraints. Although emerging video generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiawei Liu , Junqiao Li , Jiangfan Deng , Gen Li , Siyu Zhou , Zetao Fang , Shanshan Lao , Zengde Deng , Jianing Zhu , Tingting Ma , Jiayi Li , Yunqiu Wang , Qian He , Xinglong Wu

Diffusion-based video motion customization facilitates the acquisition of human motion representations from a few video samples, while achieving arbitrary subjects transfer through precise textual conditioning. Existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Shuai Tan , Biao Gong , Yujie Wei , Shiwei Zhang , Zhuoxin Liu , Ke Ma , Yan Wang , Kecheng Zheng , Xing Zhu , Yujun Shen , Hengshuang Zhao

Multi-view image diffusion models have significantly advanced open-domain 3D object generation. However, most existing models rely on 2D network architectures that lack inherent 3D biases, resulting in compromised geometric consistency. To…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Hansheng Chen , Bokui Shen , Yulin Liu , Ruoxi Shi , Linqi Zhou , Connor Z. Lin , Jiayuan Gu , Hao Su , Gordon Wetzstein , Leonidas Guibas

Camera-controlled generative video re-rendering methods, such as ReCamMaster, have achieved remarkable progress. However, despite their success in single-view setting, these works often struggle to maintain consistency across multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Xiao Fu , Shitao Tang , Min Shi , Xian Liu , Jinwei Gu , Ming-Yu Liu , Dahua Lin , Chen-Hsuan Lin

We present a novel video generation framework that integrates 3-dimensional geometry and dynamic awareness. To achieve this, we augment 2D videos with 3D point trajectories and align them in pixel space. The resulting 3D-aware video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yunuo Chen , Junli Cao , Vidit Goel , Sergei Korolev , Chenfanfu Jiang , Jian Ren , Sergey Tulyakov , Anil Kag

This paper aims to manipulate multi-entity 3D motions in video generation. Previous methods on controllable video generation primarily leverage 2D control signals to manipulate object motions and have achieved remarkable synthesis results.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xiao Fu , Xian Liu , Xintao Wang , Sida Peng , Menghan Xia , Xiaoyu Shi , Ziyang Yuan , Pengfei Wan , Di Zhang , Dahua Lin

3D content creation from a single image is a long-standing yet highly desirable task. Recent advances introduce 2D diffusion priors, yielding reasonable results. However, existing methods are not hyper-realistic enough for post-generation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Tong Wu , Zhibing Li , Shuai Yang , Pan Zhang , Xinggang Pan , Jiaqi Wang , Dahua Lin , Ziwei Liu

Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xu Peng , Junwei Zhu , Boyuan Jiang , Ying Tai , Donghao Luo , Jiangning Zhang , Wei Lin , Taisong Jin , Chengjie Wang , Rongrong Ji