English
Related papers

Related papers: 3DreamBooth: High-Fidelity 3D Subject-Driven Video…

200 papers

Video personalization methods allow us to synthesize videos with specific concepts such as people, pets, and places. However, existing methods often focus on limited domains, require time-consuming optimization per subject, or support only…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Tsai-Shien Chen , Aliaksandr Siarohin , Willi Menapace , Yuwei Fang , Kwot Sin Lee , Ivan Skorokhodov , Kfir Aberman , Jun-Yan Zhu , Ming-Hsuan Yang , Sergey Tulyakov

Existing image editing tools, while powerful, typically disregard the underlying 3D geometry from which the image is projected. As a result, edits made using these tools may become detached from the geometry and lighting conditions that are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Oscar Michel , Anand Bhattad , Eli VanderBilt , Ranjay Krishna , Aniruddha Kembhavi , Tanmay Gupta

Existing methods for human motion control in video generation typically rely on either 2D poses or explicit 3D parametric models (e.g., SMPL) as control signals. However, 2D poses rigidly bind motion to the driving viewpoint, precluding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zhixue Fang , Xu He , Songlin Tang , Haoxian Zhang , Qingfeng Li , Xiaoqiang Liu , Pengfei Wan , Kun Gai

Recent advancements in leveraging pre-trained 2D diffusion models achieve the generation of high-quality novel views from a single in-the-wild image. However, existing works face challenges in producing controllable novel views due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yunhan Yang , Shuo Chen , Yukun Huang , Xiaoyang Wu , Yuan-Chen Guo , Edmund Y. Lam , Hengshuang Zhao , Tong He , Xihui Liu

Previous Vision-Language-Action models face critical limitations in navigation: scarce, diverse data from labor-intensive collection and static representations that fail to capture temporal dynamics and physical laws. We propose NavDreamer,…

Robotics · Computer Science 2026-02-11 Xijie Huang , Weiqi Gai , Tianyue Wu , Congyu Wang , Zhiyang Liu , Xin Zhou , Yuze Wu , Fei Gao

We present 3DScenePrompt, a framework that generates the next video chunk from arbitrary-length input while enabling precise camera control and preserving scene consistency. Unlike methods conditioned on a single image or a short clip, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 JoungBin Lee , Jaewoo Jung , Jisang Han , Takuya Narihira , Kazumi Fukuda , Junyoung Seo , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Despite recent advances in video generation, existing models still lack fine-grained controllability, especially for multi-subject customization with consistent identity and interaction. In this paper, we propose PolyVivid, a multi-subject…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Teng Hu , Zhentao Yu , Zhengguang Zhou , Jiangning Zhang , Yuan Zhou , Qinglin Lu , Ran Yi

Recent advances in generative modeling have enabled the generation of high-quality synthetic data that is applicable in a variety of domains, including face recognition. Here, state-of-the-art generative models typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Darian Tomašević , Fadi Boutros , Chenhao Lin , Naser Damer , Vitomir Štruc , Peter Peer

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

Generating high-fidelity upper-body 3D avatars from one-shot input image remains a significant challenge. Current 3D avatar generation methods, which rely on large reconstruction models, are fast and capable of producing stable body…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Fan Yang , Heyuan Li , Peihao Li , Weihao Yuan , Lingteng Qiu , Chaoyue Song , Cheng Chen , Yisheng He , Shifeng Zhang , Xiaoguang Han , Steven Hoi , Guosheng Lin

Recently, the field of text-guided 3D scene generation has garnered significant attention. High-quality generation that aligns with physical realism and high controllability is crucial for practical 3D scene applications. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yang Zhou , Zongjin He , Qixuan Li , Chao Wang

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Motion transfer of talking-head videos involves generating a new video with the appearance of a subject video and the motion pattern of a driving video. Current methodologies primarily depend on a limited number of subject images and 2D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Haomiao Ni , Jiachen Liu , Yuan Xue , Sharon X. Huang

Recent advances in modeling 3D objects mostly rely on synthetic datasets due to the lack of large-scale realscanned 3D databases. To facilitate the development of 3D perception, reconstruction, and generation in the real world, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Tong Wu , Jiarui Zhang , Xiao Fu , Yuxin Wang , Jiawei Ren , Liang Pan , Wayne Wu , Lei Yang , Jiaqi Wang , Chen Qian , Dahua Lin , Ziwei Liu

Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promising directions: multiview generative models that train on 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Junlin Hao , Peiheng Wang , Haoyang Wang , Xinggong Zhang , Zongming Guo

Generating human videos with realistic and controllable motions is a challenging task. While existing methods can generate visually compelling videos, they lack separate control over four key video elements: foreground subject, background…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Jingyun Liang , Jingkai Zhou , Shikai Li , Chenjie Cao , Lei Sun , Yichen Qian , Weihua Chen , Fan Wang

We present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jingxiang Sun , Bo Zhang , Ruizhi Shao , Lizhen Wang , Wen Liu , Zhenda Xie , Yebin Liu

3D Single Object Tracking (SOT) stands a forefront task of computer vision, proving essential for applications like autonomous driving. Sparse and occluded data in scene point clouds introduce variations in the appearance of tracked…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Jiaming Liu , Yue Wu , Maoguo Gong , Qiguang Miao , Wenping Ma , Can Qin

Recently, text-guided 3D generative methods have made remarkable advancements in producing high-quality textures and geometry, capitalizing on the proliferation of large vision-language and image diffusion models. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Xiao Han , Yukang Cao , Kai Han , Xiatian Zhu , Jiankang Deng , Yi-Zhe Song , Tao Xiang , Kwan-Yee K. Wong

Diffusion Transformer has shown remarkable abilities in generating high-fidelity videos, delivering visually coherent frames and rich details over extended durations. However, existing video generation models still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zhaoyang Li , Dongjun Qian , Kai Su , Qishuai Diao , Xiangyang Xia , Chang Liu , Wenfei Yang , Tianzhu Zhang , Zehuan Yuan