English
Related papers

Related papers: AnyDoor: Zero-shot Object-level Image Customizatio…

200 papers

Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Jiawei Ren , Mengmeng Xu , Jui-Chieh Wu , Ziwei Liu , Tao Xiang , Antoine Toisoul

Specifying nuanced and compelling camera motion remains a significant hurdle for non-expert creators using generative tools, creating an "expressive gap" where generic text prompts fail to capture cinematic vision. This barrier limits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pooja Guhan , Divya Kothandaraman , Geonsun Lee , Tsung-Wei Huang , Guan-Ming Su , Dinesh Manocha

Recent developments in generative diffusion models have turned many dreams into realities. For video object insertion, existing methods typically require additional information, such as a reference video or a 3D asset of the object, to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Qi Zhao , Zhan Ma , Pan Zhou

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Recent advances in garment-centric image generation from text and image prompts based on diffusion models are impressive. However, existing methods lack support for various combinations of attire, and struggle to preserve the garment…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Xinghui Li , Qichao Sun , Pengze Zhang , Fulong Ye , Zhichao Liao , Wanquan Feng , Songtao Zhao , Qian He

Incorporating a customized object into image generation presents an attractive feature in text-to-image generation. However, existing optimization-based and encoder-based methods are hindered by drawbacks such as time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Ziyang Yuan , Mingdeng Cao , Xintao Wang , Zhongang Qi , Chun Yuan , Ying Shan

Recent progress in personalized image generation using diffusion models has been significant. However, development in the area of open-domain and non-fine-tuning personalized image generation is proceeding rather slowly. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jian Ma , Junhao Liang , Chen Chen , Haonan Lu

We present ZeroComp, an effective zero-shot 3D object compositing approach that does not require paired composite-scene images during training. Our method leverages ControlNet to condition from intrinsic images and combines it with a Stable…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Zitian Zhang , Frédéric Fortier-Chouinard , Mathieu Garon , Anand Bhattad , Jean-François Lalonde

Zero-shot artistic style transfer is an important image synthesis problem aiming at transferring arbitrary style into content images. However, the trade-off between the generalization and efficiency in existing methods impedes a high…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Lu Sheng , Ziyi Lin , Jing Shao , Xiaogang Wang

Generating motion for arbitrary skeletons is a longstanding challenge in computer graphics, remaining largely unexplored due to the scarcity of diverse datasets and the irregular nature of the data. In this work, we introduce AnyTop, a…

Graphics · Computer Science 2025-06-06 Inbar Gat , Sigal Raab , Guy Tevet , Yuval Reshef , Amit H. Bermano , Daniel Cohen-Or

Text-to-image diffusion models have attracted considerable interest due to their wide applicability across diverse fields. However, challenges persist in creating controllable models for personalized object generation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Yuheng Li , Haotian Liu , Yangming Wen , Yong Jae Lee

We do not pursue a novel method in this paper, but aim to study if a modern text-to-image diffusion model can tailor any task-adaptive image classifier across domains and categories. Existing domain adaptive image classification works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Weijie Chen , Haoyu Wang , Shicai Yang , Lei Zhang , Wei Wei , Yanning Zhang , Luojun Lin , Di Xie , Yueting Zhuang

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

Modern generative video models excel at producing convincing, high-quality outputs, but struggle to maintain multi-view and spatiotemporal consistency in highly dynamic real-world environments. In this work, we introduce \textbf{AnyView}, a…

Diffusion models are capable of generating impressive images conditioned on text descriptions, and extensions of these models allow users to edit images at a relatively coarse scale. However, the ability to precisely edit the layout,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Daniel Geng , Andrew Owens

Fashion image editing aims to modify a person's appearance based on a given instruction. Existing methods require auxiliary tools like segmenters and keypoint extractors, lacking a flexible and unified framework. Moreover, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yunfang Niu , Lingxiang Wu , Dong Yi , Jie Peng , Ning Jiang , Haiying Wu , Jinqiao Wang

The growing accessibility of diffusion models has revolutionized image editing but also raised significant concerns about unauthorized modifications, such as misinformation and plagiarism. Existing countermeasures largely rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Yaopei Zeng , Yuanpu Cao , Lu Lin

Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Shuai Yang , Yifan Zhou , Ziwei Liu , Chen Change Loy

Single-view indoor scene generation plays a crucial role in a range of real-world applications. However, generating a complete 360{\deg} scene from a single image remains a highly ill-posed and challenging problem. Recent approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Runmao Yao , Junsheng Zhou , Zhen Dong , Yu-Shen Liu

Object-level manipulation, relocating or reorienting objects in images or videos while preserving scene realism, is central to film post-production, AR, and creative editing. Yet existing methods struggle to jointly achieve three core…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Penghui Ruan , Bojia Zi , Xianbiao Qi , Youze Huang , Rong Xiao , Pichao Wang , Jiannong Cao , Yuhui Shi