English
Related papers

Related papers: Sketch and Text Guided Diffusion Model for Colored…

200 papers

Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Chen-Hsuan Lin , Chen Kong , Simon Lucey

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

Recent advancements in large vision-language models have enabled highly expressive and diverse vector sketch generation. However, state-of-the-art methods rely on a time-consuming optimization process involving repeated feedback from a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ellie Arar , Yarden Frenkel , Daniel Cohen-Or , Ariel Shamir , Yael Vinker

Reconstructing a 3D shape based on a single sketch image is challenging due to the large domain gap between a sparse, irregular sketch and a regular, dense 3D shape. Existing works try to employ the global feature extracted from sketch to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Chenjian Gao , Qian Yu , Lu Sheng , Yi-Zhe Song , Dong Xu

Text-to-Image models have introduced a remarkable leap in the evolution of machine learning, demonstrating high-quality synthesis of images from a given text-prompt. However, these powerful pretrained models still lack control handles that…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Andrey Voynov , Kfir Aberman , Daniel Cohen-Or

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jaeseok Lee , Jaekoo Lee

Sketches serve as fundamental blueprints in artistic creation because sketch editing is easier and more intuitive than pixel-level RGB image editing for painting artists, yet sketch generation remains unexplored despite advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Ruohao Zhan , Yijin Li , Yisheng He , Shuo Chen , Yichen Shen , Xinyu Chen , Zilong Dong , Zhaoyang Huang , Guofeng Zhang

In this paper, we present a novel shape reconstruction method leveraging diffusion model to generate 3D sparse point cloud for the object captured in a single RGB image. Recent methods typically leverage global embedding or local…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yan Di , Chenyangguang Zhang , Pengyuan Wang , Guangyao Zhai , Ruida Zhang , Fabian Manhardt , Benjamin Busam , Xiangyang Ji , Federico Tombari

In this work, we study the task of sketch-guided image inpainting. Unlike the well-explored natural language-guided image inpainting, which excels in capturing semantic details, the relatively less-studied sketch-guided inpainting offers…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Nakul Sharma , Aditay Tripathi , Anirban Chakraborty , Anand Mishra

We propose a new framework that formulates point cloud registration as a denoising diffusion process from noisy transformation to object transformation. During training stage, object transformation diffuses from ground-truth transformation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yue Wu , Yongzhe Yuan , Xiaolong Fan , Xiaoshui Huang , Maoguo Gong , Qiguang Miao

Seams, distortions, wasted UV space, vertex-duplication, and varying resolution over the surface are the most prominent issues of the standard UV-based texturing of meshes. These issues are particularly acute when automatic UV-unwrapping…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Simone Foti , Stefanos Zafeiriou , Tolga Birdal

Articulated object generation has seen increasing advancements, yet existing models often lack the ability to be conditioned on text prompts. To address the significant gap between textual descriptions and 3D articulated object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hao Sun , Lei Fan , Donglin Di , Shaohui Liu

Understanding and representing the structure of 3D objects in an unsupervised manner remains a core challenge in computer vision and graphics. Most existing unsupervised keypoint methods are not designed for unconditional generative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Rhys Newbury , Juyan Zhang , Tin Tran , Hanna Kurniawati , Dana Kulić

We introduce a novel approach for concept blending in pretrained text-to-image diffusion models, aiming to generate images at the intersection of multiple text prompts. At each time step during diffusion denoising, our algorithm forecasts…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Divya Kothandaraman , Ming Lin , Dinesh Manocha

Large-scale datasets are usually required to train deep neural networks, but it increases the computational complexity hindering the practical applications. Recently, dataset distillation for images and texts has been attracting a lot of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jae-Young Yim , Dongwook Kim , Jae-Young Sim

Existing feedforward image-to-3D methods mainly rely on 2D multi-view diffusion models that cannot guarantee 3D consistency. These methods easily collapse when changing the prompt view direction and mainly handle object-centric cases. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuanhao Cai , He Zhang , Kai Zhang , Yixun Liang , Mengwei Ren , Fujun Luan , Qing Liu , Soo Ye Kim , Jianming Zhang , Zhifei Zhang , Yuqian Zhou , Yulun Zhang , Xiaokang Yang , Zhe Lin , Alan Yuille

This paper focuses on a novel generative approach for 3D point clouds that makes use of invertible flow-based models. The main idea of the method is to treat a point cloud as a probability density in 3D space that is modeled using a…

Machine Learning · Computer Science 2019-10-17 Michał Stypułkowski , Maciej Zamorski , Maciej Zięba , Jan Chorowski

Automatic synthesis of high quality 3D shapes is an ongoing and challenging area of research. While several data-driven methods have been proposed that make use of neural networks to generate 3D shapes, none of them reach the level of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Isaak Lim , Moritz Ibing , Leif Kobbelt

We propose a simple and novel method for generating 3D human motion from complex natural language sentences, which describe different velocity, direction and composition of all kinds of actions. Different from existing methods that use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zhiyuan Ren , Zhihong Pan , Xin Zhou , Le Kang

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah