English
Related papers

Related papers: Shape-guided Conditional Latent Diffusion Models f…

200 papers

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Raquel Vidaurre , Elena Garces , Dan Casas

Conditional diffusion models are powerful generative models that can leverage various types of conditional information, such as class labels, segmentation masks, or text captions. However, in many real-world scenarios, conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Nicolas Dufour , Victor Besnier , Vicky Kalogeiton , David Picard

A conditional latent-diffusion based framework for solving the electromagnetic inverse scattering problem associated with microwave imaging is introduced. This generative machine-learning model explicitly mirrors the non-uniqueness of the…

Image and Video Processing · Electrical Eng. & Systems 2025-10-30 Shirin Chehelgami , Joe LoVetri , Vahab Khoshdel

Speech-driven 3D facial animation plays a key role in applications such as virtual avatars, gaming, and digital content creation. While existing methods have made significant progress in achieving accurate lip synchronization and generating…

Graphics · Computer Science 2025-07-16 Yifang Pan , Karan Singh , Luiz Gustavo Hafemann

We present Condition-Aware Neural Network (CAN), a new method for adding control to image generative models. In parallel to prior conditional control methods, CAN controls the image generation process by dynamically manipulating the weight…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Han Cai , Muyang Li , Zhuoyang Zhang , Qinsheng Zhang , Ming-Yu Liu , Song Han

Diffusion probabilistic models have achieved enormous success in the field of image generation and manipulation. In this paper, we explore a novel paradigm of using the diffusion model and classifier guidance in the latent semantic space…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Changhao Shi , Haomiao Ni , Kai Li , Shaobo Han , Mingfu Liang , Martin Renqiang Min

In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation. The model is non-autoregressive, and converts the white noise signal into structured waveform through a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-01 Zhifeng Kong , Wei Ping , Jiaji Huang , Kexin Zhao , Bryan Catanzaro

The ability to rapidly develop materials with desired properties has a transformative impact on a broad range of emerging technologies. In this work, we introduce a new framework based on the diffusion model, a recent generative machine…

Diffusion policies have emerged as a mainstream paradigm for building vision-language-action (VLA) models. Although they demonstrate strong robot control capabilities, their training efficiency remains suboptimal. In this work, we identify…

Robotics · Computer Science 2025-05-19 Zibin Dong , Yicheng Liu , Yinchuan Li , Hang Zhao , Jianye Hao

Vehicle trajectory prediction is crucial for advancing autonomous driving and advanced driver assistance systems (ADAS). Although deep learning-based approaches - especially those utilizing transformer-based and generative models - have…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Junwei You , Rui Gan , Weizhe Tang , Zilin Huang , Jiaxi Liu , Zhuoyu Jiang , Haotian Shi , Keshu Wu , Keke Long , Sicheng Fu , Sikai Chen , Bin Ran

Wall-bounded turbulent flows are chaotic and multiscale, rendering real-time prediction at high Reynolds numbers computationally prohibitive in applications such as wind farms. Classical data assimilation methods are based on repeated…

Fluid Dynamics · Physics 2026-05-25 Fabian Steinbrenner , Baris Turan , Hao Teng , Heng Xiao

Creating accurate and geologically realistic reservoir facies based on limited measurements is crucial for field development and reservoir management, especially in the oil and gas sector. Traditional two-point geostatistics, while…

Geophysics · Physics 2024-11-08 Daesoo Lee , Oscar Ovanger , Jo Eidsvik , Erlend Aune , Jacob Skauvold , Ragnar Hauge

While conditional diffusion models are known to have good coverage of the data distribution, they still face limitations in output diversity, particularly when sampled with a high classifier-free guidance scale for optimal image quality or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Seyedmorteza Sadat , Jakob Buhmann , Derek Bradley , Otmar Hilliges , Romann M. Weber

We propose a novel denoising diffusion generative model for predicting nonlinear fluid fields named FluidDiff. By performing a diffusion process, the model is able to learn a complex representation of the high-dimensional dynamic system,…

Machine Learning · Computer Science 2023-01-31 Gefan Yang , Stefan Sommer

It has been suggested that generative image models such as diffusion models can improve performance on clinically relevant tasks by offering deep learning models supplementary training data. However, most conditional diffusion models treat…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Gustav Schmidt , Philipp Berens , Sarah Müller

Determining brain hemodynamics plays a critical role in the diagnosis and treatment of various cerebrovascular diseases. In this work, we put forth a physics-informed deep learning framework that augments sparse clinical measurements with…

Medical Physics · Physics 2021-08-27 Mohammad Sarabian , Hessam Babaee , Kaveh Laksari

Diffusion Weighted Imaging (DWI) is an advanced imaging technique commonly used in neuroscience and neurological clinical research through a Diffusion Tensor Imaging (DTI) model. Volumetric scalar metrics including fractional anisotropy,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Zihao Tang , Xinyi Wang , Lihaowen Zhu , Mariano Cabezas , Dongnan Liu , Michael Barnett , Weidong Cai , Chengyu Wang

We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Juil Koo , Seungwoo Yoo , Minh Hieu Nguyen , Minhyuk Sung

Accurate 3D aortic construction is crucial for clinical diagnosis, preoperative planning, and computational fluid dynamics (CFD) simulations, as it enables the estimation of critical hemodynamic parameters such as blood flow velocity,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Delin An , Pan Du , Jian-Xun Wang , Chaoli Wang

State-of-the-art diffusion models can generate highly realistic images based on various conditioning like text, segmentation, and depth. However, an essential aspect often overlooked is the specific camera geometry used during image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Andrey Voynov , Amir Hertz , Moab Arar , Shlomi Fruchter , Daniel Cohen-Or