English
Related papers

Related papers: Modiff: Action-Conditioned 3D Motion Generation wi…

200 papers

Mixed reality applications require tracking the user's full-body motion to enable an immersive experience. However, typical head-mounted devices can only track head and hand movements, leading to a limited reconstruction of full-body motion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Angela Castillo , Maria Escobar , Guillaume Jeanneret , Albert Pumarola , Pablo Arbeláez , Ali Thabet , Artsiom Sanakoyeu

Deep learning models in the Earth Observation domain heavily rely on the availability of large-scale accurately labeled satellite imagery. However, obtaining and labeling satellite imagery is a resource-intensive endeavor. While generative…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Orkhan Baghirli , Hamid Askarov , Imran Ibrahimli , Ismat Bakhishov , Nabi Nabiyev

This paper introduces a Multi-modal Diffusion model for Motion Prediction (MDMP) that integrates and synchronizes skeletal data and textual descriptions of actions to generate refined long-term motion predictions with quantifiable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Leo Bringer , Joey Wilson , Kira Barton , Maani Ghaffari

Denoising Diffusion Probabilistic Models (DDPMs) have made great strides in generating high-quality samples in both discrete and continuous domains. However, Discrete DDPMs (D3PMs) have yet to be applied to the domain of Symbolic Music.…

Sound · Computer Science 2023-05-17 Matthias Plasser , Silvan Peter , Gerhard Widmer

Time series forecasting models are becoming increasingly prevalent due to their critical role in decision-making across various domains. However, most existing approaches represent the coupled temporal patterns, often neglecting the…

Machine Learning · Computer Science 2025-09-26 Jintao Zhang , Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Daoyu Wang

Denoising Diffusion Probabilistic Models (DDPMs) can generate high-quality samples such as image and audio samples. However, DDPMs require hundreds to thousands of iterations to produce final samples. Several prior works have successfully…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Luping Liu , Yi Ren , Zhijie Lin , Zhou Zhao

In this paper, we consider the conditional generation problem by guiding off-the-shelf unconditional diffusion models with differentiable loss functions in a plug-and-play fashion. While previous research has primarily focused on balancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Youyuan Zhang , Zehua Liu , Zenan Li , Zhaoyu Li , James J. Clark , Xujie Si

Diffusion models (DMs) are a type of generative model that has a huge impact on image synthesis and beyond. They achieve state-of-the-art generation results in various generative tasks. A great diversity of conditioning inputs, such as text…

Machine Learning · Computer Science 2024-02-02 Weiguo Lu , Xuan Wu , Deng Ding , Jinqiao Duan , Jirong Zhuang , Gangnan Yuan

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

As acquiring MRIs is expensive, neuroscience studies struggle to attain a sufficient number of them for properly training deep learning models. This challenge could be reduced by MRI synthesis, for which Generative Adversarial Networks…

Image and Video Processing · Electrical Eng. & Systems 2023-09-08 Wei Peng , Ehsan Adeli , Tomas Bosschieter , Sang Hyun Park , Qingyu Zhao , Kilian M. Pohl

The lack of real-world data in clinical fields poses a major obstacle in training effective AI models for diagnostic and preventive tools in medicine. Generative AI has shown promise in increasing data volume and enhancing model training,…

Machine Learning · Computer Science 2026-02-10 Md Shahriar Kabir , Sana Alamgeer , Minakshi Debnath , Anne H. H. Ngu

Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Xutao Guo , Yanwu Yang , Chenfei Ye , Shang Lu , Yang Xiang , Ting Ma

Motion in-betweening, a fundamental task in character animation, consists of generating motion sequences that plausibly interpolate user-provided keyframe constraints. It has long been recognized as a labor-intensive and challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Setareh Cohan , Guy Tevet , Daniele Reda , Xue Bin Peng , Michiel van de Panne

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

Machine Learning · Statistics 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

This work focuses on the problem of reconstructing a 3D human body mesh from a given 2D image. Despite the inherent ambiguity of the task of human mesh recovery, most existing works have adopted a method of regressing a single output. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hanbyel Cho , Junmo Kim

Recently, skeleton-based human action has become a hot research topic because the compact representation of human skeletons brings new blood to this research domain. As a result, researchers began to notice the importance of using RGB or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yifan Jiang , Han Chen , Hanseok Ko

Denoising diffusion probabilistic models and score-matching models have proven to be very powerful for generative tasks. While these approaches have also been applied to the generation of discrete graphs, they have, so far, relied on…

Machine Learning · Computer Science 2023-08-17 Kilian Konstantin Haefeli , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Generative models have shown great promise in generating 3D geometric systems, which is a fundamental problem in many natural science domains such as molecule and protein design. However, existing approaches only operate on static…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jiaqi Han , Minkai Xu , Aaron Lou , Haotian Ye , Stefano Ermon

Diffusion models have recently brought a powerful revolution in image generation. Despite showing impressive generative capabilities, most of these models rely on the current sample to denoise the next one, possibly resulting in denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yurui Qian , Qi Cai , Yingwei Pan , Yehao Li , Ting Yao , Qibin Sun , Tao Mei