English
Related papers

Related papers: Denoising Diffusion Probabilistic Models for Style…

200 papers

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

Generating human motion guided by conditions such as textual descriptions is challenging due to the need for datasets with pairs of high-quality motion and their corresponding conditions. The difficulty increases when aiming for finer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Pablo Ruiz-Ponce , German Barquero , Cristina Palmero , Sergio Escalera , José García-Rodríguez

Probabilistic denoising diffusion models (DDMs) have set a new standard for 2D image generation. Extending DDMs for 3D content creation is an active field of research. Here, we propose TetraDiffusion, a diffusion model that operates on a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Nikolai Kalischek , Torben Peters , Jan D. Wegner , Konrad Schindler

3D human motion generation is crucial for creative industry. Recent advances rely on generative models with domain knowledge for text-driven motion generation, leading to substantial progress in capturing common motions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mingyuan Zhang , Xinying Guo , Liang Pan , Zhongang Cai , Fangzhou Hong , Huirong Li , Lei Yang , Ziwei Liu

Human motion generation is a challenging task due to its high dimensionality and the difficulty of generating fine-grained motions. Diffusion methods have been proposed due to their high sample quality and expressiveness. Early approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Mirgahney Mohamed , Harry Jake Cunningham , Marc P. Deisenroth , Lourdes Agapito

Generating high-dimensional visual modalities is a computationally intensive task. A common solution is progressive generation, where the outputs are synthesized in a coarse-to-fine spectral autoregressive manner. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Arpit Sahni , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

Multi-modality image fusion aims to combine different modalities to produce fused images that retain the complementary features of each modality, such as functional highlights and texture details. To leverage strong generative priors and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zixiang Zhao , Haowen Bai , Yuanzhi Zhu , Jiangshe Zhang , Shuang Xu , Yulun Zhang , Kai Zhang , Deyu Meng , Radu Timofte , Luc Van Gool

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

Machine Learning · Computer Science 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Generating diverse and natural human motion is one of the long-standing goals for creating intelligent characters in the animated world. In this paper, we propose a self-supervised method for generating long-range, diverse and plausible…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jingwei Xu , Huazhe Xu , Bingbing Ni , Xiaokang Yang , Xiaolong Wang , Trevor Darrell

Human motion synthesis is a fundamental task in computer animation. Recent methods based on diffusion models or GPT structure demonstrate commendable performance but exhibit drawbacks in terms of slow sampling speeds and error accumulation.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Vincent Tao Hu , Wenzhe Yin , Pingchuan Ma , Yunlu Chen , Basura Fernando , Yuki M Asano , Efstratios Gavves , Pascal Mettes , Bjorn Ommer , Cees G. M. Snoek

The differences in brain dynamics across human subjects, commonly referred to as human artifacts, have long been a challenge in the field, severely limiting the generalizability of brain dynamics recognition models. Traditional methods for…

Human-Computer Interaction · Computer Science 2023-05-16 Yiqun Duan , Jinzhao Zhou , Zhen Wang , Yu-Cheng Chang , Yu-Kai Wang , Chin-Teng Lin

This paper introduces a Multi-modal Diffusion model for Motion Prediction (MDMP) that integrates and synchronizes skeletal data and textual descriptions of actions to generate refined long-term motion predictions with quantifiable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Leo Bringer , Joey Wilson , Kira Barton , Maani Ghaffari

We introduce a novel Stylized Motion Diffusion model, dubbed SMooDi, to generate stylized motion driven by content texts and style motion sequences. Unlike existing methods that either generate motion of various content or transfer style…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Lei Zhong , Yiming Xie , Varun Jampani , Deqing Sun , Huaizu Jiang

Although many long-range imaging systems are designed to support extended vision applications, a natural obstacle to their operation is degradation due to atmospheric turbulence. Atmospheric turbulence causes significant degradation to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Nithin Gopalakrishnan Nair , Kangfu Mei , Vishal M. Patel

Controllable generation of 3D human motions becomes an important topic as the world embraces digital transformation. Existing works, though making promising progress with the advent of diffusion models, heavily rely on meticulously captured…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Nhat M. Hoang , Kehong Gong , Chuan Guo , Michael Bi Mi

This paper introduces a novel data-driven strategy for synthesizing gramophone noise audio textures. A diffusion probabilistic model is applied to generate highly realistic quasiperiodic noises. The proposed model is designed to generate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Eloi Moliner , Vesa Välimäki

Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a…

Image and Video Processing · Electrical Eng. & Systems 2022-09-15 Kuang Gong , Keith A. Johnson , Georges El Fakhri , Quanzheng Li , Tinsu Pan

The lack of real-world data in clinical fields poses a major obstacle in training effective AI models for diagnostic and preventive tools in medicine. Generative AI has shown promise in increasing data volume and enhancing model training,…

Machine Learning · Computer Science 2026-02-10 Md Shahriar Kabir , Sana Alamgeer , Minakshi Debnath , Anne H. H. Ngu

Human trajectory data is crucial in urban planning, traffic engineering, and public health. However, directly using real-world trajectory data often faces challenges such as privacy concerns, data acquisition costs, and data quality. A…

Machine Learning · Computer Science 2025-11-05 Qingyue Long , Can Rong , Tong Li , Yong Li