English
Related papers

Related papers: DiffStyleTS: Diffusion Model for Style Transfer in…

200 papers

Denoising diffusion probabilistic models (DDPMs) are becoming the leading paradigm for generative models. It has recently shown breakthroughs in audio synthesis, time series imputation and forecasting. In this paper, we propose…

Machine Learning · Computer Science 2024-10-22 Xinyu Yuan , Yan Qiao

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

Machine Learning · Computer Science 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

Recent advances in image and video creation, especially AI-based image synthesis, have led to the production of numerous visual scenes that exhibit a high level of abstractness and diversity. Consequently, Visual Storytelling (VST), a task…

Computation and Language · Computer Science 2023-12-13 Shengguang Wu , Mei Yuan , Qi Su

Diffusion-based models have shown strong performance in video super-resolution (VSR) and video frame interpolation (VFI). However, their role in the coupled space-time video super-resolution (STVSR) setting remains limited. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zheng Chen , Ruofan Yang , Jin Han , Dehua Song , Zichen Zou , Chunming He , Yong Guo , Yulun Zhang

Style transfer aims to render the content of a given image in the graphical/artistic style of another image. The fundamental concept underlying NeuralStyle Transfer (NST) is to interpret style as a distribution in the feature space of a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Nikolai Kalischek , Jan Dirk Wegner , Konrad Schindler

Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for…

Style transfer, a pivotal task in image processing, synthesizes visually compelling images by seamlessly blending realistic content with artistic styles, enabling applications in photo editing and creative design. While mainstream…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yingying Deng , Xiangyu He , Fan Tang , Weiming Dong , Xucheng Yin

Diffusion models have recently shown the ability to generate high-quality images. However, controlling its generation process still poses challenges. The image style transfer task is one of those challenges that transfers the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Kento Masui , Mayu Otani , Masahiro Nomura , Hideki Nakayama

We introduce Color Disentangled Style Transfer (CDST), a novel and efficient two-stream style transfer training paradigm which completely isolates color from style and forces the style stream to be color-blinded. With one same model, CDST…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Shiwen Zhang , Zhuowei Chen , Lang Chen , Yanze Wu

Expressive Text-to-Speech (TTS) using reference speech has been studied extensively to synthesize natural speech, but there are limitations to obtaining well-represented styles and improving model generalization ability. In this study, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-28 Hyun Joon Park , Jin Sob Kim , Wooseok Shin , Sung Won Han

The stylization of 3D scenes is an increasingly attractive topic in 3D vision. Although image style transfer has been extensively researched with promising results, directly applying 2D style transfer methods to 3D scenes often fails to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yushen Zuo , Jun Xiao , Kin-Chung Chan , Rongkang Dong , Cuixin Yang , Zongqi He , Hao Xie , Kin-Man Lam

Style transfer is an inventive process designed to create an image that maintains the essence of the original while embracing the visual style of another. Although diffusion models have demonstrated impressive generative power in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Haofan Wang , Peng Xing , Renyuan Huang , Hao Ai , Qixun Wang , Xu Bai

Style transfer enables the seamless integration of artistic styles from a style image into a content image, resulting in visually striking and aesthetically enriched outputs. Despite numerous advances in this field, existing methods did not…

Graphics · Computer Science 2025-02-21 Ye Wang , Tongyuan Bai , Xuping Xie , Zili Yi , Yilin Wang , Rui Ma

Diffusion models have been widely used in time series and spatio-temporal data, enhancing generative, inferential, and downstream capabilities. These models are applied across diverse fields such as healthcare, recommendation, climate,…

Machine Learning · Computer Science 2025-12-09 Yiyuan Yang , Ming Jin , Haomin Wen , Chaoli Zhang , Yuxuan Liang , Lintao Ma , Yi Wang , Chenghao Liu , Bin Yang , Zenglin Xu , Shirui Pan , Qingsong Wen

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

We introduce DiffusionTrend for virtual fashion try-on, which forgoes the need for retraining diffusion models. Using advanced diffusion models, DiffusionTrend harnesses latent information rich in prior information to capture the nuances of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Wengyi Zhan , Mingbao Lin , Shuicheng Yan , Rongrong Ji

Human speech exhibits rich and flexible prosodic variations. To address the one-to-many mapping problem from text to prosody in a reasonable and flexible manner, we propose DiffStyleTTS, a multi-speaker acoustic model based on a conditional…

Sound · Computer Science 2024-12-05 Jiaxuan Liu , Zhaoci Liu , Yajun Hu , Yingying Gao , Shilei Zhang , Zhenhua Ling

Ultra-high quality artistic style transfer refers to repainting an ultra-high quality content image using the style information learned from the style image. Existing artistic style transfer methods can be categorized into style…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhanjie Zhang , Ao Ma , Ke Cao , Jing Wang , Shanyuan Liu , Yuhang Ma , Bo Cheng , Dawei Leng , Yuhui Yin

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang