English
Related papers

Related papers: MoST: Motion Style Transformer between Diverse Act…

200 papers

Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Jiawei Ren , Mengmeng Xu , Jui-Chieh Wu , Ziwei Liu , Tao Xiang , Antoine Toisoul

Video generation primarily aims to model authentic and customized motion across frames, making understanding and controlling the motion a crucial topic. Most diffusion-based studies on video motion focus on motion customization with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Zeqi Xiao , Yifan Zhou , Shuai Yang , Xingang Pan

Video generation remains a challenging task due to spatiotemporal complexity and the requirement of synthesizing diverse motions with temporal consistency. Previous works attempt to generate videos in arbitrary lengths either in an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xiaoqian Shen , Xiang Li , Mohamed Elhoseiny

We propose a way of learning disentangled content-style representation of image, allowing us to extrapolate images to any style as well as interpolate between any pair of styles. By augmenting data set in a supervised setting and imposing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sailun Xu , Jiazhi Zhang , Jiamei Liu

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

We introduce a new task, Contextual Text Style Transfer - translating a sentence into a desired style with its surrounding context taken into account. This brings two key challenges to existing style transfer approaches: ($i$) how to…

Computation and Language · Computer Science 2020-05-04 Yu Cheng , Zhe Gan , Yizhe Zhang , Oussama Elachqar , Dianqi Li , Jingjing Liu

Currently, in the field of video-text retrieval, there are many transformer-based methods. Most of them usually stack frame features and regrade frames as tokens, then use transformers for video temporal modeling. However, they commonly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ni Wang , Dongliang Liao , Xing Xu

Video-based human pose transfer is a video-to-video generation task that animates a plain source human image based on a series of target human poses. Considering the difficulties in transferring highly structural patterns on the garments…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Wing-Yin Yu , Lai-Man Po , Ray C. C. Cheung , Yuzhi Zhao , Yu Xue , Kun Li

Over the past few years, image-to-image style transfer has risen to the frontiers of neural image processing. While conventional methods were successful in various tasks such as color and texture transfer between images, none could…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jonghwa Yim , Jisung Yoo , Won-joon Do , Beomsu Kim , Jihwan Choe

Neural style transfer (NST) can create impressive artworks by transferring reference style to content image. Current image-to-image NST methods are short of fine-grained controls, which are often demanded by artistic editing. To mitigate…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Zheng Lin , Zhao Zhang , Kang-Rui Zhang , Bo Ren , Ming-Ming Cheng

Text style transfer (TST) aims to vary the style polarity of text while preserving the semantic content. Although recent advancements have demonstrated remarkable progress in short TST, it remains a relatively straightforward task with…

Computation and Language · Computer Science 2024-06-10 Jie Zhao , Ziyu Guan , Cai Xu , Wei Zhao , Yue Jiang

Given an arbitrary content and style image, arbitrary style transfer aims to render a new stylized image which preserves the content image's structure and possesses the style image's style. Existing arbitrary style transfer methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Zhanjie Zhang , Quanwei Zhang , Junsheng Luan , Mengyuan Yang , Yun Wang , Lei Zhao

Despite the impressive results of arbitrary image-guided style transfer methods, text-driven image stylization has recently been proposed for transferring a natural image into a stylized one according to textual descriptions of the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nisha Huang , Yuxin Zhang , Fan Tang , Chongyang Ma , Haibin Huang , Yong Zhang , Weiming Dong , Changsheng Xu

Current arbitrary style transfer models are limited to either image or video domains. In order to achieve satisfying image and video style transfers, two different models are inevitably required with separate training processes on image and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Bohai Gu , Heng Fan , Libo Zhang

Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using text is the most…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhi-Song Liu , Li-Wen Wang , Wan-Chi Siu , Vicky Kalogeiton

Capturing and preserving motion semantics is essential to motion retargeting between animation characters. However, most of the previous works neglect the semantic information or rely on human-designed joint-level representations. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haodong Zhang , ZhiKe Chen , Haocheng Xu , Lei Hao , Xiaofei Wu , Songcen Xu , Zhensong Zhang , Yue Wang , Rong Xiong

Video color style transfer aims to transform the color style of an original video by using a reference style image. Most existing methods employ neural networks, which come with challenges like opaque transfer processes and limited user…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xintao Jiang , Yaosen Chen , Siqin Zhang , Wei Wang , Xuming Wen

Neural style transfer draws researchers' attention, but the interest focuses on bitmap images. Various models have been developed for bitmap image generation both online and offline with arbitrary and pre-trained styles. However, the style…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Valeria Efimova , Artyom Chebykin , Ivan Jarsky , Evgenii Prosvirnin , Andrey Filchenkov

We present a novel approach for disentangling the content of a text image from all aspects of its appearance. The appearance representation we derive can then be applied to new content, for one-shot transfer of the source style to new…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Praveen Krishnan , Rama Kovvuri , Guan Pang , Boris Vassilev , Tal Hassner

The rapid development of generative diffusion models has significantly advanced the field of style transfer. However, most current style transfer methods based on diffusion models typically involve a slow iterative optimization process,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Feihong He , Gang Li , Fuhui Sun , Mengyuan Zhang , Lingyu Si , Xiaoyan Wang , Li Shen