English
Related papers

Related papers: Interactive Video Stylization Using Few-Shot Patch…

200 papers

Attribute-controlled text rewriting, also known as text style-transfer, has a crucial role in regulating attributes and biases of textual training data and a machine generated text. In this work we present SimpleStyle, a minimalist yet…

Computation and Language · Computer Science 2022-12-23 Elron Bandel , Yoav Katz , Noam Slonim , Liat Ein-Dor

Video recognition systems are vulnerable to adversarial examples. Recent studies show that style transfer-based and patch-based unrestricted perturbations can effectively improve attack efficiency. These attacks, however, face two main…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yuxin Cao , Ziyu Zhao , Xi Xiao , Derui Wang , Minhui Xue , Jin Lu

Learning visual representations with interpretable features, i.e., disentangled representations, remains a challenging problem. Existing methods demonstrate some success but are hard to apply to large-scale vision datasets like ImageNet. In…

Machine Learning · Computer Science 2023-06-01 Lilian Ngweta , Subha Maity , Alex Gittens , Yuekai Sun , Mikhail Yurochkin

Existing person video generation methods either lack the flexibility in controlling both the appearance and motion, or fail to preserve detailed appearance and temporal consistency. In this paper, we tackle the problem of motion transfer…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Kun Cheng , Hao-Zhi Huang , Chun Yuan , Lingyiqing Zhou , Wei Liu

Universal style transfer is an image editing task that renders an input content image using the visual style of arbitrary reference images, including both artistic and photorealistic stylization. Given a pair of images as the source of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Jie An , Haoyi Xiong , Jiebo Luo , Jun Huan , Jinwen Ma

Temporal consistency is essential for video editing applications. Existing work on layered representation of videos allows propagating edits consistently to each frame. These methods, however, can only edit object appearance rather than…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Yao-Chih Lee , Ji-Ze Genevieve Jang , Yi-Ting Chen , Elizabeth Qiu , Jia-Bin Huang

Keyframe extraction aims to sum up a video's semantics with the minimum number of its frames. This paper puts forward a Large Model based Sequential Keyframe Extraction for video summarization, dubbed LMSKE, which contains three stages as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Kailong Tan , Yuxiang Zhou , Qianchen Xia , Rui Liu , Yong Chen

The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences…

Machine Learning · Computer Science 2019-11-25 Thibault Duhamel , Mariane Maynard , Froduald Kabanza

Video inpainting aims to fill spatio-temporal "corrupted" regions with plausible content. To achieve this goal, it is necessary to find correspondences from neighbouring frames to faithfully hallucinate the unknown content. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Xueyan Zou , Linjie Yang , Ding Liu , Yong Jae Lee

Attention injection-based style transfer has achieved remarkable progress in recent years. However, existing methods often suffer from content leakage, where the undesired semantic content of the style image mistakenly appears in the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Haojun Tang , Qiwei Lin , Tongda Xu , Lida Huang , Yan Wang

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using text is the most…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhi-Song Liu , Li-Wen Wang , Wan-Chi Siu , Vicky Kalogeiton

Current diffusion-based video editing primarily focuses on structure-preserved editing by utilizing various dense correspondences to ensure temporal consistency and motion alignment. However, these approaches are often ineffective when the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Yuchao Gu , Yipin Zhou , Bichen Wu , Licheng Yu , Jia-Wei Liu , Rui Zhao , Jay Zhangjie Wu , David Junhao Zhang , Mike Zheng Shou , Kevin Tang

We propose an attention-based networks for transferring motions between arbitrary objects. Given a source image(s) and a driving video, our networks animate the subject in the source images according to the motion in the driving video. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Subin Jeon , Seonghyeon Nam , Seoung Wug Oh , Seon Joo Kim

Style transfer has been an important topic both in computer vision and graphics. Since the seminal work of Gatys et al. first demonstrates the power of stylization through optimization in the deep feature space, quite a few approaches have…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Zhijie Wu , Chunjin Song , Yang Zhou , Minglun Gong , Hui Huang

Neural style transfer is a powerful computer vision technique that can incorporate the artistic "style" of one image to the "content" of another. The underlying theory behind the approach relies on the assumption that the style of an image…

Machine Learning · Computer Science 2022-09-26 Yousef El-Laham , Svitlana Vyetrenko

Transferring the pose of a reference avatar to stylized 3D characters of various shapes is a fundamental task in computer graphics. Existing methods either require the stylized characters to be rigged, or they use the stylized character in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Jiashun Wang , Xueting Li , Sifei Liu , Shalini De Mello , Orazio Gallo , Xiaolong Wang , Jan Kautz

We present a novel method for few-shot video classification, which performs appearance and temporal alignments. In particular, given a pair of query and support videos, we conduct appearance alignment via frame-level feature matching to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Khoi D. Nguyen , Quoc-Huy Tran , Khoi Nguyen , Binh-Son Hua , Rang Nguyen

In this work we propose a novel method for supervised, keyshots based video summarization by applying a conceptually simple and computationally efficient soft, self-attention mechanism. Current state of the art methods leverage…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Jiri Fajtl , Hajar Sadeghi Sokeh , Vasileios Argyriou , Dorothy Monekosso , Paolo Remagnino

This paper introduces a novel dataset construction pipeline that samples pairs of frames from videos and uses multimodal large language models (MLLMs) to generate editing instructions for training instruction-based image manipulation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Mingdeng Cao , Xuaner Zhang , Yinqiang Zheng , Zhihao Xia