中文
相关论文

相关论文: MagicStick: Controllable Video Editing via Control…

200 篇论文

We present Magic Insert, a method for dragging-and-dropping subjects from a user-provided image into a target image of a different style in a physically plausible manner while matching the style of the target image. This work formalizes the…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Nataniel Ruiz , Yuanzhen Li , Neal Wadhwa , Yael Pritch , Michael Rubinstein , David E. Jacobs , Shlomi Fruchter

Generating human videos with realistic and controllable motions is a challenging task. While existing methods can generate visually compelling videos, they lack separate control over four key video elements: foreground subject, background…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Jingyun Liang , Jingkai Zhou , Shikai Li , Chenjie Cao , Lei Sun , Yichen Qian , Weihua Chen , Fan Wang

Hair editing is an interesting and challenging problem in computer vision and graphics. Many existing methods require well-drawn sketches or masks as conditional inputs for editing, however these interactions are neither straightforward nor…

计算机视觉与模式识别 · 计算机科学 2022-03-03 Tianyi Wei , Dongdong Chen , Wenbo Zhou , Jing Liao , Zhentao Tan , Lu Yuan , Weiming Zhang , Nenghai Yu

Recent diffusion models have achieved remarkable success in image relighting, and this success has quickly been extended to video relighting. However, existing methods offer limited explicit control over illumination in the relighted…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yizuo Peng , Xuelin Chen , Kai Zhang , Xiaodong Cun

Interactive image editing allows users to modify images through visual interaction operations such as drawing, clicking, and dragging. Existing methods construct such supervision signals from videos, as they capture how objects change with…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Yabo Zhang , Xinpeng Zhou , Yihan Zeng , Hang Xu , Hui Li , Wangmeng Zuo

The rapid advancement of diffusion models has greatly improved video synthesis, especially in controllable video generation, which is vital for applications like autonomous driving. Although DiT with 3D VAE has become a standard framework…

计算机视觉与模式识别 · 计算机科学 2025-07-28 Ruiyuan Gao , Kai Chen , Bo Xiao , Lanqing Hong , Zhenguo Li , Qiang Xu

Recent advances in deep generative modeling have unlocked unprecedented opportunities for video synthesis. In real-world applications, however, users often seek tools to faithfully realize their creative editing intentions with precise and…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Yuhao Liu , Tengfei Wang , Fang Liu , Zhenwei Wang , Rynson W. H. Lau

Text-to-video generation has shown promising results. However, by taking only natural languages as input, users often face difficulties in providing detailed information to precisely control the model's output. In this work, we propose…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Hsin-Ping Huang , Yu-Chuan Su , Deqing Sun , Lu Jiang , Xuhui Jia , Yukun Zhu , Ming-Hsuan Yang

Pedestrian detection models in autonomous driving systems often lack robustness due to insufficient representation of dangerous pedestrian scenarios in training datasets. To address this limitation, we present a novel framework for…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Danzhen Fu , Jiagao Hu , Daiguo Zhou , Fei Wang , Zepeng Wang , Wenhua Liao

Text-to-video diffusion models have made remarkable advancements. Driven by their ability to generate temporally coherent videos, research on zero-shot video editing using these fundamental models has expanded rapidly. To enhance editing…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Lingling Cai , Kang Zhao , Hangjie Yuan , Yingya Zhang , Shiwei Zhang , Kejie Huang

The diffusion-based generative models have achieved remarkable success in text-based image generation. However, since it contains enormous randomness in generation progress, it is still challenging to apply such models for real-world visual…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Chenyang Qi , Xiaodong Cun , Yong Zhang , Chenyang Lei , Xintao Wang , Ying Shan , Qifeng Chen

Diffusion-based point editing methods have gained significant traction in image editing tasks due to their ability to manipulate image semantics and fine details by applying localized perturbations on the manifold of noise latent. However,…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Haoyang Hu , Masataka Seo , Yen-Wei Chen

Object-level manipulation, relocating or reorienting objects in images or videos while preserving scene realism, is central to film post-production, AR, and creative editing. Yet existing methods struggle to jointly achieve three core…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Penghui Ruan , Bojia Zi , Xianbiao Qi , Youze Huang , Rong Xiao , Pichao Wang , Jiannong Cao , Yuhui Shi

Diffusion models have recently advanced video editing, yet controllable editing remains challenging due to the need for precise manipulation of diverse object properties. Current methods require different control signal for diverse editing…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Yuqing Chen , Junjie Wang , Lin Liu , Ruihang Chu , Xiaopeng Zhang , Qi Tian , Yujiu Yang

We introduce $\textit{InteractiveVideo}$, a user-centric framework for video generation. Different from traditional generative approaches that operate based on user-provided images or text, our framework is designed for dynamic interaction,…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Yiyuan Zhang , Yuhao Kang , Zhixin Zhang , Xiaohan Ding , Sanyuan Zhao , Xiangyu Yue

Drag-based image editing enables intuitive visual manipulation through point-based drag operations. Existing methods mainly rely on diffusion inversion or pixel-space warping with inpainting. However, inversion inherently introduces…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Huiguo He , Pengyu Yan , Ziqi Yi , Weizhi Zhong , Zheng Liu , Yejun Tang , Huan Yang , Guanbin Li , Lianwen Jin

Existing diffusion-based methods have achieved impressive results in human motion editing. However, these methods often exhibit significant ghosting and body distortion in unseen in-the-wild cases. In this paper, we introduce…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Yi Zuo , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Wenping Ma , Shuyuan Yang , Yuwei Guo

Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual descriptions and visual images as control conditions, which effectively improves the work efficiency of…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Di Cheng , YingJie Shi , ShiXin Sun , JiaFu Zhang , WeiJing Wang , Yu Liu

Recent advancements in diffusion models have significantly facilitated text-guided video editing. However, there is a relative scarcity of research on image-guided video editing, a method that empowers users to edit videos by merely…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Zhi-Lin Huang , Yixuan Liu , Chujun Qin , Zhongdao Wang , Dong Zhou , Dong Li , Emad Barsoum

Accurately preserving motion while editing a subject remains a core challenge in video editing tasks. Existing methods often face a trade-off between edit and motion fidelity, as they rely on motion representations that are either…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yeji Song , Jaehyun Lee , Mijin Koo , JunHoo Lee , Nojun Kwak