English
Related papers

Related papers: I2VControl-Camera: Precise Video Camera Control wi…

200 papers

Despite recent advances in image-to-video generation, better controllability and local animation are less explored. Most existing image-to-video methods are not locally aware and tend to move the entire scene. However, human artists may…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yue Ma , Yingqing He , Hongfa Wang , Andong Wang , Chenyang Qi , Chengfei Cai , Xiu Li , Zhifeng Li , Heung-Yeung Shum , Wei Liu , Qifeng Chen

Recent progress in text-to-video generation has achieved remarkable realism, yet fine-grained control over camera motion and orientation remains elusive, especially with extreme trajectories (e.g., a 180-degree turnaround, or looking…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Frédéric Fortier-Chouinard , Yannick Hold-Geoffroy , Valentin Deschaintre , Matheus Gadelha , Jean-François Lalonde

Although image editing techniques have advanced significantly, video editing, which aims to manipulate videos according to user intent, remains an emerging challenge. Most existing image-conditioned video editing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xianghao Kong , Hansheng Chen , Yuwei Guo , Lvmin Zhang , Gordon Wetzstein , Maneesh Agrawala , Anyi Rao

Recent advances in customized video generation have enabled users to create videos tailored to both specific subjects and motion trajectories. However, existing methods often require complicated test-time fine-tuning and struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yujie Wei , Shiwei Zhang , Hangjie Yuan , Xiang Wang , Haonan Qiu , Rui Zhao , Yutong Feng , Feng Liu , Zhizhong Huang , Jiaxin Ye , Yingya Zhang , Hongming Shan

Camera trajectory generation is a cornerstone in computer graphics, robotics, virtual reality, and cinematography, enabling seamless and adaptive camera movements that enhance visual storytelling and immersive experiences. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zahra Dehghanian , Pouya Ardekhani , Amir Vahedi , Hamid Beigy , Hamid R. Rabiee

The rapid progress of image-guided video generation (I2V) has raised concerns about its potential misuse in misinformation and fraud, underscoring the urgent need for effective digital watermarking. While existing watermarking methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Guanjie Wang , Zehua Ma , Han Fang , Weiming Zhang

Specifying nuanced and compelling camera motion remains a significant hurdle for non-expert creators using generative tools, creating an "expressive gap" where generic text prompts fail to capture cinematic vision. This barrier limits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pooja Guhan , Divya Kothandaraman , Geonsun Lee , Tsung-Wei Huang , Guan-Ming Su , Dinesh Manocha

Numerous works have recently integrated 3D camera control into foundational text-to-video models, but the resulting camera control is often imprecise, and video generation quality suffers. In this work, we analyze camera motion from a first…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sherwin Bahmani , Ivan Skorokhodov , Guocheng Qian , Aliaksandr Siarohin , Willi Menapace , Andrea Tagliasacchi , David B. Lindell , Sergey Tulyakov

Adjusting camera exposure in arbitrary lighting conditions is the first step to ensure the functionality of computer vision applications. Poorly adjusted camera exposure often leads to critical failure and performance degradation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Kyunghyun Lee , Ukcheol Shin , Byeong-Uk Lee

Generating controllable videos conforming to user intentions is an appealing yet challenging topic in computer vision. To enable maneuverable control in line with user intentions, a novel video generation task, named Text-Image-to-Video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yaosi Hu , Chong Luo , Zhenzhong Chen

Recent advancements in image-to-video (I2V) generation have shown promising performance in conventional scenarios. However, these methods still encounter significant challenges when dealing with complex scenes that require a deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Peng Liu , Xiaoming Ren , Fengkai Liu , Qingsong Xie , Quanlong Zheng , Yanhao Zhang , Haonan Lu , Yujiu Yang

Camera control is crucial for generating expressive and cinematic videos. Existing methods rely on explicit sequences of camera parameters as control conditions, which can be cumbersome for users to construct, particularly for intricate…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yawen Luo , Jianhong Bai , Xiaoyu Shi , Menghan Xia , Xintao Wang , Pengfei Wan , Di Zhang , Kun Gai , Tianfan Xue

Recent years have seen substantial progress in diffusion-based controllable video generation. However, achieving precise control in complex scenarios, including fine-grained object parts, sophisticated motion trajectories, and coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Haitao Zhou , Chuang Wang , Rui Nie , Jinlin Liu , Dongdong Yu , Qian Yu , Changhu Wang

Camera control, which achieves diverse visual effects by changing camera position and pose, has attracted widespread attention. However, existing methods face challenges such as complex interaction and limited control capabilities. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Xiaoda Yang , Jiayang Xu , Kaixuan Luan , Xinyu Zhan , Hongshun Qiu , Shijun Shi , Hao Li , Shuai Yang , Li Zhang , Checheng Yu , Cewu Lu , Lixin Yang

Cinematic storytelling is profoundly shaped by the artful manipulation of photographic elements such as depth of field and exposure. These effects are crucial in conveying mood and creating aesthetic appeal. However, controlling these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Huiqiang Sun , Liao Shen , Zhan Peng , Kun Wang , Size Wu , Yuhang Zang , Tianqi Liu , Zihao Huang , Xingyu Zeng , Zhiguo Cao , Wei Li , Chen Change Loy

Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation process is an important goal moving forward and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhengfei Kuang , Shengqu Cai , Hao He , Yinghao Xu , Hongsheng Li , Leonidas Guibas , Gordon Wetzstein

Camera control has been extensively studied in conditioned video generation; however, performing precisely altering the camera trajectories while faithfully preserving the video content remains a challenging task. The mainstream approach to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Dong-Yu Chen , Yixin Guo , Shuojin Yang , Tai-Jiang Mu , Shi-Min Hu

Controlling both camera motion and object dynamics is essential for coherent and expressive video generation, yet current methods typically handle only one motion type or rely on ambiguous 2D cues that entangle camera-induced parallax with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Guiyu Zhang , Yabo Chen , Xunzhi Xiang , Junchao Huang , Zhongyu Wang , Li Jiang

We introduce a framework that enables both multi-view character consistency and 3D camera control in video diffusion models through a novel customization data pipeline. We train the character consistency component with recorded volumetric…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Yuancheng Xu , Wenqi Xian , Li Ma , Julien Philip , Ahmet Levent Taşel , Yiwei Zhao , Ryan Burgert , Mingming He , Oliver Hermann , Oliver Pilarski , Rahul Garg , Paul Debevec , Ning Yu

Recent advances in text-to-image (T2I) diffusion models have enabled impressive image generation capabilities guided by text prompts. However, extending these techniques to video generation remains challenging, with existing text-to-video…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Weifeng Chen , Yatai Ji , Jie Wu , Hefeng Wu , Pan Xie , Jiashi Li , Xin Xia , Xuefeng Xiao , Liang Lin