English
Related papers

Related papers: MultiShotMaster: A Controllable Multi-Shot Video G…

200 papers

Recent advances in foundational Video Diffusion Models (VDMs) have yielded significant progress. Yet, despite the remarkable visual quality of generated videos, reconstructing consistent 3D scenes from these outputs remains challenging, due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yisu Zhang , Chenjie Cao , Tengfei Wang , Xuhui Zuo , Junta Wu , Jianke Zhu , Chunchao Guo

Autoregressive video generation aims at real-time, open-ended synthesis. Yet, cinematic storytelling is not merely the endless extension of a single scene; it requires progressing through evolving events, viewpoint shifts, and discrete shot…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yihao Meng , Zichen Liu , Hao Ouyang , Qiuyu Wang , Ka Leong Cheng , Yue Yu , Hanlin Wang , Haobo Li , Jiapeng Zhu , Yanhong Zeng , Xing Zhu , Yujun Shen , Qifeng Chen , Huamin Qu

We present ReDirector, a novel camera-controlled video retake generation method for dynamically captured variable-length videos. In particular, we rectify a common misuse of RoPE in previous works by aligning the spatiotemporal positions of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Byeongjun Park , Byung-Hoon Kim , Hyungjin Chung , Jong Chul Ye

The evolution of video generation toward complex, multi-shot narratives has exposed a critical deficit in current evaluation methods. Existing benchmarks remain anchored to single-shot paradigms, lacking the comprehensive story assets and…

Multimedia · Computer Science 2026-03-02 Haoyuan Shi , Yunxin Li , Nanhao Deng , Zhenran Xu , Xinyu Chen , Longyue Wang , Baotian Hu , Min Zhang

We propose Camera Artist, a multi-agent framework that models a real-world filmmaking workflow to generate narrative videos with explicit cinematic language. While recent multi-agent systems have made substantial progress in automating…

Artificial Intelligence · Computer Science 2026-04-13 Haobo Hu , Qi Mao , Yuanhang Li , Libiao Jin

Precise camera control for reshooting dynamic videos is bottlenecked by the severe scarcity of paired multi-view data for non-rigid scenes. We overcome this limitation with a highly scalable self-supervised framework capable of leveraging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Avinash Paliwal , Adithya Iyer , Shivin Yadav , Muhammad Ali Afridi , Midhun Harikumar

Generating long-form storytelling videos with consistent visual narratives remains a significant challenge in video synthesis. We present a novel framework, dataset, and a model that address three critical limitations: background…

Despite rapid advancements in video generation models, generating coherent storytelling videos that span multiple scenes and characters remains challenging. Current methods often rigidly convert pre-generated keyframes into fixed-length…

Multiagent Systems · Computer Science 2025-10-03 Haoyuan Shi , Yunxin Li , Xinyu Chen , Longyue Wang , Baotian Hu , Min Zhang

Video world models should maintain evolving states when evidence is unobserved, yet current generators often freeze hidden states upon interruption. This is not simply a capacity problem: pretrained video diffusion transformers already…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Tianshuo Xu , Yichen Xie , Depu Meng , Chensheng Peng , Quentin Herau , Bo Jiang , Yihan Hu , Wei Zhan

Existing AI-driven video creation systems typically treat script drafting and key-shot design as two disjoint tasks: the former relies on large language models, while the latter depends on image generation models. We argue that these two…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jiaxu Zhang , Tianshu Hu , Yuan Zhang , Zenan Li , Linjie Luo , Guosheng Lin , Xin Chen

Cinemagraphs, which combine static photographs with selective, looping motion, offer unique artistic appeal. Generating them from a single photograph in a controllable manner is particularly challenging. Existing image-animation techniques…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Aniruddha Mahapatra , Long Mai , Cusuh Ham , Feng Liu

First-Frame Propagation (FFP) offers a promising paradigm for controllable video editing, but existing methods are hampered by a reliance on cumbersome run-time guidance. We identify the root cause of this limitation as the inadequacy of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Xijie Huang , Chengming Xu , Donghao Luo , Xiaobin Hu , Peng Tang , Xu Peng , Jiangning Zhang , Chengjie Wang , Yanwei Fu

Recent advances in text-to-video diffusion models have enabled high-fidelity and temporally coherent videos synthesis. However, current models are predominantly optimized for single-event generation. When handling multi-event prompts,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Qianxun Xu , Chenxi Song , Yujun Cai , Chi Zhang

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

This paper introduces StoryAnchors, a unified framework for generating high-quality, multi-scene story frames with strong temporal consistency. The framework employs a bidirectional story generator that integrates both past and future…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bo Wang , Haoyang Huang , Zhiying Lu , Fengyuan Liu , Guoqing Ma , Jianlong Yuan , Yuan Zhang , Nan Duan , Daxin Jiang

Recent years have seen substantial progress in diffusion-based controllable video generation. However, achieving precise control in complex scenarios, including fine-grained object parts, sophisticated motion trajectories, and coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Haitao Zhou , Chuang Wang , Rui Nie , Jinlin Liu , Dongdong Yu , Qian Yu , Changhu Wang

Real-world videos naturally portray complex interactions among distinct physical objects, effectively forming dynamic compositions of visual elements. However, most current video generation models synthesize scenes holistically and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Guofeng Zhang , Angtian Wang , Jacob Zhiyuan Fang , Liming Jiang , Haotian Yang , Alan Yuille , Chongyang Ma

Text-editable and pose-controllable character video generation is a challenging but prevailing topic with practical applications. However, existing approaches mainly focus on single-object video generation with pose guidance, ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Beiyuan Zhang , Yue Ma , Chunlei Fu , Xinyang Song , Zhenan Sun , Ziqiang Li

Mask-free video object insertion has emerged as a challenging task, requiring harmonious integration of reference objects into source videos. However, existing methods struggle when references exhibit severe stylistic domain gaps with the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Xiao Cao , Yansong Qu , Xiangzhen , Chang , Wen Xiao , Jiakui Hu , Heyuan Li , Jialun Liu , Zhiyong Huang , Xuelong Li

Generating controllable character animation from a reference image and motion guidance remains a challenging task due to the inherent difficulty of injecting appearance and motion cues into video diffusion models. Prior works often rely on…

Graphics · Computer Science 2025-07-03 Guian Fang , Yuchao Gu , Mike Zheng Shou