English
Related papers

Related papers: Lights, Camera, Consistency: A Multistage Pipeline…

200 papers

Digital characters are central to modern media, yet generating character videos with long-duration, consistent multi-view appearance and expressive identity remains challenging. Existing approaches either provide insufficient context to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yuhang Yang , Fan Zhang , Huaijin Pi , Shuai Guo , Guowei Xu , Wei Zhai , Yang Cao , Zheng-Jun Zha

Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand long text inputs and 2) produce a globally consistent image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Hong Chen , Rujun Han , Te-Lin Wu , Hideki Nakayama , Nanyun Peng

State-of-the-art Text-to-Video (T2V) diffusion models can generate visually impressive results, yet they still frequently fail to compose complex scenes or follow logical temporal instructions. In this paper, we argue that many errors,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mariam Hassan , Bastien Van Delft , Wuyang Li , Alexandre Alahi

Recent advances in scene-based video generation enable coherent visual narratives from structured prompts, yet a key aspect of storytelling -- character-driven dialogue and speech -- remains underexplored. We present a modular pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Taewon Kang , Ming C. Lin

Recent advances in text-to-image generation models have unlocked vast potential for visual creativity. However, the users that use these models struggle with the generation of consistent characters, a crucial aspect for numerous real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Omri Avrahami , Amir Hertz , Yael Vinker , Moab Arar , Shlomi Fruchter , Ohad Fried , Daniel Cohen-Or , Dani Lischinski

Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zhiyu Yin , Kehai Chen , Xuefeng Bai , Ruili Jiang , Juntao Li , Hongdong Li , Jin Liu , Yang Xiang , Jun Yu , Min Zhang

Generating long-form storytelling videos with consistent visual narratives remains a significant challenge in video synthesis. We present a novel framework, dataset, and a model that address three critical limitations: background…

Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinsong Zhou , Yihua Du , Xinli Xu , Luozhou Wang , Zijie Zhuang , Yehang Zhang , Shuaibo Li , Xiaojun Hu , Bolan Su , Ying-cong Chen

Automated movie creation requires coordinating multiple characters, modalities, and narrative elements across extended sequences -- a challenge that existing end-to-end approaches struggle to address effectively. We present…

Multimedia · Computer Science 2026-04-28 Tianyidan Xie , Zhentao Huang , Mingjie Wang , Xin Huang , Jun Zhou , Minglun Gong , Zili Yi

Recent advancements in video generation models, like Stable Video Diffusion, show promising results, but primarily focus on short, single-scene videos. These models struggle with generating long videos that involve multiple scenes, coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Weijia Wu , Mingyu Liu , Zeyu Zhu , Xi Xia , Haoen Feng , Wen Wang , Kevin Qinghong Lin , Chunhua Shen , Mike Zheng Shou

Despite the significant progress that has been made in video generative models, existing state-of-the-art methods can only produce videos lasting 5-16 seconds, often labeled "long-form videos". Furthermore, videos exceeding 16 seconds…

Generating video stories from text prompts is a complex task. In addition to having high visual quality, videos need to realistically adhere to a sequence of text prompts whilst being consistent throughout the frames. Creating a benchmark…

In text-to-image generation, producing a series of consistent contents that preserve the same identity is highly valuable for real-world applications. Although a few works have explored training-free methods to enhance the consistency of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Mengyu Wang , Henghui Ding , Jianing Peng , Yao Zhao , Yunpeng Chen , Yunchao Wei

Text-to-video generation is expensive, so only a few samples are typically produced per prompt. In this low-sample regime, maximizing the value of each batch requires high cross-video diversity. Recent methods improve diversity for image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Xinshuang Liu , Runfa Blark Li , Truong Nguyen

We present a video generation model that accurately reproduces object motion, changes in camera viewpoint, and new content that arises over time. Existing video generation methods often fail to produce new content as a function of time…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Tim Brooks , Janne Hellsten , Miika Aittala , Ting-Chun Wang , Timo Aila , Jaakko Lehtinen , Ming-Yu Liu , Alexei A. Efros , Tero Karras

This paper introduces StoryAnchors, a unified framework for generating high-quality, multi-scene story frames with strong temporal consistency. The framework employs a bidirectional story generator that integrates both past and future…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bo Wang , Haoyang Huang , Zhiying Lu , Fengyuan Liu , Guoqing Ma , Jianlong Yuan , Yuan Zhang , Nan Duan , Daxin Jiang

Multimedia generation approaches occupy a prominent place in artificial intelligence research. Text-to-image models achieved high-quality results over the last few years. However, video synthesis methods recently started to develop. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Vladimir Arkhipkin , Zein Shaheen , Viacheslav Vasilev , Elizaveta Dakhova , Andrey Kuznetsov , Denis Dimitrov

While recent advancements in generative models have achieved remarkable visual fidelity in video synthesis, creating coherent multi-shot narratives remains a significant challenge. To address this, keyframe-based approaches have emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Peixuan Zhang , Zijian Jia , Kaiqi Liu , Shuchen Weng , Si Li , Boxin Shi

We study series-level cinematic remaking, a long-horizon video-to-video generation problem that localizes full episodes or films via stylization or actor replacement while strictly preserving narrative structure, motion choreography, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yiren Song , Huilin Zhong , Kevin Qinghong Lin , Haofan Wang , Mike Zheng Shou

We present CineVerse, a novel framework for the task of cinematic scene composition. Similar to traditional multi-shot generation, our task emphasizes the need for consistency and continuity across frames. However, our task also focuses on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Quynh Phung , Long Mai , Fabian David Caba Heilbron , Feng Liu , Jia-Bin Huang , Cusuh Ham
‹ Prev 1 2 3 10 Next ›