English
Related papers

Related papers: AniMaker: Multi-Agent Animated Storytelling with M…

200 papers

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

Generating long-form audio-visual stories from a short user prompt remains challenging due to an intent-execution gap, where high-level narrative intent must be preserved across coherent, shot-level multimodal generation over long horizons.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Wenzhang Sun , Zhenyu Wang , Zhangchi Hu , Chunfeng Wang , Hao Li , Wei Chen

The surging demand for adapting long-form cinematic content into short videos has motivated the need for versatile automatic video compilation systems. However, existing compilation methods are limited to predefined tasks, and the community…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Peixuan Zhang , Chang Zhou , Ziyuan Zhang , Hualuo Liu , Chunjie Zhang , Jingqi Liu , Xiaohui Zhou , Xi Chen , Shuchen Weng , Si Li , Boxin Shi

While diffusion models generate high-fidelity video clips, transforming them into coherent storytelling engines remains challenging. Current agentic pipelines automate this via chained modules but suffer from semantic drift and cascading…

We present AniME, a director-oriented multi-agent system for automated long-form anime production, covering the full workflow from a story to the final video. The director agent keeps a global memory for the whole workflow, and coordinates…

Artificial Intelligence · Computer Science 2025-10-13 Lisai Zhang , Baohan Xu , Siqian Yang , Mingyu Yin , Jing Liu , Chao Xu , Siqi Wang , Yidi Wu , Yuxin Hong , Zihao Zhang , Yanzhang Liang , Yudong Jiang

Visual storytelling aims to generate a narrative paragraph from a sequence of images automatically. Existing approaches construct text description independently for each image and roughly concatenate them as a story, which leads to the…

Computation and Language · Computer Science 2020-11-02 Ruize Wang , Zhongyu Wei , Ying Cheng , Piji Li , Haijun Shan , Ji Zhang , Qi Zhang , Xuanjing Huang

Animation pre-production lays the foundation of an animated film by transforming initial concepts into a coherent blueprint across interdependent stages such as ideation, scripting, design, and storyboarding. While generative AI tools are…

Human-Computer Interaction · Computer Science 2025-11-25 Wen-Fan Wang , Chien-Ting Lu , Jin Ping Ng , Yi-Ting Chiu , Ting-Ying Lee , Miaosen Wang , Bing-Yu Chen , Xiang 'Anthony' Chen

The proliferation of generative AI has transformed creative workflows, yet current systems face critical challenges in controllability and content protection. We propose a novel multi-agent framework that addresses both limitations through…

Multiagent Systems · Computer Science 2026-01-21 Haris Khan , Sadia Asif

The proliferation of generative AI systems creates unprecedented opportunities for content creation while raising critical concerns about controllability, copyright infringement, and content provenance. Current generative models operate as…

Cryptography and Security · Computer Science 2026-01-13 Haris Khan , Sadia Asif , Shumaila Asif

The scarcity of data depicting dangerous situations presents a major obstacle to training AI systems for safety-critical applications, such as construction safety, where ethical and logistical barriers hinder real-world data collection.…

Artificial Intelligence · Computer Science 2025-05-21 Vu Dinh Xuan , Hao Vo , David Murphy , Hoang D. Nguyen

Existing AI-driven video creation systems typically treat script drafting and key-shot design as two disjoint tasks: the former relies on large language models, while the latter depends on image generation models. We argue that these two…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jiaxu Zhang , Tianshu Hu , Yuan Zhang , Zenan Li , Linjie Luo , Guosheng Lin , Xin Chen

Generating video stories from text prompts is a complex task. In addition to having high visual quality, videos need to realistically adhere to a sequence of text prompts whilst being consistent throughout the frames. Creating a benchmark…

With the explosive growth of digital entertainment, automated video summarization has become indispensable for applications such as content indexing, personalized recommendation, and efficient media archiving. Automatic synopsis generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yizhi Li , Xiaohan Chen , Miao Jiang , Wentao Tang , Gaoang Wang

Video Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content. However, many existing methods rely on feeding frame-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Noriyuki Kugo , Xiang Li , Zixin Li , Ashish Gupta , Arpandeep Khatua , Nidhish Jain , Chaitanya Patel , Yuta Kyuragi , Yasunori Ishii , Masamoto Tanabiki , Kazuki Kozuka , Ehsan Adeli

Current video generation models excel at creating short, realistic clips, but struggle with longer, multi-scene videos. We introduce \texttt{DreamFactory}, an LLM-based framework that tackles this challenge. \texttt{DreamFactory} leverages…

Artificial Intelligence · Computer Science 2024-08-22 Zhifei Xie , Daniel Tang , Dingwei Tan , Jacques Klein , Tegawend F. Bissyand , Saad Ezzini

We present CreAgentive, an agent workflow driven multi-category creative generation engine that addresses four key limitations of contemporary large language models in writing stories, drama and other categories of creatives: restricted…

Computation and Language · Computer Science 2025-10-01 Yuyang Cheng , Linyue Cai , Changwei Peng , Yumiao Xu , Rongfang Bie , Yong Zhao

Although recent end-to-end video generation models demonstrate impressive performance in visually oriented content creation, they remain limited in scenarios that require strict logical rigor and precise knowledge representation, such as…

Artificial Intelligence · Computer Science 2026-02-13 Lingyong Yan , Jiulong Wu , Dong Xie , Weixian Shi , Deguo Xia , Jizhou Huang

Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-form, coherent narratives from high-level concepts like…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Chenyu Mu , Xin He , Qu Yang , Wanshun Chen , Jiadi Yao , Huang Liu , Zihao Yi , Bo Zhao , Xingyu Chen , Ruotian Ma , Fanghua Ye , Erkun Yang , Cheng Deng , Zhaopeng Tu , Xiaolong Li , Linus

Software development is a complex, multi-phase process traditionally requiring collaboration among individuals with diverse expertise. We propose AgentMesh, a Python-based framework that uses multiple cooperating LLM-powered agents to…

Software Engineering · Computer Science 2025-07-29 Sourena Khanzadeh

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong