English
Related papers

Related papers: Mind-of-Director: Multi-modal Agent-Driven Film Pr…

200 papers

We present Action Agent, a two-stage framework that unifies agentic navigation video generation with flow-constrained diffusion control for multi-embodiment robot navigation. In Stage I, a large language model (LLM) acts as an orchestration…

Robotics · Computer Science 2026-05-05 Jeffrin Sam , Nguyen Khang , Yara Mahmoud , Miguel Altamirano Cabrera , Dzmitry Tsetserukou

User-generated cinematic creations are gaining popularity as our daily entertainment, yet it is a challenge to master cinematography for producing immersive contents. Many existing automatic methods focus on roughly controlling predefined…

Multimedia · Computer Science 2024-05-24 Xinyi Wu , Haohong Wang , Aggelos K. Katsaggelos

This project proposes a methodology for the automatic generation of action models from video game dynamics descriptions, as well as its integration with a planning agent for the execution and monitoring of the plans. Planners use these…

Artificial Intelligence · Computer Science 2021-09-08 Ignacio Vellido , Carlos Núñez-Molina , Vladislav Nikolov , Juan Fdez-Olivares

Image generation based on diffusion models has demonstrated impressive capability, motivating exploration into diverse and specialized applications. Owing to the importance of emotion in advertising, emotion-oriented image generation has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Guoli Jia , Junyao Hu , Xinwei Long , Kai Tian , Kaiyan Zhang , KaiKai Zhao , Ning Ding , Bowen Zhou

In many intelligent systems, a network of agents collaboratively perceives the environment for better and more efficient situation awareness. As these agents often have limited resources, it could be greatly beneficial to identify the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Shuyue Lan , Zhilu Wang , Amit K. Roy-Chowdhury , Ermin Wei , Qi Zhu

World models have emerged as a powerful paradigm for building interactive simulation environments, with recent video-based approaches demonstrating impressive progress in generating visually plausible dynamics. However, because these models…

Artificial Intelligence · Computer Science 2026-05-15 Hongyu Wang , Jingquan Wang , Bocheng Zou , Radu Serban , Dan Negrut

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text,…

Artificial Intelligence · Computer Science 2025-11-06 Huawei Lin , Yunzhi Shi , Tong Geng , Weijie Zhao , Wei Wang , Ravender Pal Singh

A major challenge for world models in multi-agent systems is to understand interdependent agent dynamics, predict interactive multi-agent trajectories, and plan over long horizons with collective awareness, without centralized supervision…

Artificial Intelligence · Computer Science 2026-03-03 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishna

The landscape of video generation is shifting, from a focus on generating visually appealing clips to building virtual environments that support interaction and maintain physical plausibility. These developments point toward the emergence…

Artificial Intelligence · Computer Science 2026-02-09 Jingtong Yue , Ziqi Huang , Zhaoxi Chen , Xintao Wang , Pengfei Wan , Ziwei Liu

Collective Perception has attracted significant attention in recent years due to its advantage for mitigating occlusion and expanding the field-of-view, thereby enhancing reliability, efficiency, and, most crucially, decision-making safety.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yunshuang Yuan , Monika Sester

Automated movie genre classification has emerged as an active and essential area of research and exploration. Short duration movie trailers provide useful insights about the movie as video content consists of the cognitive and the affective…

Computation and Language · Computer Science 2021-09-15 Dinesh Kumar Vishwakarma , Mayank Jindal , Ayush Mittal , Aditya Sharma

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

In multi-agent systems, explicit cognition of teammates' decision logic serves as a critical factor in facilitating coordination. Communication (i.e., ``\textit{Tell}'') can assist in the cognitive development process by information…

Multiagent Systems · Computer Science 2025-11-25 Hao Wu , Shoucheng Song , Chang Yao , Sheng Han , Huaiyu Wan , Youfang Lin , Kai Lv

We present AniME, a director-oriented multi-agent system for automated long-form anime production, covering the full workflow from a story to the final video. The director agent keeps a global memory for the whole workflow, and coordinates…

Artificial Intelligence · Computer Science 2025-10-13 Lisai Zhang , Baohan Xu , Siqian Yang , Mingyu Yin , Jing Liu , Chao Xu , Siqi Wang , Yidi Wu , Yuxin Hong , Zihao Zhang , Yanzhang Liang , Yudong Jiang

The surging demand for adapting long-form cinematic content into short videos has motivated the need for versatile automatic video compilation systems. However, existing compilation methods are limited to predefined tasks, and the community…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Peixuan Zhang , Chang Zhou , Ziyuan Zhang , Hualuo Liu , Chunjie Zhang , Jingqi Liu , Xiaohui Zhou , Xi Chen , Shuchen Weng , Si Li , Boxin Shi

We present a Collaborative Agent-Based Framework for Multi-Image Reasoning. Our approach tackles the challenge of interleaved multimodal reasoning across diverse datasets and task formats by employing a dual-agent system: a language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Angelos Vlachos , Giorgos Filandrianos , Maria Lymperaiou , Nikolaos Spanos , Ilias Mitsouras , Vasileios Karampinis , Athanasios Voulodimos

We present a framework that extends the Actor-Critic architecture to creative 3D modeling through multi-agent self-reflection and human-in-the-loop supervision. While existing approaches rely on single-prompt agents that directly execute…

Multiagent Systems · Computer Science 2026-01-09 Jin Gao , Saichandu Juluri

Long-form video generation is rapidly moving from short, single-scene synthesis toward minute-long, multi-shot creation with narrative structure, cinematic control, audio, and cross-modal synchronization. However, evaluating such videos…

Computation and Language · Computer Science 2026-05-29 Jiamin Chen , Qianben Chen , Jiawen Zhang , Yidi Wu , Yuchen Li , Xiaokun Zhang , Wangchunshu Zhou , Chen Ma

Existing AI-driven video creation systems typically treat script drafting and key-shot design as two disjoint tasks: the former relies on large language models, while the latter depends on image generation models. We argue that these two…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jiaxu Zhang , Tianshu Hu , Yuan Zhang , Zenan Li , Linjie Luo , Guosheng Lin , Xin Chen