English
Related papers

Related papers: AutoMV: An Automatic Multi-Agent System for Music …

200 papers

Visual compliance verification is a critical yet underexplored problem in computer vision, especially in domains such as media, entertainment, and advertising where content must adhere to complex and evolving policy rules. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Rahul Ghosh , Baishali Chaudhury , Hari Prasanna Das , Meghana Ashok , Ryan Razkenari , Long Chen , Sungmin Hong , Chun-Hao Liu

With the rapid growth of video generative models (VGMs), it is essential to develop reliable and comprehensive automatic metrics for AI-generated videos (AIGVs). Existing methods either use off-the-shelf models optimized for other tasks or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanxin Liu , Rui Zhu , Shuhuai Ren , Jiacong Wang , Haoyuan Guo , Xu Sun , Lu Jiang

Video generation requires synthesizing consistent and persistent frames with dynamic content over time. This work investigates modeling the temporal relations for composing video with arbitrary length, from a few frames to even infinite,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Qihang Zhang , Ceyuan Yang , Yujun Shen , Yinghao Xu , Bolei Zhou

Diffusion models have demonstrated great success in text-to-video (T2V) generation. However, existing methods may face challenges when handling complex (long) video generation scenarios that involve multiple objects or dynamic changes in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ye Tian , Ling Yang , Haotian Yang , Yuan Gao , Yufan Deng , Jingmin Chen , Xintao Wang , Zhaochen Yu , Xin Tao , Pengfei Wan , Di Zhang , Bin Cui

Generating a video given the first several static frames is challenging as it anticipates reasonable future frames with temporal coherence. Besides video prediction, the ability to rewind from the last frame or infilling between the head…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Tsu-Jui Fu , Licheng Yu , Ning Zhang , Cheng-Yang Fu , Jong-Chyi Su , William Yang Wang , Sean Bell

Long-horizon omnimodal question answering answers questions by reasoning over text, images, audio, and video. Despite recent progress on OmniLLMs, low-resource long audio-video QA still suffers from costly dense encoding, weak fine-grained…

Computation and Language · Computer Science 2026-03-31 Yifan Zhu , Xinyu Mu , Tao Feng , Zhonghong Ou , Yuning Gong , Haoran Luo

While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, open-source alternatives significantly lag behind. Most academic models remain heavily fragmented, and the few existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Kaihang Pan , Qi Tian , Jianwei Zhang , Weijie Kong , Jiangfeng Xiong , Yanxin Long , Shixue Zhang , Haiyi Qiu , Tan Wang , Zheqi Lv , Yue Wu , Liefeng Bo , Siliang Tang , Zhao Zhong

Agentic AI has been standardized in industry as a practical paradigm for coordinating specialized models and tools to solve complex multimodal tasks. In this work, we present WeaveMuse, a multi-agent system for music understanding, symbolic…

Sound · Computer Science 2025-09-16 Emmanouil Karystinaios

Presentation generation is moving beyond static slide creation toward end-to-end presentation video generation with research grounding, multimodal media, and interactive delivery. We introduce PresentAgent-2, an agentic framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wei Wu , Ziyang Xu , Zeyu Zhang , Yang Zhao , Hao Tang

Recent advancements in image-to-video (I2V) generation have shown promising performance in conventional scenarios. However, these methods still encounter significant challenges when dealing with complex scenes that require a deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Peng Liu , Xiaoming Ren , Fengkai Liu , Qingsong Xie , Quanlong Zheng , Yanhao Zhang , Haonan Lu , Yujiu Yang

Many video-to-audio (VTA) methods have been proposed for dubbing silent AI-generated videos. An efficient quality assessment method for AI-generated audio-visual content (AGAV) is crucial for ensuring audio-visual quality. Existing…

Multimedia · Computer Science 2025-07-15 Yuqin Cao , Xiongkuo Min , Yixuan Gao , Wei Sun , Guangtao Zhai

The emergence of Diffusion Transformers (DiT) has brought significant advancements to video generation, especially in text-to-video and image-to-video tasks. Although video generation is widely applied in various fields, most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Sen Liang , Zhentao Yu , Zhengguang Zhou , Teng Hu , Hongmei Wang , Yi Chen , Qin Lin , Yuan Zhou , Xin Li , Qinglin Lu , Zhibo Chen

Recently, image-to-video (I2V) diffusion models have demonstrated impressive scene understanding and generative quality, incorporating image conditions to guide generation. However, these models primarily animate static images without…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Luis Denninger , Sina Mokhtarzadeh Azar , Juergen Gall

Recent advances in text-to-video (T2V) generation highlight the critical role of high-quality video-text pairs in training models capable of producing coherent and instruction-aligned videos. However, strategies for optimizing video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yang Du , Zhuoran Lin , Kaiqiang Song , Biao Wang , Zhicheng Zheng , Tiezheng Ge , Bo Zheng , Qin Jin

Storytelling video generation (SVG) aims to produce coherent and visually rich multi-scene videos that follow a structured narrative. Existing methods primarily employ LLM for high-level planning to decompose a story into scene-level…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zun Wang , Jialu Li , Han Lin , Jaehong Yoon , Mohit Bansal

The growing demand for high-fidelity video generation from textual descriptions has catalyzed significant research in this field. In this work, we introduce MagicVideo-V2 that integrates the text-to-image model, video motion generator,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Weimin Wang , Jiawei Liu , Zhijie Lin , Jiangqiao Yan , Shuo Chen , Chetwin Low , Tuyen Hoang , Jie Wu , Jun Hao Liew , Hanshu Yan , Daquan Zhou , Jiashi Feng

The burgeoning field of Artificial Intelligence Generated Content (AIGC) is witnessing rapid advancements, particularly in video generation. This paper introduces AIGCBench, a pioneering comprehensive and scalable benchmark designed to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Fanda Fan , Chunjie Luo , Wanling Gao , Jianfeng Zhan

Long video question answering (Long-Video QA) increasingly relies on agentic tool use to retrieve evidence from long videos. In realistic settings, this process often requires multi-hop retrieval, where agents must iteratively gather…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Rongyi Yu , Chenyuan Duan , Wentao Zhang

Automatic movie narration aims to generate video-aligned plot descriptions to assist visually impaired audiences. Unlike standard video captioning, it involves not only describing key visual details but also inferring plots that unfold…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zihao Yue , Yepeng Zhang , Ziheng Wang , Qin Jin

Large Language Model (LLM) Agents have demonstrated remarkable capabilities in task automation and intelligent decision-making, driving the widespread adoption of agent development frameworks such as LangChain and AutoGen. However, these…

Artificial Intelligence · Computer Science 2025-10-10 Jiabin Tang , Tianyu Fan , Chao Huang