English
Related papers

Related papers: CutClaw: Agentic Hours-Long Video Editing via Musi…

200 papers

We propose a fully automated AI system that produces short comedic videos similar to sketch shows such as Saturday Night Live. Starting with character references, the system employs a population of agents loosely based on real production…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Susung Hong , Brian Curless , Ira Kemelmacher-Shlizerman , Steve Seitz

Digital creators, from indie filmmakers to animation studios, face a persistent bottleneck: translating their creative vision into precise camera movements. Despite significant progress in computer vision and artificial intelligence,…

We present EditIQ, a completely automated framework for cinematically editing scenes captured via a stationary, large field-of-view and high-resolution camera. From the static camera feed, EditIQ initially generates multiple virtual feeds,…

Multimedia · Computer Science 2025-02-05 Rohit Girmaji , Bhav Beri , Ramanathan Subramanian , Vineet Gandhi

Existing multi-agent video generation systems use LLM agents to orchestrate neural video generators, producing visually impressive but semantically unreliable outputs with no ground truth annotations. We present an agentic system that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nicolae Cudlenco , Mihai Masala , Marius Leordeanu

Current video generation models excel at creating short, realistic clips, but struggle with longer, multi-scene videos. We introduce \texttt{DreamFactory}, an LLM-based framework that tackles this challenge. \texttt{DreamFactory} leverages…

Artificial Intelligence · Computer Science 2024-08-22 Zhifei Xie , Daniel Tang , Dingwei Tan , Jacques Klein , Tegawend F. Bissyand , Saad Ezzini

Large Language Models (LLMs) and Vision-Language Models (VLMs) have demonstrated remarkable reasoning and generalization capabilities in video understanding; however, their application in video editing remains largely underexplored. This…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yuzhi Li , Haojun Xu , Feng Tian

The proliferation of mobile devices and social media has revolutionized content dissemination, with short-form video becoming increasingly prevalent. This shift has introduced the challenge of video reframing to fit various screen aspect…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Jiawang Cao , Yongliang Wu , Weiheng Chi , Wenbo Zhu , Ziyue Su , Jay Wu

Text-to-video generation models have shown significant progress in the recent years. However, they still struggle with generating complex dynamic scenes based on compositional text prompts, such as attribute binding for multiple objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Kaiyi Huang , Yukun Huang , Xuefei Ning , Zinan Lin , Yu Wang , Xihui Liu

The advent of always-on personal AI assistants, enabled by all-day wearable devices such as smart glasses, demands a new level of contextual understanding, one that goes beyond short, isolated events to encompass the continuous,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Aniket Rege , Arka Sadhu , Yuliang Li , Kejie Li , Ramya Korlakai Vinayak , Yuning Chai , Yong Jae Lee , Hyo Jin Kim

AI-empowered music processing is a diverse field that encompasses dozens of tasks, ranging from generation tasks (e.g., timbre synthesis) to comprehension tasks (e.g., music classification). For developers and amateurs, it is very difficult…

Computation and Language · Computer Science 2023-10-26 Dingyao Yu , Kaitao Song , Peiling Lu , Tianyu He , Xu Tan , Wei Ye , Shikun Zhang , Jiang Bian

We address the task of video chaptering, i.e., partitioning a long video timeline into semantic units and generating corresponding chapter titles. While relatively underexplored, automatic chaptering has the potential to enable efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lucas Ventura , Antoine Yang , Cordelia Schmid , Gül Varol

Talking-head video editing aims to efficiently insert, delete, and substitute the word of a pre-recorded video through a text transcript editor. The key challenge for this task is obtaining an editing model that generates new talking-head…

Multimedia · Computer Science 2023-09-21 Songlin Yang , Wei Wang , Jun Ling , Bo Peng , Xu Tan , Jing Dong

While GUI agents have made significant progress in web navigation and basic operating system tasks, their capabilities in professional creative workflows remain largely underexplored. To bridge this gap, we introduce Cutverse, a benchmark…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Haobo Hu , Xiangwu Guo , Zhiheng Chen , Difei Gao , Haotian Liu , Libiao Jin , Qi Mao

Cross-Video Reasoning (CVR) has emerged as a critical frontier in multimodal intelligence, requiring models to retrieve, align, and aggregate evidence distributed across multiple videos. Current Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yilun Qiu , Jiahe Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Yao Hu , Chun Yuan

The rise of short-form video platforms and the emergence of multimodal large language models (MLLMs) have amplified the need for scalable, effective, zero-shot text-to-video retrieval systems. While recent advances in large-scale…

Information Retrieval · Computer Science 2026-02-24 Jiaxin Wu , Xiao-Yong Wei , Qing Li

Audio description (AD) makes video content accessible to blind and low-vision (BLV) audiences, but producing high-quality descriptions is resource-intensive. Automated AD offers scalability, and prior studies show human-in-the-loop editing…

Human-Computer Interaction · Computer Science 2026-02-04 Lana Do , Shasta Ihorn , Charity Pitcher-Cooper , Juvenal Francisco Barajas , Gio Jung , Xuan Duy Anh Nguyen , Sanjay Mirani , Ilmi Yoon

Trends on short-video platforms evolve at a rapid pace, with new content issues emerging every day that fall outside the coverage of existing annotation policies. However, traditional human-driven discovery of emerging issues is too slow,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Chenghui Yu , Hongwei Wang , Junwen Chen , Zixuan Wang , Bingfeng Deng , Zhuolin Hao , Hongyu Xiong , Yang Song

Long-form video understanding remains challenging for Vision-Language Models (VLMs) due to the inherent tension between computational constraints and the need to capture information distributed across thousands of frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Junbo Zou , Ziheng Huang , Shengjie Zhang , Liwen Zhang , Weining Shen

Video understanding requires not only visual recognition but also complex reasoning. While Vision-Language Models (VLMs) demonstrate impressive capabilities, they typically process videos largely in a single-pass manner with limited support…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Hong Gao , Yiming Bao , Xuezhen Tu , Yutong Xu , Yue Jin , Yiyang Mu , Bin Zhong , Linan Yue , Min-Ling Zhang

MediaClaw is a multimodal agent platform built on the OpenClaw ecosystem. Its core design follows a three-layer architecture of unified abstraction, pluginized extension, and workflow orchestration. The system is intended to address…

Artificial Intelligence · Computer Science 2026-05-15 Shaoan Zhao , Huanlin Gao , Qiang Hui , Ting Lu , Xueqiang Guo , Yantao Li , Xinpei Su , Fuyuan Shi , Chao Tan , Fang Zhao , Kai Wang , Shiguo Lian