English
Related papers

Related papers: Sima 1.0: A Collaborative Multi-Agent Framework fo…

200 papers

While diffusion models generate high-fidelity video clips, transforming them into coherent storytelling engines remains challenging. Current agentic pipelines automate this via chained modules but suffer from semantic drift and cascading…

The proliferation of generative AI has transformed creative workflows, yet current systems face critical challenges in controllability and content protection. We propose a novel multi-agent framework that addresses both limitations through…

Multiagent Systems · Computer Science 2026-01-21 Haris Khan , Sadia Asif

Procedural activity assistants potentially support humans in a variety of settings, from our daily lives, e.g., cooking or assembling flat-pack furniture, to professional situations, e.g., manufacturing or biological experiments. Despite…

Computation and Language · Computer Science 2025-10-02 Kimihiro Hasegawa , Wiradee Imrattanatrai , Masaki Asada , Ken Fukuda , Teruko Mitamura

Creators struggle to edit long-form, narrative-rich videos not because of UI complexity, but due to the cognitive demands of searching, storyboarding, and sequencing hours of footage. Existing transcript- or embedding-based methods fall…

Artificial Intelligence · Computer Science 2025-09-30 Zihan Ding , Xinyi Wang , Junlong Chen , Per Ola Kristensson , Junxiao Shen

Large language models (LLMs) have enabled remarkable advances in automated task-solving with multi-agent systems. However, most existing LLM-based multi-agent approaches rely on predefined agents to handle simple tasks, limiting the…

Artificial Intelligence · Computer Science 2024-05-01 Guangyao Chen , Siwei Dong , Yu Shu , Ge Zhang , Jaward Sesay , Börje F. Karlsson , Jie Fu , Yemin Shi

Large Language Model agents face fundamental challenges in adapting to novel tasks due to limitations in tool availability and experience reuse. Existing approaches either rely on predefined tools with limited coverage or build tools from…

Computation and Language · Computer Science 2025-12-15 Jiarun Liu , Shiyue Xu , Yang Li , Shangkun Liu , Yongli Yu , Peng Cao

User-generated content platforms curate their vast repositories into thematic compilations that facilitate the discovery of high-quality material. Platforms that seek tight editorial control employ people to do this curation, but this…

Human-Computer Interaction · Computer Science 2020-08-13 Yan Chen , Andrés Monroy-Hernández , Ian Wehrman , Steve Oney , Walter S. Lasecki , Rajan Vaish

Instruction-based video editing promises to democratize content creation, yet its progress is severely hampered by the scarcity of large-scale, high-quality training data. We introduce Ditto, a holistic framework designed to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Qingyan Bai , Qiuyu Wang , Hao Ouyang , Yue Yu , Hanlin Wang , Wen Wang , Ka Leong Cheng , Shuailei Ma , Yanhong Zeng , Zichen Liu , Yinghao Xu , Yujun Shen , Qifeng Chen

Recent advancements in Large Language Models (LLMs) have expanded their capabilities to multimodal contexts, including comprehensive video understanding. However, processing extensive videos such as 24-hour CCTV footage or full-length films…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Lu Zhang , Tiancheng Zhao , Heting Ying , Yibo Ma , Kyusong Lee

We present Captain Cinema, a generation framework for short movie generation. Given a detailed textual description of a movie storyline, our approach firstly generates a sequence of keyframes that outline the entire narrative, which ensures…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Junfei Xiao , Ceyuan Yang , Lvmin Zhang , Shengqu Cai , Yang Zhao , Yuwei Guo , Gordon Wetzstein , Maneesh Agrawala , Alan Yuille , Lu Jiang

Modern software engineers operate across 5-10 disconnected tools daily: GitHub, GitLab, Jira, Slack, calendar applications, CI dashboards, AI coding assistants, and container platforms. This fragmentation creates cognitive overhead that…

Software Engineering · Computer Science 2026-04-21 Happy Bhati

System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft…

Artificial Intelligence · Computer Science 2025-07-08 Jeshwanth Challagundla

Traditional animation generation methods depend on training generative models with human-labelled data, entailing a sophisticated multi-stage pipeline that demands substantial human effort and incurs high training costs. Due to limited…

Computation and Language · Computer Science 2024-08-20 Yunxin Li , Haoyuan Shi , Baotian Hu , Longyue Wang , Jiashun Zhu , Jinyi Xu , Zhen Zhao , Min Zhang

This paper presents a hybrid approach to predict the evolution of technological maturity in R and D projects, using the oil and gas sector as an example. Integrating System Dynamics (SD) and Agent Based Modelling (ABM) allows the proposed…

Multiagent Systems · Computer Science 2025-10-14 R. W. S. Pessoa , M. H. Næss , J. C. Bijos , C. M. Rebello , D. Colombo , L. Schnitman , I. B. R. Nogueira

In this work, we present CineMaster, a novel framework for 3D-aware and controllable text-to-video generation. Our goal is to empower users with comparable controllability as professional film directors: precise placement of objects within…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Qinghe Wang , Yawen Luo , Xiaoyu Shi , Xu Jia , Huchuan Lu , Tianfan Xue , Xintao Wang , Pengfei Wan , Di Zhang , Kun Gai

Current AI writing support tools are largely designed for individuals, complicating collaboration when co-writers must leave the shared workspace to use AI and then communicate and reintegrate results. We propose integrating AI agents…

Human-Computer Interaction · Computer Science 2026-02-24 Florian Lehmann , Krystsina Shauchenka , Daniel Buschek

Complex scheduling problems require a large amount computation power and innovative solution methods. The objective of this paper is the conception and implementation of a multi-agent system that is applicable in various problem domains.…

Multiagent Systems · Computer Science 2020-04-21 Peter Hillmann , Tobias Uhlig , Gabi Dreo Rodosek , Oliver Rose

While agentic AI has advanced in automating individual tasks, managing complex multi-agent workflows remains a challenging problem. This paper presents a research vision for autonomous agentic systems that orchestrate collaboration within…

Artificial Intelligence · Computer Science 2025-10-06 Charlie Masters , Advaith Vellanki , Jiangbo Shangguan , Bart Kultys , Jonathan Gilmore , Alastair Moore , Stefano V. Albrecht

Notable breakthroughs in diffusion modeling have propelled rapid improvements in video generation, yet current foundational model still face critical challenges in simultaneously balancing prompt following, motion plausibility, and visual…

Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-form, coherent narratives from high-level concepts like…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Chenyu Mu , Xin He , Qu Yang , Wanshun Chen , Jiadi Yao , Huang Liu , Zihao Yi , Bo Zhao , Xingyu Chen , Ruotian Ma , Fanghua Ye , Erkun Yang , Cheng Deng , Zhaopeng Tu , Xiaolong Li , Linus