English
Related papers

Related papers: Sima 1.0: A Collaborative Multi-Agent Framework fo…

200 papers

Synthetic data has become increasingly important for training large language models, especially when real data is scarce, expensive, or privacy-sensitive. Many such generation tasks require coordinated multi-agent workflows, where…

With the advancement of generative models, the synthesis of different sensory elements such as music, visuals, and speech has achieved significant realism. However, the approach to generate multi-sensory outputs has not been fully explored,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Minheng Ni , Chenfei Wu , Huaying Yuan , Zhengyuan Yang , Ming Gong , Lijuan Wang , Zicheng Liu , Wangmeng Zuo , Nan Duan

Creating data stories from raw data is challenging due to humans' limited attention spans and the need for specialized skills. Recent advancements in large language models (LLMs) offer great opportunities to develop systems with autonomous…

Human-Computer Interaction · Computer Science 2024-08-08 Leixian Shen , Haotian Li , Yun Wang , Huamin Qu

Recent advancements in the field of AI agents have impacted the way we work, enabling greater automation and collaboration between humans and agents. In the data visualization field, multi-agent systems can be useful for employing agents…

Artificial Intelligence · Computer Science 2025-09-03 Anton Wolter , Georgios Vidalakis , Michael Yu , Ankit Grover , Vaishali Dhanoa

Developing trustworthy multi-agent systems for practical applications is challenging due to the complicated communication of situational awareness (SA) among agents. This paper showcases a novel efficient and easy-to-use software framework…

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinglin Zeng , Kaitong Cai , Ruiqi Chen , Qinhan Lv , Keze Wang

Automated tools for video editing and assembly have applications ranging from filmmaking and advertisement to content creation for social media. Previous video editing work has mainly focused on either retrieval or user interfaces, leaving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Marcelo Sandoval-Castaneda , Bryan Russell , Josef Sivic , Gregory Shakhnarovich , Fabian Caba Heilbron

Training AI agents to proactively assist humans in daily activities, from routine household tasks to urgent safety situations, requires large-scale visual data. However, capturing such scenarios in the real world is often difficult, costly,…

Computation and Language · Computer Science 2026-05-12 Yu-Hsiang Liu , Yu-Chien Tang , An-Zi Yen

Preparing high-quality instructional materials remains a labor-intensive process that often requires extensive coordination among teaching faculty, instructional designers, and teaching assistants. In this work, we present Instructional…

Artificial Intelligence · Computer Science 2026-02-03 Huaiyuan Yao , Wanpeng Xu , Justin Turnau , Nadia Kellam , Hua Wei

Multi-agent applications have recently gained significant popularity. In many computer vision tasks, a network of agents, such as a team of robots with cameras, could work collaboratively to perceive the environment for efficient and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Shuyue Lan , Zhilu Wang , Ermin Wei , Amit K. Roy-Chowdhury , Qi Zhu

The surging demand for adapting long-form cinematic content into short videos has motivated the need for versatile automatic video compilation systems. However, existing compilation methods are limited to predefined tasks, and the community…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Peixuan Zhang , Chang Zhou , Ziyuan Zhang , Hualuo Liu , Chunjie Zhang , Jingqi Liu , Xiaohui Zhou , Xi Chen , Shuchen Weng , Si Li , Boxin Shi

We present AniME, a director-oriented multi-agent system for automated long-form anime production, covering the full workflow from a story to the final video. The director agent keeps a global memory for the whole workflow, and coordinates…

Artificial Intelligence · Computer Science 2025-10-13 Lisai Zhang , Baohan Xu , Siqian Yang , Mingyu Yin , Jing Liu , Chao Xu , Siqi Wang , Yidi Wu , Yuxin Hong , Zihao Zhang , Yanzhang Liang , Yudong Jiang

Recent advances in large language models (LLMs) have substantially accelerated the development of embodied agents. LLM-based multi-agent systems mitigate the inefficiency of single agents in complex tasks. However, they still suffer from…

Emerging Technologies · Computer Science 2026-02-02 XiaoJie Zhang , JianHan Wu , Xiaoyang Qu , Jianzong Wang

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction…

Artificial Intelligence · Computer Science 2025-10-22 Abhigya Verma , Seganrasan Subramanian , Nandhakumar Kandasamy , Naman Gupta

We present Mind-of-Director, a multi-modal agent-driven framework for film previz that models the collaborative decision-making process of a film production team. Given a creative idea, Mind-of-Director orchestrates multiple specialized…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shufeng Nan , Mengtian Li , Sixiao Zheng , Yuwei Lu , Han Zhang , Yanwei Fu

Generating engaging, accurate short-form videos from scientific papers is challenging due to content complexity and the gap between expert authors and readers. Existing end-to-end methods often suffer from factual inaccuracies and visual…

Computation and Language · Computer Science 2025-04-29 Jong Inn Park , Maanas Taneja , Qianwen Wang , Dongyeop Kang

This paper presents an integrated multi-agents architecture for indexing and retrieving video information.The focus of our work is to elaborate an extensible approach that gathers a priori almost of the mandatory tools which palliate to the…

Information Retrieval · Computer Science 2014-08-01 Yasser El Madani El Alami , El Habib Nfaoui , Omar El Beqqali

Training multimodal large language models (MLLMs) for video understanding requires large-scale annotated data spanning diverse tasks such as object counting, question answering, and segmentation. However, collecting and annotating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tanzila Rahman , Renjie Liao , Leonid Sigal

Traditional data processing pipelines are typically static and handcrafted for specific tasks, limiting their adaptability to evolving requirements. While general-purpose agents and coding assistants can generate code for well-understood…

Artificial Intelligence · Computer Science 2026-02-20 Udayan Khurana

We present an agentic AI framework for autonomous multimodal query processing that coordinates specialized tools across text, image, audio, video, and document modalities. A central Supervisor dynamically decomposes user queries, delegates…

Computation and Language · Computer Science 2026-03-16 Mayank Saini , Arit Kumar Bishwas