English
Related papers

Related papers: Cutscene Agent: An LLM Agent Framework for Automat…

200 papers

The rapid advancement of video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models, primarily due to simple prompts that cannot showcase the model's capabilities, fixed evaluation operators…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yuhang Yang , Ke Fan , Shangkun Sun , Hongxiang Li , Ailing Zeng , FeiLin Han , Wei Zhai , Wei Liu , Yang Cao , Zheng-Jun Zha

We present ChatScene, a Large Language Model (LLM)-based agent that leverages the capabilities of LLMs to generate safety-critical scenarios for autonomous vehicles. Given unstructured language instructions, the agent first generates…

Artificial Intelligence · Computer Science 2024-05-24 Jiawei Zhang , Chejian Xu , Bo Li

Long-form video generation is rapidly moving from short, single-scene synthesis toward minute-long, multi-shot creation with narrative structure, cinematic control, audio, and cross-modal synchronization. However, evaluating such videos…

Computation and Language · Computer Science 2026-05-29 Jiamin Chen , Qianben Chen , Jiawen Zhang , Yidi Wu , Yuchen Li , Xiaokun Zhang , Wangchunshu Zhou , Chen Ma

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction…

Artificial Intelligence · Computer Science 2025-10-22 Abhigya Verma , Seganrasan Subramanian , Nandhakumar Kandasamy , Naman Gupta

This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Ziniu Hu , Ahmet Iscen , Aashi Jain , Thomas Kipf , Yisong Yue , David A. Ross , Cordelia Schmid , Alireza Fathi

Text-to-3D scene generation from natural language is highly desirable for digital content creation. However, existing methods are largely domain-restricted or reliant on predefined spatial relationships, limiting their capacity for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jun Luo , Jiaxiang Tang , Ruijie Lu , Gang Zeng

Existing long-form video generation frameworks lack automated planning, requiring manual input for storylines, scenes, cinematography, and character interactions, resulting in high costs and inefficiencies. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Weijia Wu , Zeyu Zhu , Mike Zheng Shou

Designing 3D scenes is traditionally a challenging task that demands both artistic expertise and proficiency with complex software. Recent advances in text-to-3D generation have greatly simplified this process by letting users create scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zeqi Gu , Yin Cui , Zhaoshuo Li , Fangyin Wei , Yunhao Ge , Jinwei Gu , Ming-Yu Liu , Abe Davis , Yifan Ding

Enabling agents to understand and interact with complex 3D scenes is a fundamental challenge for embodied artificial intelligence systems. While Multimodal Large Language Models (MLLMs) have achieved significant progress in 2D image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Haoyuan Li , Rui Liu , Hehe Fan , Yi Yang

Constructing photorealistic virtual worlds has applications across various fields, but it often requires the extensive labor of highly trained professionals to operate conventional 3D modeling software. To democratize this process, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Xinhang Liu , Chi-Keung Tang , Yu-Wing Tai

Traditional animation generation methods depend on training generative models with human-labelled data, entailing a sophisticated multi-stage pipeline that demands substantial human effort and incurs high training costs. Due to limited…

Computation and Language · Computer Science 2024-08-20 Yunxin Li , Haoyuan Shi , Baotian Hu , Longyue Wang , Jiashun Zhu , Jinyi Xu , Zhen Zhao , Min Zhang

Current video generation models excel at creating short, realistic clips, but struggle with longer, multi-scene videos. We introduce \texttt{DreamFactory}, an LLM-based framework that tackles this challenge. \texttt{DreamFactory} leverages…

Artificial Intelligence · Computer Science 2024-08-22 Zhifei Xie , Daniel Tang , Dingwei Tan , Jacques Klein , Tegawend F. Bissyand , Saad Ezzini

Software development is a complex, multi-phase process traditionally requiring collaboration among individuals with diverse expertise. We propose AgentMesh, a Python-based framework that uses multiple cooperating LLM-powered agents to…

Software Engineering · Computer Science 2025-07-29 Sourena Khanzadeh

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Arafa Yoncalik , Wouter Jansen , Nico Huebel , Mohammad Hasan Rahmani , Jan Steckel

As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive…

Human-Computer Interaction · Computer Science 2026-04-09 Junlong Chen , Jens Grubert , Per Ola Kristensson

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

Existing approaches for digital short-drama production typically rely on one-shot LLM generated scripts and loosely coupled pipelines, which fail to satisfy three key requirements of short-drama generation: (1) narrative pacing, resulting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yufei Shi , Weilong Yan , Naixuan Huang , Yucheng Chen , Chenyu Zhang , Tao He , Si Yong Yeo , Ming Li

For agentic systems to use external tools to solve complex, long-horizon tasks, we need a large set of diverse and controllable tool-use environments. We introduce SynthTools, a fully LLM-based pipeline spanning the entire lifecycle:…

Artificial Intelligence · Computer Science 2026-05-28 Tommaso Castellani , Naimeng Ye , Daksh Mittal , Thomson Yen , Emmanouil Koukoumidis , William Zeng , Hongseok Namkoong

LLM agents are rapidly becoming the practical interface for task automation, yet the ecosystem lacks a principled way to choose among an exploding space of deployable configurations. Existing LLM leaderboards and tool/agent benchmarks…

Artificial Intelligence · Computer Science 2026-03-05 Yunxiao Shi , Wujiang Xu , Tingwei Chen , Haoning Shang , Ling Yang , Yunfeng Wan , Zhuo Cao , Xing Zi , Dimitris N. Metaxas , Min Xu

3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel deep-learning based approach for automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yongzhi Xu , Yonhon Ng , Yifu Wang , Inkyu Sa , Yunfei Duan , Zhenhong Sun , Yang Li , Pan Ji , Hongdong Li