English
Related papers

Related papers: Agentic Video Generation: From Text to Executable …

200 papers

Despite the promise of autonomous agentic reasoning, existing workflow generation methods frequently produce fragile, unexecutable plans due to unconstrained LLM-driven construction. We introduce MermaidFlow, a framework that redefines the…

Machine Learning · Computer Science 2025-05-30 Chengqi Zheng , Jianda Chen , Yueming Lyu , Wen Zheng Terence Ng , Haopeng Zhang , Yew-Soon Ong , Ivor Tsang , Haiyan Yin

Scene graphs offer a structured, hierarchical representation of images, with nodes and edges symbolizing objects and the relationships among them. It can serve as a natural interface for image editing, dramatically improving precision and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiyuan Zhang , DongDong Chen , Jing Liao

Multi-agent systems built upon large language models (LLMs) have demonstrated remarkable capabilities in tackling complex compositional tasks. In this work, we apply this paradigm to the paper-to-poster generation problem, a practical yet…

Artificial Intelligence · Computer Science 2026-04-14 Zhilin Zhang , Xiang Zhang , Jiaqi Wei , Yiwei Xu , Chenyu You

We introduce STORY2GAME, a novel approach to using Large Language Models to generate text-based interactive fiction games that starts by generating a story, populates the world, and builds the code for actions in a game engine that enables…

Artificial Intelligence · Computer Science 2025-05-07 Eric Zhou , Shreyas Basavatia , Moontashir Siam , Zexin Chen , Mark O. Riedl

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

Computation and Language · Computer Science 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

Long-form video understanding remains a fundamental challenge for current Video Large Language Models. Most existing models rely on static reasoning over uniformly sampled frames, which weakens temporal localization and leads to substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenglin Li , Qianglong Chen , Feng Han , Yikun Wang , Xingxi Yin , Yan Gong , Ruilin Li , Yin Zhang , Jiaqi Wang

With the growing popularity of generative AI for images, video, and music, we witnessed models rapidly improve in quality and performance. However, not much attention is paid towards enabling AI's ability to "be creative". In this study, we…

Multiagent Systems · Computer Science 2025-09-10 Naomi Imasato , Kazuki Miyazawa , Takayuki Nagai , Takato Horii

We introduce Simulation Streams, a programming paradigm designed to efficiently control and leverage Large Language Models (LLMs) for complex, dynamic simulations and agentic workflows. Our primary goal is to create a minimally interfering…

Artificial Intelligence · Computer Science 2025-02-03 Peter Sunehag , Joel Z. Leibo

We introduce LEAP (illustrated in Figure 1), a novel method for generating video-grounded action programs through use of a Large Language Model (LLM). These action programs represent the motoric, perceptual, and structural aspects of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Eadom Dessalene , Michael Maynord , Cornelia Fermüller , Yiannis Aloimonos

Designing realistic multi-object scenes requires not only generating images, but also planning spatial layouts that respect semantic relations and physical plausibility. On one hand, while recent advances in diffusion models have enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zezhong Fan , Xiaohan Li , Luyi Ma , Kai Zhao , Liang Peng , Topojoy Biswas , Evren Korpeoglu , Kaushiki Nag , Kannan Achan

Entity alignment (EA) aims to identify entities across different knowledge graphs (KGs) that refer to the same real-world object and plays a critical role in knowledge fusion and integration. Traditional EA methods mainly rely on knowledge…

Information Retrieval · Computer Science 2026-04-14 Yixuan Nan , Xixun Lin , Yanmin Shang , Ge Zhang , Zheng Fang , Fang Fang , Yanan Cao

Large language model (LLM)-based multi-agent systems enable expressive agent reasoning but are expensive to scale and poorly calibrated for timestep-aligned state-transition simulation, while classical agent-based models (ABMs) offer…

Multiagent Systems · Computer Science 2026-02-10 Kavana Venkatesh , Yinhan He , Jundong Li , Jiaming Cui

Integrating textual graphs into Large Language Models (LLMs) is promising for complex graph-based QA. However, a key bottleneck is retrieving informative yet compact subgraphs that fit the LLM context. Existing retrievers often struggle,…

Computation and Language · Computer Science 2026-04-23 Ge Chang , Jinbo Su , Jiacheng Liu , Pengfei Yang , Yuhao Shang , Huiwen Zheng , Hongli Ma , Yan Liang , Yuanchun Li , Yunxin Liu

This paper presents a temporal expression language for monitoring AI agent behavior, enabling systematic error-detection of LLM-based agentic systems that exhibit variable outputs due to stochastic generation processes. Drawing from…

Artificial Intelligence · Computer Science 2025-09-26 Thomas J Sheffler

Automatically generating training supervision for embodied tasks is crucial, as manual designing is tedious and not scalable. While prior works use large language models (LLMs) or vision-language models (VLMs) to generate rewards, these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xiaowen Qiu , Yian Wang , Jiting Cai , Zhehuan Chen , Chunru Lin , Tsun-Hsuan Wang , Chuang Gan

Embodied robotic AI systems designed to manage complex daily tasks rely on a task planner to understand and decompose high-level tasks. While most research focuses on enhancing the task-understanding abilities of LLMs/VLMs through…

Robotics · Computer Science 2025-12-23 Zhenglong Guo , Yiming Zhao , Feng Jiang , Heng Jin , Zongbao Feng , Jianbin Zhou , Siyuan Xu

Large Language Models have evolved from single-round generators into long-horizon agents, capable of complex text synthesis scenarios. However, current evaluation frameworks lack the ability to assess the actual synthesis operations, such…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Yu Luo , Bosi Wen , Yidong Wang , Lin Fan , Yilin Zhou , Zikang Wang , Wenbo Yu , Lindong Wu , Hongning Wang , Minlie Huang

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

Synthesizing 3D scenes from open-vocabulary text descriptions is a challenging, important, and recently-popular application. One of its critical subproblems is layout generation: given a set of objects, lay them out to produce a scene…

Data incompleteness severely impedes the reliability of multimodal systems. Existing reconstruction methods face distinct bottlenecks: conventional parametric/generative models are prone to hallucinations due to over-reliance on internal…

Artificial Intelligence · Computer Science 2026-02-05 Ruiting Dai , Zheyu Wang , Haoyu Yang , Yihan Liu , Chengzhi Wang , Zekun Zhang , Zishan Huang , Jiaman Cen , Lisi Mo