English
Related papers

Related papers: World Craft: Agentic Framework to Create Visualiza…

200 papers

Large Language Models (LLM) based agents have shown promise in autonomously completing tasks across various domains, e.g., robotics, games, and web navigation. However, these agents typically require elaborate design and expert prompts to…

Artificial Intelligence · Computer Science 2024-11-12 Minghao Chen , Yihang Li , Yanting Yang , Shiyu Yu , Binbin Lin , Xiaofei He

3D generation from natural language offers significant potential to reduce expert manual modeling efforts and enhance accessibility to 3D assets. However, existing methods often yield unstructured meshes and exhibit poor interactivity,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuyuan Zhang , Chenhan Jiang , Zuoou Li , Jiankang Deng

Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely…

Artificial Intelligence · Computer Science 2025-12-30 Mengkang Hu , Bowei Xia , Yuran Wu , Ailing Yu , Yude Zou , Qiguang Chen , Shijian Wang , Jiarui Jin , Kexin Li , Wenxiang Jiao , Yuan Lu , Ping Luo

Despite the promise of autonomous agentic reasoning, existing workflow generation methods frequently produce fragile, unexecutable plans due to unconstrained LLM-driven construction. We introduce MermaidFlow, a framework that redefines the…

Machine Learning · Computer Science 2025-05-30 Chengqi Zheng , Jianda Chen , Yueming Lyu , Wen Zheng Terence Ng , Haopeng Zhang , Yew-Soon Ong , Ivor Tsang , Haiyan Yin

Programming a robotic is a complex task, as it demands the user to have a good command of specific programming languages and awareness of the robot's physical constraints. We propose a framework that simplifies robot deployment by allowing…

Human-Computer Interaction · Computer Science 2024-07-18 Cathy Mengying Fang , Krzysztof Zieliński , Pattie Maes , Joe Paradiso , Bruce Blumberg , Mikkel Baun Kjærgaard

Image generation models have evolved from text-conditioned pixel synthesis toward multimodal agents endowed with visual comprehension and tool invocation capabilities. Yet, existing agents remain at the mercy of underlying black-box image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Junyan Ye , Jun He , Zilong Huang , Dongzhi Jiang , Xuan Yang , Rui Chen , Weijia Li

Large Language Models (LLMs) have demonstrated remarkable potential in scientific domains, yet a fundamental question remains unanswered: Can we simulate human research communities with LLMs? Addressing this question can deepen our…

Computation and Language · Computer Science 2025-06-09 Haofei Yu , Zhaochen Hong , Zirui Cheng , Kunlun Zhu , Keyang Xuan , Jinwei Yao , Tao Feng , Jiaxuan You

Immersive authoring provides an intuitive medium for users to create 3D scenes via direct manipulation in Virtual Reality (VR). Recent advances in generative AI have enabled the automatic creation of realistic 3D layouts. However, it is…

Human-Computer Interaction · Computer Science 2024-08-20 Lei Zhang , Jin Pan , Jacob Gettig , Steve Oney , Anhong Guo

Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction…

Artificial Intelligence · Computer Science 2025-05-28 Kaiming Liu , Xuanyu Lei , Ziyue Wang , Peng Li , Yang Liu

Despite recent advances in multimodal content generation enabled by vision-language models (VLMs), their ability to reason about and generate structured 3D scenes remains largely underexplored. This limitation constrains their utility in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

The rapid evolution of Large Language Models (LLM) and subsequent Agentic AI technologies requires systematic architectural guidance for building sophisticated, production-grade systems. This paper presents an approach for architecting such…

Artificial Intelligence · Computer Science 2026-05-26 Zoran Milosevic , Fethi Rabhi

This work introduces World-GAN, the first method to perform data-driven Procedural Content Generation via Machine Learning in Minecraft from a single example. Based on a 3D Generative Adversarial Network (GAN) architecture, we are able to…

Machine Learning · Computer Science 2021-06-21 Maren Awiszus , Frederik Schubert , Bodo Rosenhahn

World models have shown great utility in improving the task performance of embodied agents. While prior work largely focuses on pixel-space world models, these approaches face practical limitations in GUI settings, where predicting complex…

Artificial Intelligence · Computer Science 2025-12-17 Shufan Li , Konstantinos Kallidromitis , Akash Gokul , Yusuke Kato , Kazuki Kozuka , Aditya Grover

The generative capabilities of Large Language Models (LLMs) are rapidly expanding from static code to dynamic, interactive visual artifacts. This progress is bottlenecked by a critical evaluation gap: established benchmarks focus on…

Large Language Models (LLMs) trained using massive text datasets have recently shown promise in generating action plans for robotic agents from high level text queries. However, these models typically do not consider the robot's…

Robotics · Computer Science 2023-05-03 Maitrey Gramopadhye , Daniel Szafir

It is challenging to generate the code for a complete user interface using a Large Language Model (LLM). User interfaces are complex and their implementations often consist of multiple, inter-related files that together specify the contents…

Human-Computer Interaction · Computer Science 2025-08-29 Jazbo Beason , Ruijia Cheng , Eldon Schoop , Jeffrey Nichols

Artificial Intelligence is moving from models that only generate text to Agentic AI, where systems behave as autonomous entities that can perceive, reason, plan, and act. Large Language Models (LLMs) are no longer used only as passive…

Artificial Intelligence · Computer Science 2026-01-21 Arunkumar V , Gangadharan G. R. , Rajkumar Buyya

AI agentic programming is an emerging paradigm where large language model (LLM)-based coding agents autonomously plan, execute, and interact with tools such as compilers, debuggers, and version control systems. Unlike conventional code…

Software Engineering · Computer Science 2025-09-16 Huanting Wang , Jingzhi Gong , Huawei Zhang , Jie Xu , Zheng Wang

Large Language Models (LLMs) enhance their problem-solving capability by utilizing external tools. However, in open-world scenarios with massive and evolving tool repositories, existing methods relying on static embedding retrieval or…

Computation and Language · Computer Science 2026-04-16 Shouzheng Huang , Meishan Zhang , Baotian Hu , Min Zhang

Applying reinforcement learning (RL) to real-world tasks requires converting informal descriptions into a formal Markov decision process (MDP), implementing an executable environment, and training a policy agent. Automating this process is…

Artificial Intelligence · Computer Science 2025-12-15 Hong Je-Gal , Chan-Bin Yi , Hyun-Suk Lee