English
Related papers

Related papers: 3D Building Generation in Minecraft via Large Lang…

200 papers

This work explores expanding the capabilities of large language models (LLMs) pretrained on text to generate 3D meshes within a unified model. This offers key advantages of (1) leveraging spatial knowledge already embedded in LLMs, derived…

Machine Learning · Computer Science 2024-11-15 Zhengyi Wang , Jonathan Lorraine , Yikai Wang , Hang Su , Jun Zhu , Sanja Fidler , Xiaohui Zeng

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…

In the pursuit of efficient automated content creation, procedural generation, leveraging modifiable parameters and rule-based systems, emerges as a promising approach. Nonetheless, it could be a demanding endeavor, given its intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Chunyi Sun , Junlin Han , Weijian Deng , Xinlong Wang , Zishan Qin , Stephen Gould

Large Language Models (LLMs) are transforming the way people generate, explore, and engage with content. We study how we can develop LLM applications for online social networks. Despite LLMs' successes in other domains, it is challenging to…

Social and Information Networks · Computer Science 2024-01-08 Jingying Zeng , Richard Huang , Waleed Malik , Langxuan Yin , Bojan Babic , Danny Shacham , Xiao Yan , Jaewon Yang , Qi He

With the recent development of generative models, Text-to-3D generations have also seen significant growth, opening a door for creating video-game 3D assets from a more general public. Nonetheless, people without any professional 3D editing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Zhaoning Wang , Ming Li , Chen Chen

Large language models (LLMs) have taken the scientific world by storm, changing the landscape of natural language processing and human-computer interaction. These powerful tools can answer complex questions and, surprisingly, perform…

Artificial Intelligence · Computer Science 2023-11-14 Pier Luca Lanzi , Daniele Loiacono

The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates…

Human-Computer Interaction · Computer Science 2023-10-25 Yuwen Lu , Ziang Tong , Qinyi Zhao , Chengzhi Zhang , Toby Jia-Jun Li

Diffusion-based generative models have significantly advanced text-to-image generation but encounter challenges when processing lengthy and intricate text prompts describing complex scenes with multiple objects. While excelling in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanan Gani , Shariq Farooq Bhat , Muzammal Naseer , Salman Khan , Peter Wonka

We present a novel framework that integrates Large Language Models (LLMs) with automated planning and formal verification to streamline the creation and use of Markov Decision Processes (MDP). Our system leverages LLMs to extract structured…

Robotics · Computer Science 2026-01-12 Enrico Saccon , Davide De Martini , Matteo Saveriano , Edoardo Lamon , Luigi Palopoli , Marco Roveri

There is a significant potential for coding skills to transition fully to natural language in the future. In this context, large language models (LLMs) have shown impressive natural language processing abilities to generate sophisticated…

Materials Science · Physics 2024-06-25 Prathamesh Satpute , Saurabh Tiwari , Maneet Gupta , Supriyo Ghosh

Large language models (LLMs) with in-context learning have demonstrated remarkable capability in the text-to-SQL task. Previous research has prompted LLMs with various demonstration-retrieval strategies and intermediate reasoning steps to…

Computation and Language · Computer Science 2023-11-28 Shuaichen Chang , Eric Fosler-Lussier

With the vast and dynamic user-generated content on Roblox, creating effective game recommendations requires a deep understanding of game content. Traditional recommendation models struggle with the inconsistent and sparse nature of game…

Information Retrieval · Computer Science 2025-02-12 Chen Wang , Xiaokai Wei , Yexi Jiang , Frank Ong , Kevin Gao , Xiao Yu , Zheng Hui , Se-eun Yoon , Philip Yu , Michelle Gong

Large Language Models (LLMs) reasoning abilities are increasingly being applied to classical board and card games, but the dominant approach -- involving prompting for direct move generation -- has significant drawbacks. It relies on the…

Large Language Models (LLMs) are used for many different software engineering tasks. In software architecture, they have been applied to tasks such as classification of design decisions, detection of design patterns, and generation of…

Software Engineering · Computer Science 2025-05-23 Larissa Schmid , Tobias Hey , Martin Armbruster , Sophie Corallo , Dominik Fuchß , Jan Keim , Haoyu Liu , Anne Koziolek

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Arafa Yoncalik , Wouter Jansen , Nico Huebel , Mohammad Hasan Rahmani , Jan Steckel

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

Recent research has demonstrated that large language models (LLMs) can support experts across various domains, including game design. In this study, we examine the utility of medium-sized LLMs, models that operate on consumer-grade hardware…

Human-Computer Interaction · Computer Science 2026-05-19 Julian Geheeb , Farhan Abid Ivan , Daniel Dyrda , Miriam Anschütz , Georg Groh

Table processing, a key task in natural language processing, has significantly benefited from recent advancements in language models (LMs). However, the capabilities of LMs in table-to-text generation, which transforms structured data into…

Computation and Language · Computer Science 2024-10-18 Sahar Iravani , Tim . O . F Conrad

Large Language Models (LLM) show strong abilities in code generation, but their skill in creating efficient parallel programs is less studied. This paper explores how LLMs generate task-based parallel code from three kinds of input prompts:…

Programming Languages · Computer Science 2026-02-27 Linus Bantel , Moritz Strack , Alexander Strack , Dirk Pflüger

Significant efforts has been made to expand the use of Large Language Models (LLMs) beyond basic language tasks. While the generalizability and versatility of LLMs have enabled widespread adoption, evolving demands in application…

Software Engineering · Computer Science 2024-11-20 Dawen Zhang , Xiwei Xu , Chen Wang , Zhenchang Xing , Robert Mao