English
Related papers

Related papers: ShapeCraft: LLM Agents for Structured, Textured an…

200 papers

Large language models (LLMs) have achieved great success in many fields, and recent works have studied exploring LLMs for graph discriminative tasks such as node classification. However, the abilities of LLMs for graph generation remain…

Machine Learning · Computer Science 2024-03-22 Yang Yao , Xin Wang , Zeyang Zhang , Yijian Qin , Ziwei Zhang , Xu Chu , Yuekui Yang , Wenwu Zhu , Hong Mei

Recent advances in vision language models (VLMs) have shown strong potential for spatial reasoning and 3D scene layout generation from open-ended language instructions. However, generating layouts that are not only semantically coherent but…

Artificial Intelligence · Computer Science 2026-03-10 Ali Shamsaddinlou

Computer-aided design (CAD) is fundamental to modern engineering and manufacturing, but creating CAD models still requires expert knowledge and specialized software. Recent advances in large language models (LLMs) open up the possibility of…

Artificial Intelligence · Computer Science 2025-05-13 Haoyang Xie , Feng Ju

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Web scraping is a powerful technique that extracts data from websites, enabling automated data collection, enhancing data analysis capabilities, and minimizing manual data entry efforts. Existing methods, wrappers-based methods suffer from…

Computation and Language · Computer Science 2024-09-27 Wenhao Huang , Zhouhong Gu , Chenghao Peng , Zhixu Li , Jiaqing Liang , Yanghua Xiao , Liqian Wen , Zulong Chen

There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jianqiang Ren , Chao He , Lin Liu , Jiahao Chen , Yutong Wang , Yafei Song , Jianfang Li , Tangli Xue , Siqi Hu , Tao Chen , Kunkun Zheng , Jianjing Xiang , Liefeng Bo

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

Dynamic scenes contain intricate spatio-temporal information, crucial for mobile robots, UAVs, and autonomous driving systems to make informed decisions. Parsing these scenes into semantic triplets <Subject-Predicate-Object> for accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Hang Zhang , Zhuoling Li , Jun Liu

The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological…

Computation and Language · Computer Science 2025-01-22 Yaoxiang Wang , Zhiyong Wu , Junfeng Yao , Jinsong Su

As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive…

Human-Computer Interaction · Computer Science 2026-04-09 Junlong Chen , Jens Grubert , Per Ola Kristensson

We introduce PartCrafter, the first structured 3D generative model that jointly synthesizes multiple semantically meaningful and geometrically distinct 3D meshes from a single RGB image. Unlike existing methods that either produce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yuchen Lin , Chenguo Lin , Panwang Pan , Honglei Yan , Yiqiang Feng , Yadong Mu , Katerina Fragkiadaki

Generating natural human grasps necessitates consideration of not just object geometry but also semantic information. Solely depending on object shape for grasp generation confines the applications of prior methods in downstream tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kailin Li , Jingbo Wang , Lixin Yang , Cewu Lu , Bo Dai

In the last years' digitalization process, the creation and management of documents in various domains, particularly in Public Administration (PA), have become increasingly complex and diverse. This complexity arises from the need to handle…

Computation and Language · Computer Science 2024-02-26 Emanuele Musumeci , Michele Brienza , Vincenzo Suriani , Daniele Nardi , Domenico Daniele Bloisi

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Recent Multi-Modal Large Language Models (MLLMs) have demonstrated strong capabilities in learning joint representations from text and images. However, their spatial reasoning remains limited. We introduce 3DFroMLLM, a novel framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Noor Ahmed , Cameron Braunstein , Steffen Eger , Eddy Ilg

Text-to-3D generation is to craft a 3D object according to a natural language description. This can significantly reduce the workload for manually designing 3D models and provide a more natural way of interaction for users. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Han Yi , Zhedong Zheng , Xiangyu Xu , Tat-seng Chua

Decades of cognitive science establish that humans navigate environments by forming cognitive maps, defined as allocentric and topology-preserving representations of 3D space. While modern Vision-Language Models (VLMs) demonstrate emergent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haoming Wang , Wei Gao

Synthesizing 3D scenes from open-vocabulary text descriptions is a challenging, important, and recently-popular application. One of its critical subproblems is layout generation: given a set of objects, lay them out to produce a scene…

Cutscenes are carefully choreographed cinematic sequences embedded in video games and interactive media, serving as the primary vehicle for narrative delivery, character development, and emotional engagement. Producing cutscenes is…

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object…

Computation and Language · Computer Science 2015-06-08 Angel Chang , Will Monroe , Manolis Savva , Christopher Potts , Christopher D. Manning