English
Related papers

Related papers: From Voices to Worlds: Developing an AI-Powered Fr…

200 papers

Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chenghao Li , Chaoning Zhang , Joseph Cho , Atish Waghwase , Lik-Hang Lee , Francois Rameau , Yang Yang , Sung-Ho Bae , Choong Seon Hong

Traditional augmented reality (AR) systems predominantly rely on fixed class detectors or fiducial markers, limiting their ability to interpret complex, open-vocabulary natural language queries. We present a modular AR agent system that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Lixing Guo , Tobias Höllerer

Explorable 3D world generation from a single image or text prompt forms a cornerstone of spatial intelligence. Recent works utilize video model to achieve wide-scope and generalizable 3D world generation. However, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zhongqi Yang , Wenhang Ge , Yuqi Li , Jiaqi Chen , Haoyuan Li , Mengyin An , Fei Kang , Hua Xue , Baixin Xu , Yuyang Yin , Eric Li , Yang Liu , Yikai Wang , Hao-Xiang Guo , Yahui Zhou

Large language models (LLMs) have exhibited remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. Despite the recent success, current LLMs are not capable of processing…

This paper introduces a new architectural design framework that utilizes generative AI tools including ChatGPT and Veras with parametric modeling and Building Information Modeling (BIM) to enhance the design process. The study experiments…

Human-Computer Interaction · Computer Science 2023-08-02 Jaechang Ko , John Ajibefun , Wei Yan

Text-to-3D generative AI systems create navigable environments from natural language prompts, but unlike text-to-image generation, evaluation requires embodied exploration of spatial coherence, scale, and navigability. We present the first…

Human-Computer Interaction · Computer Science 2026-03-17 Aung Pyae

Articulated 3D object generation is fundamental for creating realistic, functional, and interactable virtual assets which are not simply static. We introduce MeshArt, a hierarchical transformer-based approach to generate articulated 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Daoyi Gao , Yawar Siddiqui , Lei Li , Angela Dai

The demand for innovation in product design necessitates a prolific ideation phase. Conversational AI (CAI) systems that use Large Language Models (LLMs) such as GPT (Generative Pre-trained Transformer) have been shown to be fruitful in…

Artificial Intelligence · Computer Science 2025-05-19 B. Sankar , Dibakar Sen

In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent text-based…

Sound · Computer Science 2025-07-08 Kaung Myat Kyaw , Jonathan Hoyin Chan

Articulated objects are central to interactive 3D applications, including embodied AI, robotics, and VR/AR, where functional part decomposition and kinematic motion are essential. Yet producing high-fidelity articulated assets remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Qingming Liu , Xinyue Yao , Shuyuan Zhang , Yueci Deng , Guiliang Liu , Zhen Liu , Kui Jia

Indoor scene modification has emerged as a prominent area within computer vision, particularly for its applications in Augmented Reality (AR) and Virtual Reality (VR). Traditional methods often rely on pre-existing object databases and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yiyang Luo , Ke Lin , Chao Gu

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object…

Computation and Language · Computer Science 2015-06-08 Angel Chang , Will Monroe , Manolis Savva , Christopher Potts , Christopher D. Manning

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

Articulated object generation has seen increasing advancements, yet existing models often lack the ability to be conditioned on text prompts. To address the significant gap between textual descriptions and 3D articulated object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hao Sun , Lei Fan , Donglin Di , Shaohui Liu

With the rapid development of artificial intelligence (AI), digital humans have attracted more and more attention and are expected to achieve a wide range of applications in several industries. Then, most of the existing digital humans…

Multimedia · Computer Science 2023-11-01 Yingjie Zhou , Yaodong Chen , Kaiyue Bi , Lian Xiong , Hui Liu

Metamaterials, renowned for their exceptional mechanical, electromagnetic, and thermal properties, hold transformative potential across diverse applications, yet their design remains constrained by labor-intensive trial-and-error methods…

Recent advancements in multi-modal large language models (MLLMs) have shown strong potential for 3D scene understanding. However, existing methods struggle with fine-grained object grounding and contextual reasoning, limiting their ability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Haifeng Huang , Yilun Chen , Zehan Wang , Jiangmiao Pang , Zhou Zhao

Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework…

Human-Computer Interaction · Computer Science 2024-10-03 Amina Kobenova , Cyan DeVeaux , Samyak Parajuli , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

As augmented reality (AR) applications increasingly require 3D content, generative pipelines driven by natural input such as speech offer an alternative to manual asset creation. In this work, we design a modular, edge-assisted architecture…

Human-Computer Interaction · Computer Science 2025-08-19 Yanming Xiu , Joshua Chilukuri , Shunav Sen , Maria Gorlatova

The integration of generative artificial intelligence (AI) into architectural design has advanced significantly, enabling the generation of text, images, and 3D models. However, prior AI applications lack support for text-to-parametric…

Human-Computer Interaction · Computer Science 2025-05-20 Guangxi Feng , Wei Yan