English
Related papers

Related papers: Transcending Dimensions using Generative AI: Real-…

200 papers

This paper presents Matrix, an advanced AI-powered framework designed for real-time 3D object generation in Augmented Reality (AR) environments. By integrating a cutting-edge text-to-3D generative AI model, multilingual speech-to-text…

Human-Computer Interaction · Computer Science 2025-03-24 Majid Behravan , Denis Gracanin

Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chenghao Li , Chaoning Zhang , Joseph Cho , Atish Waghwase , Lik-Hang Lee , Francois Rameau , Yang Yang , Sung-Ho Bae , Choong Seon Hong

This paper presents an in-depth exploration of 3D human model and avatar generation technology, propelled by the rapid advancements in large-scale models and artificial intelligence. The paper reviews the comprehensive process of 3D human…

Graphics · Computer Science 2024-06-04 Lei Liu , Ke Zhao

Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework…

Human-Computer Interaction · Computer Science 2024-10-03 Amina Kobenova , Cyan DeVeaux , Samyak Parajuli , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

The research field of augmented reality (AR) is of increasing popularity, as seen, among others, in several recently published surveys. To produce further advancements in AR, it is not only necessary to create new systems or applications,…

Human-Computer Interaction · Computer Science 2021-04-09 Marc Satkowski , Wolfgang Büschel , Raimund Dachselt

This paper introduces Generative Augmented Reality (GAR) as a next-generation paradigm that reframes augmentation as a process of world re-synthesis rather than world composition by a conventional AR engine. GAR replaces the conventional AR…

Human-Computer Interaction · Computer Science 2025-11-24 Chen Liang , Jiawen Zheng , Yufeng Zeng , Yi Tan , Hengye Lyu , Yuhui Zheng , Zisu Li , Yueting Weng , Jiaxin Shi , Hanwang Zhang

Advances in Generative AI tools have allowed designers to manipulate existing 3D models using text or image-based prompts, enabling creators to explore different design goals. Photochromic color-changing systems, on the other hand, allow…

Human-Computer Interaction · Computer Science 2024-04-29 Yunyi Zhu , Faraz Faruqi , Stefanie Mueller

Artificial Intelligence-Generated Content (AIGC) has the potential to transform how people build and interact with virtual environments. Within this paper, we discuss potential benefits but also challenges that AIGC has for the creation of…

Human-Computer Interaction · Computer Science 2024-11-01 Jens Grubert , Junlong Chen , Per Ola Kristensson

Augmented Reality (AR) enriches a user's real environment by adding spatially aligned virtual objects (3D models, 2D textures, textual annotations, etc) by means of special display technologies. These are either worn on the body or placed…

Human-Computer Interaction · Computer Science 2021-03-05 Holger Regenbrecht , Thomas Schubert

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

While AI-generated text and 2D images continue to expand its territory, 3D generation has gradually emerged as a trend that cannot be ignored. Since the year 2023 an abundant amount of research papers has emerged in the domain of 3D…

Artificial Intelligence · Computer Science 2024-01-08 Song Bai , Jie Li

Generative artificial intelligence has recently progressed from static image and video synthesis to 3D content generation, culminating in the emergence of 4D generation-the task of synthesizing temporally coherent dynamic 3D assets guided…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Qiaowei Miao , Kehan Li , Jinsheng Quan , Zhiyuan Min , Shaojie Ma , Yichao Xu , Yi Yang , Ping Liu , Yawei Luo

Augmented Reality (AR) is a powerful perceptual technology that can alter what users see, hear, feel, and experience throughout their daily lives. When combined with the speed and flexibility of context-aware generative AI, the power is…

Computers and Society · Computer Science 2026-01-28 Louis Rosenberg

Generative Adversarial Networks (GANs) have emerged as a significant player in generative modeling by mapping lower-dimensional random noise to higher-dimensional spaces. These networks have been used to generate high-resolution images and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Satya Pratheek Tata , Subhankar Mishra

World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphasizes generative methods for 2D image and video data, they…

We present a significant breakthrough in 3D shape generation by scaling it to unprecedented dimensions. Through the adaptation of the Auto-Regressive model and the utilization of large language models, we have developed a remarkable model…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yu Wang , Xuelin Qian , Jingyang Huo , Tiejun Huang , Bo Zhao , Yanwei Fu

Social interactions incorporate nonverbal signals to convey emotions alongside speech, including facial expressions and body gestures. Generative models have demonstrated promising results in creating full-body nonverbal animations…

Human-Computer Interaction · Computer Science 2026-04-01 Kiran Chhatre , Renan Guarese , Andrii Matviienko , Christopher Peters

Photo-realistic and controllable 3D avatars are crucial for various applications such as virtual and mixed reality (VR/MR), telepresence, gaming, and film production. Traditional methods for avatar creation often involve time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Keqiang Sun , Amin Jourabloo , Riddhish Bhalodia , Moustafa Meshry , Yu Rong , Zhengyu Yang , Thu Nguyen-Phuoc , Christian Haene , Jiu Xu , Sam Johnson , Hongsheng Li , Sofien Bouaziz

Generating 3D models lies at the core of computer graphics and has been the focus of decades of research. With the emergence of advanced neural representations and generative models, the field of 3D content generation is developing rapidly,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xiaoyu Li , Qi Zhang , Di Kang , Weihao Cheng , Yiming Gao , Jingbo Zhang , Zhihao Liang , Jing Liao , Yan-Pei Cao , Ying Shan