We present DreamLLM-3D, a composite multimodal AI system behind an immersive art installation for dream re-experiencing. It enables automated dream content analysis for immersive dream-reliving, by integrating a Large Language Model (LLM) with text-to-3D Generative AI. The LLM processes voiced dream reports to identify key dream entities (characters and objects), social interaction, and dream sentiment. The extracted entities are visualized as dynamic 3D point clouds, with emotional data influencing the color and soundscapes of the virtual dream environment. Additionally, we propose an experiential AI-Dreamworker Hybrid paradigm. Our system and paradigm could potentially facilitate a more emotionally engaging dream-reliving experience, enhancing personal insights and creativity.
@article{arxiv.2503.16439,
title = {DreamLLM-3D: Affective Dream Reliving using Large Language Model and 3D Generative AI},
author = {Pinyao Liu and Keon Ju Lee and Alexander Steinmaurer and Claudia Picard-Deland and Michelle Carr and Alexandra Kitson},
journal= {arXiv preprint arXiv:2503.16439},
year = {2025}
}
Comments
8 pages, 3 figures, Accepted by NeurIPS creative AI track 2024