English
Related papers

Related papers: DreamLLM-3D: Affective Dream Reliving using Large …

200 papers

Recent conditional 3D completion works have mainly relied on CLIP or BERT to encode textual information, which cannot support complex instruction. Meanwhile, large language models (LLMs) have shown great potential in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jianmeng Liu , Yichen Liu , Yuyao Zhang , Zeyuan Meng , Yu-Wing Tai , Chi-Keung Tang

Machine learning (ML) models have significantly impacted various domains in our everyday lives. While large language models (LLMs) offer intuitive interfaces and versatility, task-specific ML models remain valuable for their efficiency and…

Human-Computer Interaction · Computer Science 2024-12-04 Wataru Kawabe , Yusuke Sugano

The adoption of large language models (LLMs) and autonomous agents in software engineering marks an enduring paradigm shift. These systems create new opportunities for tool design, workflow orchestration, and empirical observation, while…

Software Engineering · Computer Science 2025-11-04 Christoph Treude , Margaret-Anne Storey

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

Since the advent of Large Language Models (LLMs), various research based on such models have maintained significant academic attention and impact, especially in AI and robotics. In this paper, we propose a multi-agent framework with LLMs to…

Robotics · Computer Science 2025-05-12 Junhong Chen , Ziqi Yang , Haoyuan G Xu , Dandan Zhang , George Mylonas

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and…

Artificial Intelligence · Computer Science 2024-07-30 Yun Li , Kai Katsumata , Ehsan Javanmardi , Manabu Tsukada

This work leverages Large Language Models (LLMs) to simulate human mobility, addressing challenges like high costs and privacy concerns in traditional models. Our hierarchical framework integrates persona generation, activity selection, and…

Artificial Intelligence · Computer Science 2025-02-27 Chenlu Ju , Jiaxin Liu , Shobhit Sinha , Hao Xue , Flora Salim

Large language models (LLMs) have taken the scientific world by storm, changing the landscape of natural language processing and human-computer interaction. These powerful tools can answer complex questions and, surprisingly, perform…

Artificial Intelligence · Computer Science 2023-11-14 Pier Luca Lanzi , Daniele Loiacono

The emergence of large language models (LLMs) has revolutionized machine learning and related fields, showcasing remarkable abilities in comprehending, generating, and manipulating human language. However, their conventional usage through…

Computation and Language · Computer Science 2024-04-18 Andrea Bacciu , Florin Cuconasu , Federico Siciliano , Fabrizio Silvestri , Nicola Tonellotto , Giovanni Trappolini

We introduce CinemaWorld, a generative augmented reality system that augments the viewer's physical surroundings with automatically generated mixed reality 3D content extracted from and synchronized with 2D movie scenes. Our system…

Human-Computer Interaction · Computer Science 2026-03-10 Keiichi Ihara , DaeHo Lee , Manato Abe , Hye-Young Jo , Ryo Suzuki

The emergence of Generative Artificial Intelligence (AI) and Large Language Models (LLMs) has marked a new era of Natural Language Processing (NLP), introducing unprecedented capabilities that are revolutionizing various domains. This paper…

Computation and Language · Computer Science 2024-08-26 Desta Haileselassie Hagos , Rick Battle , Danda B. Rawat

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs. LLMR leverages novel strategies to tackle difficult cases where ideal…

Human-Computer Interaction · Computer Science 2024-03-25 Fernanda De La Torre , Cathy Mengying Fang , Han Huang , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data transmission and…

Machine Learning · Computer Science 2025-07-08 Yusong Zhang , Yuxuan Sun , Lei Guo , Wei Chen , Bo Ai , Deniz Gunduz

Embeddings have become a pivotal means to represent complex, multi-faceted information about entities, concepts, and relationships in a condensed and useful format. Nevertheless, they often preclude direct interpretation. While downstream…

This study introduces a transformative framework for medical education by integrating semi-structured data with Large Language Models (LLMs), primarily OpenAIs ChatGPT3.5, to automate the creation of medical simulation scenarios.…

Computation and Language · Computer Science 2024-05-07 Scott Sumpter

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

This paper investigates the potential of AI models, particularly large language models (LLMs), to support knowledge exploration and augment human creativity during ideation. We present "Latent Lab" an interactive tool for discovering…

Artificial Intelligence · Computer Science 2023-11-23 Kevin Dunnell , Trudy Painter , Andrew Stoddard , Andy Lippman

With the rapid development of artificial intelligence (AI), digital humans have attracted more and more attention and are expected to achieve a wide range of applications in several industries. Then, most of the existing digital humans…

Multimedia · Computer Science 2023-11-01 Yingjie Zhou , Yaodong Chen , Kaiyue Bi , Lian Xiong , Hui Liu