English
Related papers

Related papers: VRCopilot: Authoring 3D Layouts with Generative AI…

200 papers

Advances in language modeling have paved the way for novel human-AI co-writing experiences. This paper explores how varying levels of scaffolding from large language models (LLMs) shape the co-writing process. Employing a within-subjects…

Human-Computer Interaction · Computer Science 2024-02-20 Paramveer S. Dhillon , Somayeh Molaei , Jiaqi Li , Maximilian Golub , Shaochun Zheng , Lionel P. Robert

AI Advancements have augmented casual writing and story generation, but their usage poses challenges in collaborative storytelling. In role-playing games such as Dungeons & Dragons (D&D), composing prompts using generative AI requires a…

Human-Computer Interaction · Computer Science 2023-04-05 Jose Ma. Santiago , Richard Lance Parayno , Jordan Aiko Deja , Briane Paul V. Samson

Robots are moving beyond industrial settings into creative, educational, and public environments where interaction is open-ended and improvisational. Yet much of human-AI-robot interaction remains framed around performance and efficiency,…

Human-Computer Interaction · Computer Science 2026-03-10 Jordan Aiko Deja , Isidro Butaslac , Nicko Reginio Caluya , Maheshya Weerasinghe

Immersive analytics is gaining attention across multiple domains due to its capability to facilitate intuitive data analysis in expansive environments through user interaction with data. However, creating immersive analytics systems for…

Human-Computer Interaction · Computer Science 2025-07-15 Suemin Jeon , JunYoung Choi , Haejin Jeong , Won-Ki Jeong

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that…

Human-Computer Interaction · Computer Science 2026-03-30 Sirui Tao , Ivan Liang , Cindy Peng , Zhiqing Wang , Srishti Palani , Steven P. Dow

The Piping and Instrumentation Diagrams (P&IDs) are foundational to the design, construction, and operation of workflows in the engineering and process industries. However, their manual creation is often labor-intensive, error-prone, and…

Machine Learning · Computer Science 2024-12-18 Shreeyash Gowaikar , Srinivasan Iyengar , Sameer Segal , Shivkumar Kalyanaraman

Drawing supports learning by externalizing mental models, but providing timely feedback at scale remains challenging. We present Draw2Learn, a system that explores how AI can act as a supportive teammate during drawing-based learning. The…

Human-Computer Interaction · Computer Science 2026-02-03 Yuqi Hang

LLM/VLM-based digital agents have advanced rapidly thanks to scalable sandboxes for coding, web navigation, and computer use, which provide rich interactive training grounds. In contrast, embodied agents still lack abundant, diverse, and…

Artificial Intelligence · Computer Science 2026-05-14 Haoqiang Kang , Xiaokang Ye , Yuhan Liu , Siddhant Hitesh Mantri , Lingjun Mao , James Fleming , Drishti Regmi , Lianhui Qin

Automated generation and (user) authoring of the realistic virtual terrain is most sought for by the multimedia applications like VR models and gaming. The most common representation adopted for terrain is Digital Elevation Model (DEM).…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Shanthika Naik , Aryamaan Jain , Avinash Sharma , KS Rajan

GitHub's Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs, such as generating summaries of changes or providing complete walkthroughs with links to the relevant code. As this…

Software Engineering · Computer Science 2024-02-15 Tao Xiao , Hideaki Hata , Christoph Treude , Kenichi Matsumoto

Recent neural generation systems have demonstrated the potential for procedurally generating game content, images, stories, and more. However, most neural generation algorithms are "uncontrolled" in the sense that the user has little say in…

Artificial Intelligence · Computer Science 2022-08-08 Zhiyu Lin , Rohan Agarwal , Mark Riedl

To allow non-designers' involvement in design projects new methods are needed. Co-design gives the same opportunity to all the multidisciplinary participants to co-create ideas simultaneously. Nevertheless, current co-design processes…

Human-Computer Interaction · Computer Science 2019-06-27 Tomás Dorta , Stéphane Safin , Sana Boudhraâ , Emmanuel Beaudry Marchand

Virtual reality (VR) has re-emerged as a low-cost, highly accessible consumer product, and training on simulators is rapidly becoming standard in many industrial sectors. However, the available systems are either focusing on gaming context,…

Context-aware AR instruction enables adaptive and in-situ learning experiences. However, hardware limitations and expertise requirements constrain the creation of such instructions. With recent developments in Generative Artificial…

Human-Computer Interaction · Computer Science 2025-01-29 Jingyu Shi , Rahul Jain , Seungguen Chi , Hyungjun Doh , Hyunggun Chi , Alexander J. Quinn , Karthik Ramani

Generative AI, i.e., the group of technologies that automatically generate visual or written content based on text prompts, has undergone a leap in complexity and become widely available within just a few years. Such technologies…

Human-Computer Interaction · Computer Science 2023-03-17 Nanna Inie , Jeanette Falk , Steven Tanimoto

Large language models trained for code generation can be applied to speaking virtual worlds into existence (creating virtual worlds). In this work we show that prompt-based methods can both accelerate in-VR level editing, as well as can…

Human-Computer Interaction · Computer Science 2022-11-14 Jasmine Roberts , Andrzej Banburski-Fahey , Jaron Lanier

3D layout generation and editing play a crucial role in Embodied AI and immersive VR interaction. However, manual creation requires tedious labor, while data-driven generation often lacks diversity. The emergence of large models introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haiyan Jiang , Deyu Zhang , Dongdong Weng , Weitao Song , Henry Been-Lirn Duh

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without…

Human-Computer Interaction · Computer Science 2022-07-05 Alexander Schäfer , Gerd Reis , Didier Stricker

Recent advances in artificial intelligence have created new possibilities for making education more scalable, adaptive, and learner-centered. However, existing educational chatbot systems often lack contextual adaptability, real-time…

Computation and Language · Computer Science 2026-02-10 Mohamed El Hajji , Tarek Ait Baha , Aicha Dakir , Hammou Fadili , Youssef Es-Saady

The ways people remember and recall places reveal an invisible aspect of cultural heritage (CH), reflecting how individuals and communities relate to these places. Heritage is communal, emerging through collaboratively constructed…

Human-Computer Interaction · Computer Science 2026-04-17 Yushang Yang , Fanxu Meng , Fiona Fui-Hoon Nah , RAY LC