English
Related papers

Related papers: ConnectVR: A Trigger-Action Interface for Creating…

200 papers

Creating an animated data video enriched with audio narration takes a significant amount of time and effort and requires expertise. Users not only need to design complex animations, but also turn written text scripts into audio narrations…

Human-Computer Interaction · Computer Science 2024-06-10 Yun Wang , Leixian Shen , Zhengxin You , Xinhuan Shu , Bongshin Lee , John Thompson , Haidong Zhang , Dongmei Zhang

The emerging field of panoramic video generation from text and image prompts unlocks new creative possibilities in virtual reality (VR), addressing the limitations of current immersive experiences, which are constrained by pre-designed…

Human-Computer Interaction · Computer Science 2025-01-28 Yunge Wen

Data-driven storytelling is a powerful method for conveying insights by combining narrative techniques with visualizations and text. These stories integrate visual aids, such as highlighted bars and lines in charts, along with textual…

Computation and Language · Computer Science 2024-10-07 Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Md Rizwan Parvez , Enamul Hoque , Shafiq Joty

Large language models can be used for collaborative storytelling. In this work we report on using GPT-3 \cite{brown2020language} to co-narrate stories. The AI system must track plot progression and character arcs while the human actors…

Human-Computer Interaction · Computer Science 2021-10-01 Boyd Branch , Piotr Mirowski , Kory W. Mathewson

The design of intuitive three-dimensional user interfaces is vital for interaction in virtual reality, allowing to effectively close the loop between a human user and the virtual environment. The utilization of 3D gestural input allows for…

Human-Computer Interaction · Computer Science 2024-01-17 Nico Reski , Aris Alissandrakis , Andreas Kerren

Prompting is central to interaction with AI systems, yet many users struggle to explore alternative directions, articulate creative intent, or understand how variations in prompts shape model outputs. We introduce prompt recommender systems…

Human-Computer Interaction · Computer Science 2026-01-23 Jason Kim , Maria Teleki , James Caverlee

Generating talking avatars is a fundamental task in video generation. Although existing methods can generate full-body talking avatars with simple human motion, extending this task to grounded human-object interaction (GHOI) remains an open…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Youliang Zhang , Zhengguang Zhou , Zhentao Yu , Ziyao Huang , Teng Hu , Sen Liang , Guozhen Zhang , Ziqiao Peng , Shunkai Li , Yi Chen , Zixiang Zhou , Yuan Zhou , Qinglin Lu , Xiu Li

We present a graphical, node-based system through which users can visually chain generative AI models for creative tasks. Research in the area of chaining LLMs has found that while chaining provides transparency, controllability and…

Human-Computer Interaction · Computer Science 2025-07-14 Abhinav Sood , Maria Teresa Llano , Jon McCormack

Bioscientists frequently seek to visualize the biological systems they have empirically characterized and reported in the literature. Realizing such visualizations requires biological structure modeling, an inherently complex process that…

Human-Computer Interaction · Computer Science 2026-05-20 Donggang Jia , Yunhai Wang , Ivan Viola

Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In a creative collaboration, communication is an essential component among collaborators. In many existing co-creative systems users can…

Human-Computer Interaction · Computer Science 2022-06-07 Jeba Rezwana , Mary Lou Maher

Imaginative play is an area of creativity that could allow robots to engage with the world around them in a much more personified way. Imaginary play can be seen as taking real objects and locations and using them as imaginary objects and…

Computation and Language · Computer Science 2023-08-04 Zexin Chen , Eric Zhou , Kenneth Eaton , Xiangyu Peng , Mark Riedl

Experiential AI is an emerging research field that addresses the challenge of making AI tangible and explicit, both to fuel cultural experiences for audiences, and to make AI systems more accessible to human understanding. The central theme…

Computers and Society · Computer Science 2023-06-06 Drew Hemment , Matjaz Vidmar , Daga Panas , Dave Murray-Rust , Vaishak Belle , Aylett Ruth

An engaging and provocative question can open up a great conversation. In this work, we explore a novel scenario: a conversation agent views a set of the user's photos (for example, from social media platforms) and asks an engaging question…

Artificial Intelligence · Computer Science 2022-05-20 Shih-Han Chan , Tsai-Lun Yang , Yun-Wei Chu , Chi-Yang Hsu , Ting-Hao Huang , Yu-Shian Chiu , Lun-Wei Ku

Recent advances in large language models have enabled developers to generate software by conversing with artificial intelligence systems rather than writing code directly. This paper introduces vibe coding, an emerging AI-native programming…

Software Engineering · Computer Science 2025-10-22 Vinay Bamil

Generative AI significantly enhances player agency in interactive narratives (IN) by enabling just-in-time content generation that adapts to player actions. While delegating generation to AI makes IN more interactive, it becomes challenging…

Human-Computer Interaction · Computer Science 2025-02-27 Zhuoran Lu , Qian Zhou , Yi Wang

Story visualization is the transformation of narrative elements into image sequences. While existing research has primarily focused on visual contextual coherence, the deeper narrative essence of stories often remains overlooked. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Seungkwon Kim , GyuTae Park , Sangyeon Kim , Seung-Hun Nam

Editing and manipulating graph-based models within immersive environments is largely unexplored and certain design activities could benefit from using those technologies. For example, in the case study of architectural modelling, the 3D…

Human-Computer Interaction · Computer Science 2020-01-06 Adrien Coppens , Berat Bicer , Naz Yilmaz , Serhat Aras

This study presents a theory-inspired visual narrative generative system that integrates conceptual principles-comic authoring idioms-with generative and language models to enhance the comic creation process. Our system combines human…

Artificial Intelligence · Computer Science 2024-09-27 Yi-Chun Chen , Arnav Jhala

Story composition is a challenging problem for machines and even for humans. We present a neural narrative generation system that interacts with humans to generate stories. Our system has different levels of human interaction, which enables…

Computation and Language · Computer Science 2019-06-04 Seraphina Goldfarb-Tarrant , Haining Feng , Nanyun Peng

TouchVR is a novel wearable haptic interface which can deliver multimodal tactile stimuli on the palm by DeltaTouch haptic display and vibrotactile feedback on the fingertips by vibration motors for the Virtual Reality (VR) user. DeltaTouch…

Robotics · Computer Science 2019-11-12 Daria Trinitatova , Dzmitry Tsetserukou