English
Related papers

Related papers: Mutltimodal AI Companion for Interactive Fairytale…

200 papers

Cross-language collaborative storytelling plays a vital role in children's language learning and cultural development, fostering both expressive ability and intercultural awareness. Yet, in practice, children's participation is often…

Human-Computer Interaction · Computer Science 2026-03-06 Wenxin Zhao , Peng Zhang , Hansu Gu , Haoxuan Zhou , Xiaojie Huo , Lin Wang , Wen Zheng , Tun Lu , Ning Gu

Social narratives help autistic children understand and navigate social situations through stories. To ensure effective practice, however, they often require significant time and effort from parents in customizing the narrative materials…

Human-Computer Interaction · Computer Science 2026-04-06 Jungeun Lee , Kyungah Lee , Inseok Hwang , SoHyun Park , Young-Ho Kim

This paper introduces Kahaani, a multimodal, co-creative storytelling system that leverages Generative Artificial Intelligence, designed for children to address the challenge of sustaining engagement to foster educational narrative…

Computation and Language · Computer Science 2026-02-10 Samee Arif , Muhammad Saad Haroon , Aamina Jamal Khan , Taimoor Arif , Agha Ali Raza , Awais Athar

Storytelling is a deeply personal and creative process, yet existing methods often treat users as passive consumers, offering generic plots with limited personalization. This undermines engagement and immersion, especially where individual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Minh-Loi Nguyen , Quang-Khai Le , Tam V. Nguyen , Minh-Triet Tran , Trung-Nghia Le

In the diverse world of AI-driven storytelling, there is a unique opportunity to engage young audiences with customized, and personalized narratives. This paper introduces FairyLandAI an innovative Large Language Model (LLM) developed…

Artificial Intelligence · Computer Science 2024-07-15 Georgios Makridis , Athanasios Oikonomou , Vasileios Koukos

Storyboarding is an established method for designing user experiences. Generative AI can support this process by helping designers quickly create visual narratives. However, existing tools only focus on accurate text-to-image generation.…

Human-Computer Interaction · Computer Science 2024-07-11 Zhaohui Liang , Xiaoyu Zhang , Kevin Ma , Zhao Liu , Xipei Ren , Kosa Goucher-Lambert , Can Liu

Cartoon videos have proven to be effective in learning vocabulary to preschool children.However, we have little knowledge about integrating AI into cartoon videos to provide systematic, multimodal vocabulary learning support. This…

Human-Computer Interaction · Computer Science 2025-02-19 Shiya Tsang , Ruiyao Miao , Junren Xiao , Hui Xiong

Pedagogical Agents (PAs) show significant potential for boosting student engagement and learning outcomes by providing adaptive, on-demand support in educational contexts. However, existing PA solutions are often hampered by pre-scripted…

Human-Computer Interaction · Computer Science 2025-05-13 Eason Chen , Chenyu Lin , Yu-Kai Huang , Xinyi Tang , Aprille Xi , Jionghao Lin , Kenneth Koedinger

Pictorial charts are favored for their memorability and visual appeal, offering a more engaging alternative to basic charts. However, their creation can be complex and time-consuming due to the lack of native support in popular…

Human-Computer Interaction · Computer Science 2025-01-14 Siyu Yan , Tiancheng Liu , Weikai Yang , Nan Tang , Yuyu Luo

Recent advances in artificial intelligence have created new possibilities for making education more scalable, adaptive, and learner-centered. However, existing educational chatbot systems often lack contextual adaptability, real-time…

Computation and Language · Computer Science 2026-02-10 Mohamed El Hajji , Tarek Ait Baha , Aicha Dakir , Hammou Fadili , Youssef Es-Saady

Intergenerational co-creation using technology between grandparents and grandchildren can be challenging due to differences in technological familiarity. AI has emerged as a promising tool to support co-creative activities, offering…

Human-Computer Interaction · Computer Science 2025-03-04 Callie Y. Kim , Arissa J. Sato , Nathan Thomas White , Hui-Ru Ho , Christine P. Lee , Yuna Hwang , Bilge Mutlu

Empowering blind and low vision (BLV) users to explore visual media improves content comprehension, strengthens user agency, and fulfills diverse information needs. However, most existing tools separate exploration from the main narration,…

Human-Computer Interaction · Computer Science 2025-08-08 Shuchang Xu

Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework…

Human-Computer Interaction · Computer Science 2024-10-03 Amina Kobenova , Cyan DeVeaux , Samyak Parajuli , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

Therapeutic art activities, such as expressive drawing and painting, require the synergy between creative visual production and interactive dialogue. Recent advancements in Multimodal Large Language Models (MLLMs) have expanded the capacity…

Human-Computer Interaction · Computer Science 2026-05-12 Le Lin , Zihao Zhu , Rainbow Tin Hung Ho , Jing Liao , Yuhan Luo

We present dialogue management routines for a system to engage in multiparty agent-infant interaction. The ultimate purpose of this research is to help infants learn a visual sign language by engaging them in naturalistic and socially…

Human-Computer Interaction · Computer Science 2018-09-06 Setareh Nasihati Gilani , David Traum , Arcangelo Merla , Eugenia Hee , Zoey Walker , Barbara Manini , Grady Gallagher , Laura-Ann Petitto

Generative artificial intelligence (GenAI) has ushered in a new era for storytellers, providing a powerful tool to ignite creativity and explore uncharted narrative territories. As technology continues to advance, the synergy between human…

Human-Computer Interaction · Computer Science 2024-03-05 Ahmed Y. Radwan , Khaled M. Alasmari , Omar A. Abdulbagi , Emad A. Alghamdi

The rapid evolution of large language models (LLMs) has transformed human-computer interaction (HCI), but the interaction with LLMs is currently mainly focused on text-based interactions, while other multi-model approaches remain…

Human-Computer Interaction · Computer Science 2025-02-14 Eason Chen , Chenyu Lin , Xinyi Tang , Aprille Xi , Canwen Wang , Jionghao Lin , Kenneth R Koedinger

Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to balance between…

Human-Computer Interaction · Computer Science 2020-09-02 Tan Tang , Renzhong Li , Xinke Wu , Shuhan Liu , Johannes Knittel , Steffen Koch , Thomas Ertl , Lingyun Yu , Peiran Ren , Yingcai Wu

The topic of Co-creation, i.e., AI agents interacting with humans to generate outputs (e.g., art), has gained significant attention recently. However, most studies focus on adult-human interactions in a digital setting. This paper explores…

Artificial Intelligence · Computer Science 2026-05-29 Arturo Valdivia , Paolo Burelli

Narrative visualization is a powerful communicative tool that can take on various formats such as interactive articles, slideshows, and data videos. These formats each have their strengths and weaknesses, but existing authoring tools only…

Human-Computer Interaction · Computer Science 2022-05-23 Matthew Conlen , Jeffrey Heer