English
Related papers

Related papers: Mutltimodal AI Companion for Interactive Fairytale…

200 papers

Family learning takes place in everyday routines where children and caregivers read, practice, and develop new skills together. Although AI is increasingly present in learning environments, most systems remain child-centered and overlook…

Human-Computer Interaction · Computer Science 2025-10-29 Yao Li , Jingyi Xie , Ya-Fang Lin , He Zhang , Ge Wang , Gaojian Huang , Rui Yu , Si Chen

Voice, the discursive construction of the writer's identity, has been extensively studied and theorized in composition studies. In multimodal writing, students are able to mobilize both linguistic and non linguistic resources to express…

Computers and Society · Computer Science 2024-03-29 Xiao Tan , Wei Xu , Chaoran Wang

Recent neural generation systems have demonstrated the potential for procedurally generating game content, images, stories, and more. However, most neural generation algorithms are "uncontrolled" in the sense that the user has little say in…

Artificial Intelligence · Computer Science 2022-08-08 Zhiyu Lin , Rohan Agarwal , Mark Riedl

Virtual assistants (VAs) have become ubiquitous in daily life, integrated into smartphones and smart devices, sparking interest in AI companions that enhance user experiences and foster emotional connections. However, existing companions…

Human-Computer Interaction · Computer Science 2025-09-03 Xuetong Wang , Ching Christie Pang , Pan Hui

Accurate Story visualization requires several necessary elements, such as identity consistency across frames, the alignment between plain text and visual content, and a reasonable layout of objects in images. Most previous works endeavor to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Yuan Gong , Youxin Pang , Xiaodong Cun , Menghan Xia , Yingqing He , Haoxin Chen , Longyue Wang , Yong Zhang , Xintao Wang , Ying Shan , Yujiu Yang

Traditional medical basic sciences educational approaches follow a one-size-fits-all model, neglecting the diverse learning styles of individual students. I propose an intelligent AI companion which will fill this gap by providing…

Computers and Society · Computer Science 2024-09-18 Ritwik Raj Saxena

Storytelling infographics are a powerful medium for communicating data-driven stories through visual presentation. However, existing authoring tools lack support for maintaining story consistency and aligning with users' story goals…

Human-Computer Interaction · Computer Science 2026-02-27 Jielin Feng , Xinwu Ye , Qianhui Li , Verena Ingrid Prantl , Jun-Hsiang Yao , Yuheng Zhao , Yun Wang , Siming Chen

This work investigates the integration of generative visual aids in human-robot task communication. We developed GenComUI, a system powered by large language models that dynamically generates contextual visual aids (such as map annotations,…

Human-Computer Interaction · Computer Science 2025-02-18 Yate Ge , Meiying Li , Xipeng Huang , Yuanda Hu , Qi Wang , Xiaohua Sun , Weiwei Guo

Hybrid tutoring, where a human tutor supports multiple students in learning with educational technology, is an increasingly common application to deliver high-impact tutoring at scale. However, past hybrid tutoring applications are limited…

Human-Computer Interaction · Computer Science 2025-05-14 Eason Chen , Xinyi Tang , Aprille Xi , Chenyu Lin , Conrad Borchers , Shivang Gupta , Jionghao Lin , Kenneth R Koedinger

Recent advances in AI-driven storytelling have enhanced video generation and story visualization. However, translating dialogue-centric scripts into coherent storyboards remains a significant challenge due to limited script detail,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Min Zhang , Zilin Wang , Liyan Chen , Kunhong Liu , Juncong Lin

High enrollment in STEM-related degree programs has created increasing demand for scalable tutoring support, as universities experience a shortage of qualified instructors and teaching assistants (TAs). To address this challenge, LeafTutor,…

Computers and Society · Computer Science 2026-01-07 Madison Bochard , Tim Conser , Alyssa Duran , Lazaro Martull , Pu Tian , Yalong Wu

Large Multimodal Models (LMMs) have shown strong potential for assisting users in tasks, such as programming, content creation, and information access, yet their interaction remains largely limited to traditional interfaces such as desktops…

Human-Computer Interaction · Computer Science 2026-02-12 Liuchuan Yu , Yongqi Zhang , Lap-Fai Yu

Design processes involve exploration, iteration, and movement across interconnected stages such as persona creation, problem framing, solution ideation, and prototyping. However, time and resource constraints often hinder designers from…

Human-Computer Interaction · Computer Science 2025-08-18 Sangho Suh , Michael Lai , Kevin Pu , Steven P. Dow , Tovi Grossman

Video story interaction enables viewers to engage with and explore narrative content for personalized experiences. However, existing methods are limited to user selection, specially designed narratives, and lack customization. To address…

Human-Computer Interaction · Computer Science 2025-05-08 Yiwen Zhang , Jianing Hao , Zhan Wang , Hongling Sheng , Wei Zeng

Concept designers in the entertainment industry create highly detailed, often imaginary environments for movies, games, and TV shows. Their early ideation phase requires intensive research, brainstorming, visual exploration, and combination…

Human-Computer Interaction · Computer Science 2025-02-21 Wen-Fan Wang , Chien-Ting Lu , Nil Ponsa Campanyà , Bing-Yu Chen , Mike Y. Chen

In this position paper, we propose researching the combination of Augmented Reality (AR) and Artificial Intelligence (AI) to support conversations, inspired by the interfaces of dialogue systems commonly found in videogames. AR-capable…

Human-Computer Interaction · Computer Science 2025-03-10 Julián Méndez , Marc Satkowski

Artificial Intelligence (AI) chatbots powered by a large language model (LLM) are entering young children's learning and play, yet little is known about how young children construe these agents or how such construals relate to engagement.…

Human-Computer Interaction · Computer Science 2025-12-04 Pilyoung Kim , Jenna H. Chin , Yun Xie , Nolan Brady , Tom Yeh , Sujin Yang

The rapid adoption of Generative AI, including LLM-based chatbots like ChatGPT, has highlighted the need for accessible ways to support public understanding and AI literacy. To address this need, we introduce a game-based, interactive…

Computation and Language · Computer Science 2026-05-21 Francesca Padovani , Malvina Nissim

Drawing supports learning by externalizing mental models, but providing timely feedback at scale remains challenging. We present Draw2Learn, a system that explores how AI can act as a supportive teammate during drawing-based learning. The…

Human-Computer Interaction · Computer Science 2026-02-03 Yuqi Hang

Cognitive presence and social presence are crucial for a comprehensive learning experience. Despite the flexibility of asynchronous learning environments to accommodate individual schedules, the inherent constraints of asynchronous…

Human-Computer Interaction · Computer Science 2024-10-08 Tianjia Wang , Tong Wu , Huayi Liu , Chris Brown , Yan Chen