English
Related papers

Related papers: Mutltimodal AI Companion for Interactive Fairytale…

200 papers

As children increasingly consume media on devices, parents look for ways this usage can support learning and growth, especially in domains like social-emotional learning. We introduce eaSEL, a system that (a) integrates social-emotional…

Human-Computer Interaction · Computer Science 2025-02-05 Jocelyn Shen , Jennifer King Chen , Leah Findlater , Griffin Dietz Smith

Vocabulary learning support tools have widely exploited existing materials, e.g., stories or video clips, as contexts to help users memorize each target word. However, these tools could not provide a coherent context for any target words of…

Human-Computer Interaction · Computer Science 2023-11-01 Zhenhui Peng , Xingbo Wang , Qiushi Han , Junkai Zhu , Xiaojuan Ma , Huamin Qu

In this work we investigate how children ages 5-12 perceive, understand, and use generative AI models such as a text-based LLMs ChatGPT and a visual-based model DALL-E. Generative AI is newly being used widely since chatGPT. Children are…

Human-Computer Interaction · Computer Science 2024-05-24 Eliza Kosoy , Soojin Jeong , Anoop Sinha , Alison Gopnik , Tanya Kraljic

Storytelling in AR has gained attention due to its multi-modality and interactivity. However, generating multi-modal content for AR storytelling requires expertise and efforts for high-quality conveyance of the narrator's intention.…

Human-Computer Interaction · Computer Science 2025-05-23 Hyungjun Doh , Jingyu Shi , Rahul Jain , Heesoo Kim , Karthik Ramani

Synchronous data-driven storytelling with network visualizations presents significant challenges due to the complexity of real-time manipulation of network components. While existing research addresses asynchronous scenarios, there is a…

Human-Computer Interaction · Computer Science 2025-04-08 Kentaro Takahira , Wong Kam-Kwai , Leni Yang , Xian Xu , Takanori Fujiwara , Huamin Qu

One-to-one tutoring is widely considered the gold standard for personalized education, yet it remains prohibitively expensive to scale. To evaluate whether generative AI might help expand access to this resource, we conducted an exploratory…

Visual blends combine elements from two distinct visual concepts into a single, integrated image, with the goal of conveying ideas through imaginative and often thought-provoking visuals. Communicating abstract concepts through visual…

Human-Computer Interaction · Computer Science 2025-02-25 Zhida Sun , Zhenyao Zhang , Yue Zhang , Min Lu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Generative AI, particularly Language Models (LMs), has the potential to transform real-world domains with societal impact, particularly where access to experts is limited. For example, in education, training novice educators with expert…

Computation and Language · Computer Science 2025-01-28 Rose E. Wang , Ana T. Ribeiro , Carly D. Robinson , Susanna Loeb , Dora Demszky

Story visualization aims to generate a series of images that match the story described in texts, and it requires the generated images to satisfy high quality, alignment with the text description, and consistency in character identities.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Wen Wang , Canyu Zhao , Hao Chen , Zhekai Chen , Kecheng Zheng , Chunhua Shen

Recently, large language models have facilitated the emergence of highly intelligent conversational AI capable of engaging in human-like dialogues. However, a notable distinction lies in the fact that these AI models predominantly generate…

Human-Computer Interaction · Computer Science 2025-10-13 Jijie Zhou , Yuhan Hu

Instructors play a pivotal role in integrating AI into education, yet their adoption of AI-powered tools remains inconsistent. Despite this, limited research explores how to design AI tools that support broader instructor adoption. This…

Human-Computer Interaction · Computer Science 2025-03-10 Si Chen , Reid Metoyer , Khiem Le , Adam Acunin , Izzy Molnar , Alex Ambrose , James Lang , Nitesh Chawla , Ronald Metoyer

Public participation has become increasingly important in collaborative urban design; yet, existing processes often face challenges in achieving efficient and scalable citizen engagement. To address this gap, this study explores how large…

Human-Computer Interaction · Computer Science 2026-03-18 Zhaoxi Zhang , Ruolin Wu , Feiyang Ren , Sridevi Turaga , Tamir Mendel

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitate a collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Chantal Pellegrini , Ege Özsoy , Benjamin Busam , Nassir Navab , Matthias Keicher

Generative AI (genAI) is increasingly being integrated into children's everyday lives, not only through screens but also through so-called "screen-free" AI toys. These toys can simulate emotions, personalize responses, and recall prior…

Human-Computer Interaction · Computer Science 2026-04-06 Aayushi Dangol , Meghna Gupta , Daeun Yoo , Robert Wolfe , Jason Yip , Franziska Roesner , Julie A. Kientz

As AI writing tools evolve from fixing surface errors to creating language with writers, new capabilities raise concerns about negative impacts on student writers, such as replacing their voices and undermining critical thinking skills. To…

Human-Computer Interaction · Computer Science 2026-02-05 Yijun Liu , John Gallagher , Sarah Sterman , Tal August

A study was conducted to prove AI software could be used to translate and generate illustrations without any human intervention. This was done with the purpose of showing and distributing it to the external customer, Pratham Books. The…

Artificial Intelligence · Computer Science 2023-04-05 Jakub J. Dylag , Victor Suarez , James Wald , Aneesha Amodini Uvara

This is the study that presents an AI-Python-based chatbot that helps students to learn programming by demonstrating solutions to such problems as debugging errors, solving syntax problems or converting abstract theoretical concepts to…

Software Engineering · Computer Science 2025-09-26 Sayed Mahbub Hasan Amiri , Md Mainul Islam

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that…

Human-Computer Interaction · Computer Science 2026-03-30 Sirui Tao , Ivan Liang , Cindy Peng , Zhiqing Wang , Srishti Palani , Steven P. Dow

Conversational artificial intelligence has the potential to assist users in preliminary medical consultations, particularly in settings where access to healthcare professionals is limited. However, many existing medical dialogue systems…

Computation and Language · Computer Science 2026-03-26 Shubham Kumar Nigam , Suparnojit Sarkar , Piyush Patel

Augmentative and alternative communication (AAC) is a practical means of communication for people with language disabilities. In this study, we propose PicTalky, which is an AI-based AAC system that helps children with language…

Computation and Language · Computer Science 2022-10-25 Chanjun Park , Yoonna Jang , Seolhwa Lee , Jaehyung Seo , Kisu Yang , Heuiseok Lim