English
Related papers

Related papers: Evaluating the efectiveness of sonifcation in scie…

200 papers

Jupyter notebooks are increasingly being adopted by teachers to deliver interactive practical sessions to their students. Notebooks come with many attractive features, such as the ability to combine textual explanations, multimedia content,…

Computers and Society · Computer Science 2023-09-29 Christophe Casseau , Jean-Rémy Falleri , Thomas Degueule , Xavier Blanc

This workshop focuses on visualization education, literacy, and activities. It aims to streamline previous efforts and initiatives of the visualization community to provide a format for education and engagement practices in visualization.…

Powerful artificial intelligence (AI) tools that have emerged in recent years -- including large language models, automated coding assistants, and advanced image and speech generation technologies -- are the result of monumental human…

Signal Processing · Electrical Eng. & Systems 2025-09-12 Jarvis Haupt , Qin Lu , Yanning Shen , Jia Chen , Yue Dong , Dan McCreary , Mehmet Akçakaya , Georgios B. Giannakis

Multi-modality perception is essential to develop interactive intelligence. In this work, we consider a new task of visual information-infused audio inpainting, \ie synthesizing missing audio segments that correspond to their accompanying…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Hang Zhou , Ziwei Liu , Xudong Xu , Ping Luo , Xiaogang Wang

Speech perception is key to verbal communication. For people with hearing loss, the capability to recognize speech is restricted, particularly in a noisy environment or the situations without visual cues, such as lip-reading unavailable via…

Sound · Computer Science 2020-12-21 Rung-Yu Tseng , Tao-Wei Wang , Szu-Wei Fu , Chia-Ying Lee , Yu Tsao

This article proposes and discusses qualitatively the use of a didactic board game in Science Education for high school students. The game contemplates in an interdisciplinary way the areas of Physics, Biology, Chemistry and Astronomy and…

Physics Education · Physics 2021-09-23 M. A. M. Souza , V. Dutra , T. B. Menezes , J. W. Silva

Modern sciences and astrophysics in particular study objects and phenomena not visible in physical terms, that is they cannot be investigated with the eyes or analogous optical systems. Nevertheless, they make intensive use of visual…

Physics Education · Physics 2023-03-09 Stefania Varano , Anita Zanella

Sonification serves as a powerful tool for data accessibility, especially for people with vision loss. Among various modalities, speech is a familiar means of communication similar to the role of text in visualization. However, speech-based…

Human-Computer Interaction · Computer Science 2024-08-14 Yichun Zhao , Jingyi Lu , Miguel A Nacenta

In the last decade, the multi-sensory approach to data analysis has gained relevance. The possibility of including people with vision difficulties in the field of education and the dissemination of science is part of it. However, in the…

Instrumentation and Methods for Astrophysics · Physics 2024-04-30 Johanna Casado , Beatriz García

A long-standing goal in the field of sensory substitution is to enable sound perception for deaf and hard of hearing (DHH) people by visualizing audio content. Different from existing models that translate to hand sign language, between…

Human-Computer Interaction · Computer Science 2023-02-15 Chunjin Song , Yuchi Zhang , Willis Peng , Parmis Mohaghegh , Bastian Wandt , Helge Rhodin

Annotations are a critical component of visualizations, helping viewers interpret the visual representation and highlighting critical data insights. Despite their significant role, we lack an understanding of how annotations can be…

Human-Computer Interaction · Computer Science 2024-08-09 Rhys Sorenson-Graff , S. Sandra Bae , Jordan Wirfs-Brock

Due to the empirical success of reinforcement learning, an increasing number of students study the subject. However, from our practical teaching experience, we see students entering the field (bachelor, master and early PhD) often struggle.…

Traditional sign language teaching methods face challenges such as limited feedback and diverse learning scenarios. Although 2D resources lack real-time feedback, classroom teaching is constrained by a scarcity of teacher. Methods based on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hongli Wen , Yang Xu , Lin Li , Xudong Ru , Xingce Wang , Zhongke Wu

Evaluating teachers' skills is crucial for enhancing education quality and student outcomes. Teacher discourse, significantly influencing student performance, is a key component. However, coding this discourse can be laborious. This study…

Computation and Language · Computer Science 2024-12-20 Samuel Falcon , Jaime Leon

Solid materials may appear static, but at the atomic scale they are in constant vibrational motion. These vibrations, described by phonons, govern many key material properties, including structural stability, mechanical strength, optical…

This systematic mapping study consisted of tracking the scientific literature that addresses the issue of analogies as a didactic strategy in science teaching. An analogy can be understood as comparing an existing knowledge with a new…

Physics Education · Physics 2021-08-03 Pedro Hernandez , Edinson Espitia

Structured hand gestures that incorporate visual motions and signs are used in sign language. Sign language is a valuable means of daily communication for individuals who are deaf or have speech impairments, but it is still rare among…

This paper describes results from a project in an undergraduate engineering physics course that coupled classroom use of interactive computer simulations with the collection of real-time formative assessment using pen-enabled mobile…

Physics Education · Physics 2016-11-17 F. V. Kowalski , S. E. Kowalski

Several animal species (e.g., bats, dolphins, and whales) and even visually impaired humans have the remarkable ability to perform echolocation: a biological sonar used to perceive spatial layout and locate objects in the world. We explore…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Ruohan Gao , Changan Chen , Ziad Al-Halah , Carl Schissler , Kristen Grauman

Social robots are required not only to understand human intentions but also to effectively communicate their intentions or own internal states to users. This study explores the use of sonification to provide explicit auditory feedback,…

Robotics · Computer Science 2024-11-15 Simone Arreghini , Antonio Paolillo , Gabriele Abbate , Alessandro Giusti