Related papers: Edukoi: developing an interactive sonification too…
In the present work we have made use of the animation freeware Algodoo,as an easy handling tool to teach and learn physics. The animation is based on the oblique motion model and we have described the movement qualitatively, showing changes…
Accurate volume estimation of objects from visual data is a long-standing challenge in computer vision with significant applications in robotics, logistics, and smart health. Existing methods often rely on complex 3D reconstruction…
Humans are capable of completing a range of challenging manipulation tasks that require reasoning jointly over modalities such as vision, touch, and sound. Moreover, many such tasks are partially-observed; for example, taking a notebook out…
Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…
Music visualization is an important medium that enables synesthetic experiences and creative inspiration. However, previous research focused mainly on the technical and theoretical aspects, overlooking users' everyday interaction with music…
Holography is 3D imaging which can record intensity and phase at the same time. The importance of construct hologram is holographic recording and wavefront reconstruction. It is surprised that holography be discovered in study interstellar…
This paper introduces Chord Colourizer, a near real-time system that detects the musical key of an audio signal and visually represents it through a novel graphical user interface (GUI). The system assigns colours to musical notes based on…
The rapid growth in scale and complexity of both computational and observational astrophysics over the past decade necessitates efficient and intuitive methods for examining and visualizing large datasets. Here we discuss some newly…
We present SHINOBI, an end-to-end framework for the reconstruction of shape, material, and illumination from object images captured with varying lighting, pose, and background. Inverse rendering of an object based on unconstrained image…
We report our experience in bringing science into US and French classrooms. We participated in the US scientific educational program Project ASTRO. It is based on a partnership between a school teacher and an astronomer. They together…
Recent years have witnessed the success of deep learning on the visual sound separation task. However, existing works follow similar settings where the training and testing datasets share the same musical instrument categories, which to…
Research into tonal music examines the structural relationships among sounds and how they align with our auditory perception. The exploration of integrating tonal cognition into sonic interaction design, particularly for practitioners…
We present an easily reproducible, open-source, sound card based experimental set-up to support transfer function measurement. Our system is able to visualize signals of mechanical and electrical resonances and their spectra in real time.…
Recent successes suggest that an image can be manipulated by a text prompt, e.g., a landscape scene on a sunny day is manipulated into the same scene on a rainy day driven by a text input "raining". These approaches often utilize a…
Interactive visualization and simulation of astrophysical phenomena help astronomers and enable digital planetariums and television documentaries to take their spectators on a journey into deep space to explore the astronomical wonders of…
From the patter of rain to the crunch of snow, the sounds we hear often convey the visual textures that appear within a scene. In this paper, we present a method for learning visual styles from unlabeled audio-visual data. Our model learns…
The impulsive noise in astronomical images originates from various sources. It develops as a result of thermal generation in pixels, collision of cosmic rays with image sensor or may be induced by high readout voltage in Electron…
Borrowing methods and formulas from Prof. Goodman's classic Introduction to Fourier Optics textbook [1], I have developed a software package [2] that has been used in both industrial research and classroom teaching [3]. This paper briefly…
We introduce SonoHaptics, an audio-haptic cursor for gaze-based 3D object selection. SonoHaptics addresses challenges around providing accurate visual feedback during gaze-based selection in Extended Reality (XR), e.g., lack of world-locked…
Modern astronomical surveys have multiple competing scientific goals. Optimizing the observation schedule for these goals presents significant computational and theoretical challenges, and state-of-the-art methods rely on expensive human…