相关论文: Painting graphs with sounds: CosMonic sonification…
Humans can easily perceive the direction of sound sources in a visual scene, termed sound source localization. Recent studies on learning-based sound source localization have mainly explored the problem from a localization perspective.…
Photoacoustic imaging systems offer a platform with high resolution to explore body tissues, food, and artwork. On the other hand, plasmonics constitutes a source of resonant heating and thermal expansion to generate acoustic waves.…
This study explores the integration of auditory and tactile experiences in musical haptics, focusing on enhancing sensory dimensions of music through touch. Addressing the gap in translating auditory signals to meaningful tactile feedback,…
The goal of image harmonization is adjusting the foreground appearance in a composite image to make the whole image harmonious. To construct paired training images, existing datasets adopt different ways to adjust the illumination…
Several studies report that people diagnosed with autism spectrum disorder (ASD) have low employment rates and major difficulties in maintaining occupation (Hendricks, 2010). Adopting smart and interactive technology, promoted by Industry…
Understanding astrophysical and cosmological processes can be challenging due to their complexity and lack of intuitive analogies. To address this, we present \texttt{AstronomyCalc}, a Python package specifically designed to aid…
Sound is a preferred context to build foundations on wave phenomena, one of the most important disciplinary referents in physics. It is also one of the best-set frameworks to achieve transversality, overcoming scholastic level and…
The present document is Part 1 of a 2-part introduction to ambisonics and aims at readers who would like to work practically with ambisonics. We leave out deep technical details in this part and focus on helping the reader to develop an…
The instrumentation plan for the European-Extremely Large Telescope foresees a Multi-Object Spectrograph (E-ELT MOS). The MOSAIC project is proposed by a European-Brazilian consortium, to provide a unique MOS facility for astrophysics,…
Modern sciences and astrophysics in particular study objects and phenomena not visible in physical terms, that is they cannot be investigated with the eyes or analogous optical systems. Nevertheless, they make intensive use of visual…
In this work, we present Score MUsic Graph (SMUG)-Explain, a framework for generating and visualizing explanations of graph neural networks applied to arbitrary prediction tasks on musical scores. Our system allows the user to visualize the…
Three-dimensional (3D) visualization has opened up a Universe of possible scientific data representations. 3D printing has the potential to make seemingly abstract and esoteric data sets accessible, particularly through the lens of…
Acoustic sensing manifests great potential in various applications that encompass health monitoring, gesture interface and imaging by leveraging the speakers and microphones on smart devices. However, in ongoing research and development in…
We present a novel approach to inspecting galaxy spectra using sound, via their direct audio representation ('spectral audification'). We discuss the potential of this as a complement to (or stand-in for) visual approaches. We surveyed 58…
Visual representation of information is a fundamental tool for advancing our understanding of science. It enables the research community to extract new knowledge from complex datasets, and plays an equally vital role in communicating new…
Large-scale vision-language models demonstrate strong multimodal alignment and generalization across diverse tasks. Among them, CLIP stands out as one of the most successful approaches. In this work, we extend the application of CLIP to…
Solid materials may appear static, but at the atomic scale they are in constant vibrational motion. These vibrations, described by phonons, govern many key material properties, including structural stability, mechanical strength, optical…
The world of audio production and design has long been a difficult one to break into, requiring expertise and a working knowledge of the standard digital audio paradigms. This paper describes a novel interface that makes audio production…
This paper provides a prospectus for a new way of thinking about the wavefunction of the universe: a $\Psi$-epistemic quantum cosmology. We present a proposal that, if successfully implemented, would resolve the cosmological measurement…
Ambisonics i.e., a full-sphere surround sound, is quintessential with 360-degree visual content to provide a realistic virtual reality (VR) experience. While 360-degree visual content capture gained a tremendous boost recently, the…