Related papers: Painting graphs with sounds: CosMonic sonification…
Graph theory is emerging as a new source of tools for time series analysis. One promising method is to transform a signal into its visibility graph, a representation which captures many interesting aspects of the signal. Here we introduce…
It is commonplace in cosmology to analyze fields projected onto the celestial sphere, and in particular density fields that are defined by a set of points e.g. galaxies. When performing an harmonic-space analysis of such data (e.g. an…
We present a cost-effective method to integrate speech into a large language model (LLM), resulting in a Contextual Speech Model with Instruction-following/in-context-learning Capabilities (COSMIC) multi-modal LLM. Using GPT-3.5, we…
Despite the impressive performance of deep learning models across diverse tasks, their complexity poses challenges for interpretation. This challenge is particularly evident for audio signals, where conveying interpretations becomes…
Commonsense knowledge is crucial for artificial intelligence systems to understand natural language. Previous commonsense knowledge acquisition approaches typically rely on human annotations (for example, ATOMIC) or text generation models…
Recent advances in our understanding of the Universe have revolutionized our view of its structure, composition and evolution. However, these new ideas have not necessarily been used to improve the teaching of introductory astronomy…
The present document reviews the mathematics behind binaural rendering of sound fields that are available as spherical harmonic expansion coefficients. This process is also known as binaural ambisonic decoding. We highlight that the details…
Modern autonomous systems are driving the critical need for next-generation adaptive materials and structures with embodied intelligence, i.e., the embodiment of memory, perception, learning, and decision-making within the mechanical…
Moving around in the world is naturally a multisensory experience, but today's embodied agents are deaf---restricted to solely their visual perception of the environment. We introduce audio-visual navigation for complex, acoustically and…
Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing eforts to equip schools with digital instrumentation have opened up the possibility…
The dynamics of gravitating astrophysical systems such as black holes and neutron stars are fascinatingly complex, offer some of nature's most spectacular phenomena, and capture the public's imagination in ways that few subjects can. Here,…
Training audio-to-image generative models requires an abundance of diverse audio-visual pairs that are semantically aligned. Such data is almost always curated from in-the-wild videos, given the cross-modal semantic correspondence that is…
We present MOSAIC, a modular architecture for coordinating multiple robots to (a) interact with users using natural language and (b) manipulate an open vocabulary of everyday objects. MOSAIC employs modularity at several levels: it…
This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a "Guided Harmony" musical game. We aim to examine co-creative behaviors between human musicians and robotic…
Smart cities are urban areas with sensor networks that collect data used towards efficient management. As a source of ubiquitous data, smart city initiatives present opportunities to enhance inhabitants' urban awareness. However, making…
Everything we know about the environment around us is thanks to light, a kind of electromagnetic radiation. Astronomy takes advantage of it and all the electromagnetic spectrum with the help of many devices to record them and determine from…
Cosmography is the tool that makes possible to untie the interpretation of cosmological observations from the definition of any dynamical prior. We review the constraints on the cosmographic parameter obtained using the most thorough data…
Abstract notions of convexity over the vertices of a graph, and corresponding notions of halfspaces, have recently gained attention from the machine learning community. In this work we study monophonic halfspaces, a notion of graph…
We present graphic results with high-levels of abstraction to desribe the basic principles and rules of thumb for acoustic or phononic band-gap engineering. We use these rules for developing an improved machien mount for damping acoustic…
Synthesizing natural human motion that adapts to complex environments while allowing creative control remains a fundamental challenge in motion synthesis. Existing models often fall short, either by assuming flat terrain or lacking the…