Related papers: Virtual acoustics in inhomogeneous media with sing…

We propose a conceptually and computationally simple form of sound velocity that offers a readable view of the interference between direct and indirect sound waves. Unlike most approaches in the literature, it jointly exploits both active…

In this paper, I will attempt to establish a framework for representation in virtual worlds that may allow for input data from many different scales and virtual physics to be merged. For example, a typical virtual environment must…

Visual events are usually accompanied by sounds in our daily lives. We pose the question: Can the machine learn the correspondence between visual scene and the sound, and localize the sound source only by observing sound and visual scene…

Simulation involves predicting responses of a physical system. In this article, we simulate opto-acoustic signals generated in a three-dimensional volume due to absorption of an optical pulse. A separable computational model is developed…

Long duration noisy-looking waveforms such as those obtained in randomly multiply scattering and reverberant media are complex; they resist direct interpretation. Nevertheless, such waveforms are sensitive to small changes in the source of…

We demonstrate theoretically that acoustic forces acting on inhomogeneous fluids can be used to pattern and manipulate solute concentration fields into spatio-temporally controllable configurations stabilized against gravity. A theoretical…

Acoustic flat lensing is achieved here by tuning a phononic array to have indefinite medium behaviour in a narrow frequency spectral region along the acoustic branch. This is confirmed by the occurrence of a flat band along an unusual path…

In this paper, a method of rendering aerial haptics that uses an aerodynamic vortex and focused ultrasound is presented. Significant research has been conducted on haptic applications based on multiple phenomena such as magnetic and…

The dialogue experience with conversational agents can be greatly enhanced with multimodal and immersive interactions in virtual reality. In this work, we present an open-source architecture with the goal of simplifying the development of…

We present a theoretical and experimental study of boundary-driven acoustic streaming in an inhomogeneous fluid with variations in density and compressibility. In a homogeneous fluid this streaming results from dissipation in the boundary…

The equations of motion in a macroscopically inhomogeneous porous medium saturated by a fluid are derived. As a first verification of the validity of these equations, a two-layer rigid frame porous system considered as one single porous…

In this paper, we introduce a novel audio-visual multi-modal bridging framework that can utilize both audio and visual information, even with uni-modal inputs. We exploit a memory network that stores source (i.e., visual) and target (i.e.,…

Volumetric video is an emerging technology for immersive representation of 3D spaces that captures objects from all directions using multiple cameras and creates a dynamic 3D model of the scene. However, processing volumetric content…

Estimation of the location of sound sources is usually done using microphone arrays. Such settings provide an environment where we know the difference between the received signals among different microphones in the terms of phase or…

Inverse source problems are central to many applications in acoustics, geophysics, non-destructive testing, and more. Traditional imaging methods suffer from the resolution limit, preventing distinction of sources separated by less than the…

This paper is concerned with reconstructing an acoustic obstacle and its excitation sources from the phaseless near-field measurements. By supplementing some artificial sources to the inverse scattering system, this co-inversion problem can…

Dialogue models falter in noisy, multi-speaker environments, often producing irrelevant responses and awkward turn-taking. We present AV-Dialog, the first multimodal dialog framework that uses both audio and visual cues to track the target…

We present a new approach for spatiotemporal focusing through complex scattering media by wave front shaping. Using a nonlinear feedback signal to shape the incident pulsed wave front, we show that the limit of a spatiotemporal matched…

Moving around in the world is naturally a multisensory experience, but today's embodied agents are deaf---restricted to solely their visual perception of the environment. We introduce audio-visual navigation for complex, acoustically and…

Many previous audio-visual voice-related works focus on speech, ignoring the singing voice in the growing number of musical video streams on the Internet. For processing diverse musical video data, voice activity detection is a necessary…