English
Related papers

Related papers: Log Complex Color for Visual Pattern Recognition o…

200 papers

We propose SpectroStream, a full-band multi-channel neural audio codec. Successor to the well-established SoundStream, SpectroStream extends its capability beyond 24 kHz monophonic audio and enables high-quality reconstruction of 48 kHz…

Sound · Computer Science 2025-08-08 Yunpeng Li , Kehang Han , Brian McWilliams , Zalan Borsos , Marco Tagliasacchi

Deep neural networks have been applied to audio spectrograms for respiratory sound classification. Existing models often treat the spectrogram as a synthetic image while overlooking its physical characteristics. In this paper, a Multi-View…

Sound · Computer Science 2024-05-31 Wentao He , Yuchen Yan , Jianfeng Ren , Ruibin Bai , Xudong Jiang

Phase retrieval in optical imaging refers to the recovery of a complex signal from phaseless data acquired in the form of its diffraction patterns. These patterns are acquired through a system with a coherent light source that employs a…

Phase retrieval consists in the recovery of a complex-valued signal from intensity-only measurements. As it pervades a broad variety of applications, many researchers have striven to develop phase-retrieval algorithms. Classical approaches…

Circular-harmonic spectra are a compact representation of local image features in two dimensions. It is well known that the computational complexity of such transforms is greatly reduced when polar separability is exploited in steerable…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Hugh L Kennedy

Modern neural speech enhancement models usually include various forms of phase information in their training loss terms, either explicitly or implicitly. However, these loss terms are typically designed to reduce the distortion of phase…

Sound · Computer Science 2022-02-25 Doyeon Kim , Hyewon Han , Hyeon-Kyeong Shin , Soo-Whan Chung , Hong-Goo Kang

A time-frequency diagram is a commonly used visualization for observing the time-frequency distribution of radio signals and analyzing their time-varying patterns of communication states in radio monitoring and management. While it excels…

Signal Processing · Electrical Eng. & Systems 2022-10-03 Ying Zhao , Luhao Ge , Huixuan Xie , Genghuai Bai , Zhao Zhang , Qiang Wei , Yun Lin , Yuchao Liu , Fangfang Zhou

Disentangling and recovering physical attributes, such as shape and material, from a few waveform examples is a challenging inverse problem in audio signal processing, with numerous applications in musical acoustics as well as structural…

Sound · Computer Science 2020-07-21 Han Han , Vincent Lostanlen

It is commonplace in cosmology to analyze fields projected onto the celestial sphere, and in particular density fields that are defined by a set of points e.g. galaxies. When performing an harmonic-space analysis of such data (e.g. an…

Cosmology and Nongalactic Astrophysics · Physics 2024-04-02 Antón Baleato Lizancos , Martin White

The change in the relative phase between two light fields serves as a basic principle for the measurement of the physical quantity that guides this change. It would therefore be highly advantageous if the relative phase could be amplified…

Resonances are common in wave physics and their full and rigorous characterization is crucial to correctly tailor the response of a system in both time and frequency domains. However, they have been conventionally described by the quality…

Optics · Physics 2025-04-09 Isam Ben Soltane , Nicolas Bonod

visual information can be converted into audio stream via sensory substitution devices in order to give visually impaired people the chance of perception of their surrounding easily and simultaneous to performing everyday tasks. In this…

Sound · Computer Science 2021-06-17 Ezsan Mehrbani , Sezedeh Fatemeh Mirhoseini , Noushin Riahi

The extraction of spectral features from a music clip is a computationally expensive task. As in order to extract accurate features, we need to process the clip for its whole length. This preprocessing task creates a large overhead and also…

Sound · Computer Science 2020-11-05 Dishant Parikh , Saurabh Sachdev

Hyperspectral imaging enables versatile applications due to its competence in capturing abundant spatial and spectral information, which are crucial for identifying substances. However, the devices for acquiring hyperspectral images are…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Jingang Zhang , Runmu Su , Wenqi Ren , Qiang Fu , Felix Heide , Yunfeng Nie

We introduce a scattering representation for the analysis and classification of sounds. It is locally translation-invariant, stable to deformations in time and frequency, and has the ability to capture harmonic structures. The scattering…

Sound · Computer Science 2015-09-02 Vincent Lostanlen , Stéphane Mallat

We are looking for a mathematical model of monophonic sounds with independent time and phase dimensions. With such a model we can resynthesise a sound with arbitrarily modulated frequency and progress of the timbre. We propose such a model…

Sound · Computer Science 2011-03-22 Henning Thielemann

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase.…

Computer Vision and Pattern Recognition · Computer Science 2011-08-17 Artem Migukin , Vladimir Katkovnik , Jaakko Astola

Recovering images from optical interferometric observations is one of the major challenges in the field. Unlike the case of observations at radio wavelengths, in the optical the atmospheric turbulence changes the phases on a very short time…

While characterization of coherent wavefields is essential to laser, x-ray and electron imaging, sensors measure the squared magnitude of the field, rather than the field itself. Holography or phase retrieval must be used to characterize…

Image and Video Processing · Electrical Eng. & Systems 2020-12-10 David J. Brady , Timothy J. Schulz , Chengyu Wang

In this study we describe a methodology to realize visual images cognition in the broader sense, by a cross-modal stimulation through the auditory channel. An original algorithm of conversion from bi-dimensional images to sounds has been…

Neurons and Cognition · Quantitative Biology 2017-05-16 Takahisa Kishino , Sun Zhe , Roberto Marchisio , Ruggero Micheletto