English
Related papers

Related papers: Using perceptive subbands analysis to perform audi…

200 papers

In this paper, we propose an effective and robust method of spatial feature extraction for acoustic scene analysis utilizing partially synchronized and/or closely located distributed microphones. In the proposed method, a new cepstrum…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-22 Keisuke Imoto

Audio-based pedestrian detection is a challenging task and has, thus far, only been explored in noise-limited environments. We present a new dataset, results, and a detailed analysis of the state-of-the-art in audio-based pedestrian…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Yonghyun Kim , Chaeyeon Han , Akash Sarode , Noah Posner , Subhrajit Guhathakurta , Alexander Lerch

Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to…

Machine Learning · Computer Science 2024-04-03 Yi Di Yuan , Swee Liang Wong , Jonathan Pan

Representing diverse and plausible future trajectories is critical for motion forecasting in autonomous driving. However, efficiently capturing these trajectories in a compact set remains challenging. This study introduces a novel approach…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Abhishek Vivekanandan , J. Marius Zöllner

In music and speech, meaning is derived at multiple levels of context. Affect, for example, can be inferred both by a short sound token and by sonic patterns over a longer temporal window such as an entire recording. In this letter, we…

Sound · Computer Science 2022-09-12 Camille Noufi , Prateek Verma

We present an end-to-end binaural audio rendering approach (Listen2Scene) for virtual reality (VR) and augmented reality (AR) applications. We propose a novel neural-network-based binaural sound propagation method to generate acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Anton Ratnarajah , Dinesh Manocha

In this paper, we propose the use of spatial and harmonic features in combination with long short term memory (LSTM) recurrent neural network (RNN) for automatic sound event detection (SED) task. Real life sound recordings typically have…

The driving behavior at urban intersections is very complex. It is thus crucial for autonomous vehicles to comprehensively understand challenging urban traffic scenes in order to navigate intersections and prevent accidents. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Prarthana Bhattacharyya , Yanlei Gu , Jiali Bao , Xu Liu , Shunsuke Kamijo

Scenario-based methods for the assessment of Automated Vehicles (AVs) are widely supported by many players in the automotive field. Scenarios captured from real-world data can be used to define the scenarios for the assessment and to…

In the field of acoustic scene analysis, this paper presents a novel approach to find spatio-temporal latent representations from in-the-wild audio data. By using WE-LIVE, an in-house collected dataset that includes audio recordings in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-11 Claudia Montero-Ramírez , Esther Rituerto-González , Carmen Peláez-Moreno

Spectrograms have been widely used in Convolutional Neural Networks based schemes for acoustic scene classification, such as the STFT spectrogram and the MFCC spectrogram, etc. They have different time-frequency characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Weiping Zheng , Zhenyao Mo , Xiaotao Xing , Gansen Zhao

Separating an audio scene into isolated sources is a fundamental problem in computer audition, analogous to image segmentation in visual scene analysis. Source separation systems based on deep learning are currently the most successful…

Sound · Computer Science 2018-11-07 Prem Seetharaman , Gordon Wichern , Jonathan Le Roux , Bryan Pardo

Embedding acoustic information into fixed length representations is of interest for a whole range of applications in speech and audio technology. Two novel unsupervised approaches to generate acoustic embeddings by modelling of acoustic…

Computation and Language · Computer Science 2021-02-08 Yanpei Shi , Thomas Hain

This paper proposes a benchmark of submissions to Detection and Classification Acoustic Scene and Events 2021 Challenge (DCASE) Task 4 representing a sampling of the state-of-the-art in Sound Event Detection task. The submissions are…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Romain Serizel

Environmental soundscapes convey substantial ecological and social information regarding urban environments; however, their potential remains largely untapped in large-scale geographic analysis. In this study, we investigate the extent to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Pengyu Chen , Xiao Huang , Teng Fei , Sicheng Wang

We study the problem of multimodal physical scene understanding, where an embodied agent needs to find fallen objects by inferring object properties, direction, and distance of an impact sound source. Previous works adopt feed-forward…

Robotics · Computer Science 2024-07-17 Jie Yin , Andrew Luo , Yilun Du , Anoop Cherian , Tim K. Marks , Jonathan Le Roux , Chuang Gan

This paper addresses the matching of short music audio snippets to the corresponding pixel location in images of sheet music. A system is presented that simultaneously learns to read notes, listens to music and matches the currently played…

Machine Learning · Computer Science 2016-12-16 Matthias Dorfer , Andreas Arzt , Gerhard Widmer

Interaction with the world requires an organism to transform sensory signals into representations in which behaviorally meaningful properties of the environment are made explicit. These representations are derived through cascades of…

Neurons and Cognition · Quantitative Biology 2017-10-17 Wiktor Młynarski , Josh H. McDermott

We present a continuation to our previous work, in which we developed the MR-CKR framework to reason with knowledge overriding across contexts organized in multi-relational hierarchies. Reasoning is realized via ASP with algebraic measures,…

Artificial Intelligence · Computer Science 2023-05-04 Loris Bozzato , Thomas Eiter , Rafael Kiesel , Daria Stepanova

In this paper we study the problem of acoustic scene classification, i.e., categorization of audio sequences into mutually exclusive classes based on their spectral content. We describe the methods and results discovered during a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-30 Shayan Gharib , Honain Derrar , Daisuke Niizumi , Tuukka Senttula , Janne Tommola , Toni Heittola , Tuomas Virtanen , Heikki Huttunen