English
Related papers

Related papers: Latent Acoustic Mapping for Direction of Arrival E…

200 papers

Speech recognition systems are often highly domain dependent, a fact widely reported in the literature. However the concept of domain is complex and not bound to clear criteria. Hence it is often not evident if data should be considered to…

Computation and Language · Computer Science 2015-09-23 Mortaza Doulaty , Oscar Saz , Thomas Hain

We present the signal processing framework and some results for the IEEE AASP challenge on acoustic source localization and tracking (LOCATA). The system is designed for the direction of arrival (DOA) estimation in single-source scenarios.…

Sound · Computer Science 2018-12-05 Daniele Salvati , Carlo Drioli , Gian Luca Foresti

Spatial sound reasoning is a fundamental human skill, enabling us to navigate and interpret our surroundings based on sound. In this paper we present BAT, which combines the spatial sound perception ability of a binaural acoustic scene…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-20 Zhisheng Zheng , Puyuan Peng , Ziyang Ma , Xie Chen , Eunsol Choi , David Harwath

In this paper, an unsupervised deep learning framework based on dual-path model-driven variational auto-encoders (VAE) is proposed for angle-of-arrivals (AoAs) and channel estimation in massive MIMO systems. Specifically designed for…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Zhiheng Guo , Yuanzhang Xiao , Xiang Chen

Existing large language models (LLMs) that mainly focus on Standard American English (SAE) often lead to significantly worse performance when being applied to other English dialects. While existing mitigations tackle discrepancies for…

Computation and Language · Computer Science 2023-12-07 Yanchen Liu , William Held , Diyi Yang

Interpretability is essential for user trust in real-world anomaly detection applications. However, deep learning models, despite their strong performance, often lack transparency. In this work, we study the interpretability of…

While many text-to-audio systems produce monophonic or fixed-stereo outputs, generating audio with user-defined spatial properties remains a challenge. Existing deep learning-based spatialization methods often rely on latent-space…

Sound · Computer Science 2025-09-16 Tutti Chi , Letian Gao , Yixiao Zhang

Distributed Acoustic Sensing (DAS) is an emerging technology for earthquake monitoring and subsurface imaging. The recorded seismic signals by DAS have several distinct characteristics, such as unknown coupling effects, strong anthropogenic…

Geophysics · Physics 2023-03-16 Weiqiang Zhu , Ettore Biondi , Jiaxuan Li , Jiuxun Yin , Zachary E. Ross , Zhongwen Zhan

Simultaneous localisation and mapping (SLAM) is the problem of autonomous robots to construct or update a map of an undetermined unstructured environment while simultaneously estimate the pose in it. The current trend towards self-driving…

Robotics · Computer Science 2023-02-14 B. Udugama

We propose a semi-supervised approach to acoustic source localization in reverberant environments based on deep generative modeling. Localization in reverberant environments remains an open challenge. Even with large data volumes, the…

Signal Processing · Electrical Eng. & Systems 2021-04-05 Michael J. Bianco , Sharon Gannot , Efren Fernandez-Grande , Peter Gerstoft

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when…

Machine Learning · Computer Science 2022-05-09 Sanghyun Yoo , Inchul Song , Yoshua Bengio

Distributed fiber-optic acoustic sensing (DAS) has emerged as a transformative approach for distributed vibration measurement with high spatial resolution and long measurement range while maintaining cost-efficiency. However, the…

Signal Processing · Electrical Eng. & Systems 2025-12-15 Junyi Duan , Jiageng Chen , Zuyuan He

Deep learning based localization and mapping has recently attracted significant attention. Instead of creating hand-designed algorithms through exploitation of physical models or geometric theories, deep learning based solutions provide an…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Changhao Chen , Bing Wang , Chris Xiaoxuan Lu , Niki Trigoni , Andrew Markham

Recently, many forms of audio industrial applications, such as sound monitoring and source localization, have begun exploiting smart multi-modal devices equipped with a microphone array. Regrettably, model-based methods are often difficult…

Sound · Computer Science 2023-06-21 Hao Liang , Guanxing Zhou , Xiaotong Tu , Andreas Jakobsson , Xinghao Ding , Yue Huang

End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded approaches (ASR+MT) often suffer from error propagation in the…

Computation and Language · Computer Science 2021-02-10 Junkun Chen , Mingbo Ma , Renjie Zheng , Liang Huang

We proposed an end-to-end deep learning-based simultaneous localization and mapping (SLAM) system following conventional visual odometry (VO) pipelines. The proposed method completes the SLAM framework by including tracking, mapping, and…

Robotics · Computer Science 2019-05-10 Youngji Kim , Ayoung Kim

Environmental audio tagging aims to predict only the presence or absence of certain acoustic events in the interested acoustic scene. In this paper we make contributions to audio tagging in two parts, respectively, acoustic modeling and…

In this work, we consider the use of a model-based decoder in combination with an unsupervised learning strategy for direction-of-arrival (DoA) estimation. Relying only on unlabeled training data we show in our analysis that we can…

Signal Processing · Electrical Eng. & Systems 2023-11-29 Franz Weißer , Michael Baur , Wolfgang Utschick

Recent multi-modal audio-language models (ALMs) excel at text-audio retrieval but struggle with frame-wise audio understanding. Prior works use temporal-aware labels or unsupervised training to improve frame-wise capabilities, but they…

Pre-trained Language Models (PLMs) exhibit good accuracy and generalization ability across various tasks using self-supervision, but their large size results in high inference latency. Early Exit (EE) strategies handle the issue by allowing…

Computation and Language · Computer Science 2024-10-08 Divya Jyoti Bajpai , Manjesh Kumar Hanawal