English
Related papers

Related papers: Localizing Spatial Information in Neural Spatiospe…

200 papers

This paper describes a versatile method that accelerates multichannel source separation methods based on full-rank spatial modeling. A popular approach to multichannel source separation is to integrate a spatial model with a source model…

Sound · Computer Science 2019-03-11 Kouhei Sekiguchi , Aditya Arie Nugraha , Yoshiaki Bando , Kazuyoshi Yoshii

We address the problem of unsupervised semantic segmentation of outdoor LiDAR point clouds in diverse traffic scenarios. The key idea is to leverage the spatiotemporal nature of a dynamic point cloud sequence and introduce drastically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiao Li , Pan He , Aotian Wu , Sanjay Ranka , Anand Rangarajan

This paper presents, in the context of multi-channel ASR, a method to adapt a mask based, statistically optimal beamforming approach to a speaker of interest. The beamforming vector of the statistically optimal beamformer is computed by…

Computation and Language · Computer Science 2018-06-21 Tobias Menne , Ralf Schlüter , Hermann Ney

Autoencoders are powerful machine learning models used to compress information from multiple data sources. However, autoencoders, like all artificial neural networks, are often unidentifiable and uninterpretable. This research focuses on…

Beamforming is an imaging tool for the investigation of aeroacoustic phenomena and results in high dimensional data that is broken down to spectra by integrating spatial Regions Of Interest. This paper presents two methods that enable the…

Sound · Computer Science 2021-09-29 Armin Goudarzi , Carsten Spehr , Steffen Herbold

Spatial functional organization is a hallmark of biological brains: neurons are arranged topographically according to their response properties, at multiple scales. In contrast, representations within most machine learning models lack…

Computation and Language · Computer Science 2025-10-22 Taha Binhuraib , Greta Tuckute , Nicholas Blauch

At present, deep neural network methods have played a dominant role in face alignment field. However, they generally use predefined network structures to predict landmarks, which tends to learn general features and leads to mediocre…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jun Wan , He Liu , Yujia Wu , Zhihui Lai , Wenwen Min , Jun Liu

Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yifan Pu , Yizeng Han , Yulin Wang , Junlan Feng , Chao Deng , Gao Huang

Recent applications of pattern recognition techniques on brain connectome classification using functional connectivity (FC) are shifting towards acknowledging the non-Euclidean topology and dynamic aspects of brain connectivity across time.…

Machine Learning · Computer Science 2024-11-12 Sin-Yee Yap , Junn Yong Loo , Chee-Ming Ting , Fuad Noman , Raphael C. -W. Phan , Adeel Razi , David L. Dowe

Transformers are powerful neural architectures that allow integrating different modalities using attention mechanisms. In this paper, we leverage the neural transformer architectures for multi-channel speech recognition systems, where the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Feng-Ju Chang , Martin Radfar , Athanasios Mouchtaris , Brian King , Siegfried Kunzmann

Current region feature-based image captioning methods have progressed rapidly and achieved remarkable performance. However, they are still prone to generating irrelevant descriptions due to the lack of contextual information and the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jun Wan , Jun Liu , Zhihui lai , Jie Zhou

Despite its widespread adoption as the prominent neural architecture, the Transformer has spurred several independent lines of work to address its limitations. One such approach is selective state space models, which have demonstrated…

Sound · Computer Science 2024-06-11 Sarthak Yadav , Zheng-Hua Tan

Self-supervised speech representations are known to encode both speaker and phonetic information, but how they are distributed in the high-dimensional space remains largely unexplored. We hypothesize that they are encoded in orthogonal…

Computation and Language · Computer Science 2023-12-12 Oli Liu , Hao Tang , Sharon Goldwater

For time-frequency (TF) domain speech enhancement (SE) methods, the overlap-and-add operation in the inverse TF transformation inevitably leads to an algorithmic delay equal to the window size. However, typical causal SE systems fail to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Yuewei Zhang , Huanbin Zou , Jie Zhu

Recently, frequency domain all-neural beamforming methods have achieved remarkable progress for multichannel speech separation. In parallel, the integration of time domain network structure and beamforming also gains significant attention.…

Sound · Computer Science 2022-12-27 Rongzhi Gu , Shi-Xiong Zhang , Yuexian Zou , Dong Yu

Distant-microphone meeting transcription is a challenging task. State-of-the-art end-to-end speaker-attributed automatic speech recognition (SA-ASR) architectures lack a multichannel noise and reverberation reduction front-end, which limits…

Computation and Language · Computer Science 2025-07-09 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

This paper addresses the problem of multi-channel multi-speech separation based on deep learning techniques. In the short time Fourier transform domain, we propose an end-to-end narrow-band network that directly takes as input the…

Sound · Computer Science 2022-04-13 Changsheng Quan , Xiaofei Li

Dereverberation of a moving speech source in the presence of other directional interferers, is a harder problem than that of stationary source and interference cancellation. We explore joint multi channel linear prediction (MCLP) and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-23 Srikanth Raj Chetupalli , Thippur V. Sreenivas

We investigate the potential of stochastic neural networks for learning effective waveform-based acoustic models. The waveform-based setting, inherent to fully end-to-end speech recognition systems, is motivated by several comparative…

Machine Learning · Statistics 2021-08-17 Dino Oglic , Zoran Cvetkovic , Peter Sollich

Guided ultrasonic wave localization uses spatially distributed multistatic sensor arrays and generalized beamforming strategies to detect and locate damage across a structure. The propagation channel is often very complex. Methods can…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Ishan D. Khurjekar , Joel B. Harley