English
Related papers

Related papers: Spatio-Temporal Representation Learning Enhanced S…

200 papers

Spatial information is a critical clue for multi-channel multi-speaker target speech recognition. Most state-of-the-art multi-channel Automatic Speech Recognition (ASR) systems extract spatial features only during the speech separation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Yiwen Shao , Yong Xu , Sanjeev Khudanpur , Dong Yu

With the rapid advances of data acquisition techniques, spatio-temporal data are becoming increasingly abundant in a diverse array of disciplines. Here we develop spatio-temporal regression methodology for analyzing large amounts of…

Methodology · Statistics 2021-12-01 Ting Fung Ma , Fangfang Wang , Jun Zhu , Anthony R. Ives , Katarzyna E. Lewińska

The trimming scheme with a prefixed cutoff portion is known as a method of improving the robustness of statistical models such as multivariate Gaussian mixture models (MG- MMs) in small scale tests by alleviating the impacts of outliers.…

Computation and Language · Computer Science 2014-05-20 Dalei Wu , Haiqing Wu

Self-attention is a method of encoding sequences of vectors by relating these vectors to each-other based on pairwise similarities. These models have recently shown promising results for modeling discrete sequences, but they are non-trivial…

Computation and Language · Computer Science 2018-06-19 Matthias Sperber , Jan Niehues , Graham Neubig , Sebastian Stüker , Alex Waibel

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li

Training automatic speech recognition (ASR) systems requires large amounts of data in the target language in order to achieve good performance. Whereas large training corpora are readily available for languages like English, there exists a…

Audio and Speech Processing · Electrical Eng. & Systems 2017-11-15 Markus Müller , Sebastian Stüker , Alex Waibel

Learning representations from electrocardiogram (ECG) signals can serve as a fundamental step for different machine learning-based ECG tasks. In order to extract general ECG representations that can be adapted to various downstream tasks,…

Machine Learning · Computer Science 2022-09-22 Wenrui Zhang , Shijia Geng , Shenda Hong

3D Semantic Occupancy Prediction is fundamental for spatial understanding, yet existing approaches face challenges in scalability and generalization due to their reliance on extensive labeled data and computationally intensive voxel-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyi Jiang , Liu Liu , Tianheng Cheng , Xinjie Wang , Tianwei Lin , Zhizhong Su , Wenyu Liu , Xinggang Wang

We explore the potential of large-scale noisily labeled data to enhance feature learning by pretraining semantic segmentation models within a multi-modal framework for geospatial applications. We propose a novel Cross-modal Sample Selection…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chenying Liu , Conrad Albrecht , Yi Wang , Xiao Xiang Zhu

Despite recent progress in time-series foundation models, challenges persist in improving representation learning and adapting to diverse downstream tasks. We introduce a General Time-series Model (GTM), which advances representation…

Machine Learning · Computer Science 2026-03-13 Cheng He , Xu Huang , Gangwei Jiang , Zhaoyi Li , Defu Lian , Hong Xie , Enhong Chen , Xijie Liang , Zengrong Zheng , Patrick P. C. Lee

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

Machine Learning · Computer Science 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

The diverse perceptual consequences of hearing loss severely impede speech communication, but standard clinical audiometry, which is focused on threshold-based frequency sensitivity, does not adequately capture deficits in frequency and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Xiajie Zhou , Candy Olivia Mawalim , Masashi Unoki

We introduce Condition-Aware Self-Supervised Learning Representation (CA-SSLR), a generalist conditioning model broadly applicable to various speech-processing tasks. Compared to standard fine-tuning methods that optimize for downstream…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-06 Yen-Ju Lu , Jing Liu , Thomas Thebaud , Laureano Moro-Velazquez , Ariya Rastrow , Najim Dehak , Jesus Villalba

In this paper, learning of tree-structured Gaussian graphical models from distributed data is addressed. In our model, samples are stored in a set of distributed machines where each machine has access to only a subset of features. A central…

Machine Learning · Computer Science 2018-12-05 Mostafa Tavassolipour , Seyed Abolfazl Motahari , Mohammad-Taghi Manzuri Shalmani

This work investigates application of different machine learning based prediction methodologies to estimate the performance of silicon based textured cells. Concept of confidence bound regions is introduced and advantages of this concept…

Machine Learning · Computer Science 2021-07-16 Rahul Jaiswal , Manel Martínez-Ramón , Tito Busani

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Far-field speech recognition in noisy and reverberant conditions remains a challenging problem despite recent deep learning breakthroughs. This problem is commonly addressed by acquiring a speech signal from multiple microphones and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-17 Zhong Meng , Shinji Watanabe , John R. Hershey , Hakan Erdogan

In this work, we propose an acoustic embedding based approach for representation learning in speech recognition. The proposed approach involves two stages comprising of acoustic filterbank learning from raw waveform, followed by modulation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Purvi Agrawal , Sriram Ganapathy

Zero-resource speech technology is a growing research area that aims to develop methods for speech processing in the absence of transcriptions, lexicons, or language modelling text. Early term discovery systems focused on identifying…

Computation and Language · Computer Science 2017-09-19 Herman Kamper , Aren Jansen , Sharon Goldwater

In this paper, we present a novel multi-modal deep neural network architecture that uses speech and text entanglement for learning phonetically sound spoken-word representations. STEPs-RL is trained in a supervised manner to predict the…

Computation and Language · Computer Science 2020-11-24 Prakamya Mishra