English
Related papers

Related papers: Leveraging Deep Neural Network Activation Entropy …

200 papers

Observational studies are based on accurate assessment of human state. A behavior recognition system that models interlocutors' state in real-time can significantly aid the mental health domain. However, behavior recognition from speech…

Machine Learning · Computer Science 2016-06-15 Haoqi Li , Brian Baucom , Panayiotis Georgiou

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Machine Learning · Computer Science 2021-02-24 Janis Postels , Hermann Blum , Yannick Strümpler , Cesar Cadena , Roland Siegwart , Luc Van Gool , Federico Tombari

With the increasing adoption of Deep Neural Network (DNN) models as integral parts of software systems, efficient operational testing of DNNs is much in demand to ensure these models' actual performance in field conditions. A challenge is…

Software Engineering · Computer Science 2019-06-28 Zenan Li , Xiaoxing Ma , Chang Xu , Chun Cao , Jingwei Xu , Jian Lü

A method for correcting for detector smearing effects using machine learning techniques is presented. Compared to the standard approaches the method can use more than one reconstructed variable to infere the value of the unsmeared quantity…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Alexander Glazov

Speech recognition technologies are gaining enormous popularity in various industrial applications. However, building a good speech recognition system usually requires large amounts of transcribed data, which is expensive to collect. To…

Computation and Language · Computer Science 2019-11-01 Dongwei Jiang , Xiaoning Lei , Wubo Li , Ne Luo , Yuxuan Hu , Wei Zou , Xiangang Li

Deep learning methods for unsupervised registration often rely on objectives that assume a uniform noise level across the spatial domain (e.g. mean-squared error loss), but noise distributions are often heteroscedastic and input-dependent…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Xiaoran Zhang , Daniel H. Pak , Shawn S. Ahn , Xiaoxiao Li , Chenyu You , Lawrence H. Staib , Albert J. Sinusas , Alex Wong , James S. Duncan

The intelligibility of speech severely degrades in the presence of environmental noise and reverberation. In this paper, we propose a novel deep learning based system for modifying the speech signal to increase its intelligibility under the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Haoyu Li , Junichi Yamagishi

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

Computation and Language · Computer Science 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

In this study, we present an approach to train a single speech enhancement network that can perform both personalized and non-personalized speech enhancement. This is achieved by incorporating a frame-wise conditioning input that specifies…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-24 Zhepei Wang , Ritwik Giri , Devansh Shah , Jean-Marc Valin , Michael M. Goodwin , Paris Smaragdis

Word embedding techniques heavily rely on the abundance of training data for individual words. Given the Zipfian distribution of words in natural language texts, a large number of words do not usually appear frequently or at all in the…

Computation and Language · Computer Science 2018-11-14 Victor Prokhorov , Mohammad Taher Pilehvar , Dimitri Kartsaklis , Pietro Lio , Nigel Collier

We consider the problem of diagnosis where a set of simple observations are used to infer a potentially complex hidden hypothesis. Finding the optimal subset of observations is intractable in general, thus we focus on the problem of active…

Artificial Intelligence · Computer Science 2017-07-12 Yewen Pu , Leslie P Kaelbling , Armando Solar-Lezama

Supervised learning has become a cornerstone of modern machine learning, yet a comprehensive theory explaining its effectiveness remains elusive. Empirical phenomena, such as neural analogy-making and the linear representation hypothesis,…

Machine Learning · Computer Science 2025-02-26 Patrik Reizinger , Alice Bizeul , Attila Juhos , Julia E. Vogt , Randall Balestriero , Wieland Brendel , David Klindt

Existing training criteria in automatic speech recognition(ASR) permit the model to freely explore more than one time alignments between the feature and label sequences. In this paper, we use entropy to measure a model's uncertainty, i.e.…

Computation and Language · Computer Science 2022-12-26 Ehsan Variani , Ke Wu , David Rybach , Cyril Allauzen , Michael Riley

Deep neural networks (DNNs) have been introduced for designing wireless policies by approximating the mappings from environmental parameters to solutions of optimization problems. Considering that labeled training samples are hard to…

Information Theory · Computer Science 2020-08-12 Chengjian Sun , Changyang She , Chenyang Yang

Overconfidence is a common issue for deep neural networks, limiting their deployment in real-world applications. To better estimate confidence, existing methods mostly focus on fully-supervised scenarios and rely on training labels. In this…

Machine Learning · Computer Science 2023-07-21 Chen Li , Xiaoling Hu , Chao Chen

By representing speaker characteristic as a single fixed-length vector extracted solely from speech, we can train a neural multi-speaker speech synthesis model by conditioning the model on those vectors. This model can also be adapted to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-09 Hieu-Thi Luong , Junichi Yamagishi

In embodied intelligence, datasets play a pivotal role, serving as both a knowledge repository and a conduit for information transfer. The two most critical attributes of a dataset are the amount of information it provides and how easily…

Robotics · Computer Science 2025-11-13 Jiahao Xiao , Bowen Yan , Jianbo Zhang , Jia Wang , Chunyi Li , Zhengxue Cheng , Guangtao Zhai

Data augmentation is conventionally used to inject robustness in Speaker Verification systems. Several recently organized challenges focus on handling novel acoustic environments. Deep learning based speech enhancement is a modern solution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-29 Saurabh Kataria , Phani Sankar Nidadavolu , Jesús Villalba , Najim Dehak

Data-efficient domain adaptation with only a few labelled data is desired for many robotic applications, e.g., in grasping detection, the inference skill learned from a grasping dataset is not universal enough to directly apply on various…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Haiyue Zhu , Yiting Li , Fengjun Bai , Wenjie Chen , Xiaocong Li , Jun Ma , Chek Sing Teo , Pey Yuen Tao , Wei Lin