English
Related papers

Related papers: Binary Neural Network for Speaker Verification

200 papers

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu

Sound event detection (SED) is a hot topic in consumer and smart city applications. Existing approaches based on Deep Neural Networks are very effective, but highly demanding in terms of memory, power, and throughput when targeting…

Machine Learning · Computer Science 2021-01-13 Gianmarco Cerutti , Renzo Andri , Lukas Cavigelli , Michele Magno , Elisabetta Farella , Luca Benini

In this paper, a novel Convolutional Neural Network architecture has been developed for speaker verification in order to simultaneously capture and discard speaker and non-speaker information, respectively. In training phase, the network is…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-13 Hossein Salehghaffari

Binarization is a powerful compression technique for neural networks, significantly reducing FLOPs, but often results in a significant drop in model performance. To address this issue, partial binarization techniques have been developed,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Udbhav Bamba , Neeraj Anand , Saksham Aggarwal , Dilip K. Prasad , Deepak K. Gupta

Speaker Verification still suffers from the challenge of generalization to novel adverse environments. We leverage on the recent advancements made by deep learning based speech enhancement and propose a feature-domain supervised denoising…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Saurabh Kataria , Phani Sankar Nidadavolu , Jesús Villalba , Nanxin Chen , Paola García , Najim Dehak

In this work, we propose extreme compression techniques like binarization, ternarization for Neural Decoders such as TurboAE. These methods reduce memory and computation by a factor of 64 with a performance better than the quantized (with…

Information Theory · Computer Science 2021-06-21 Devannagari Vikas , Nancy Nayak , Sheetal Kalyani

Binary neural networks (BNNs) have received ever-increasing popularity for their great capability of reducing storage burden as well as quickening inference time. However, there is a severe performance drop compared with real-valued…

Machine Learning · Computer Science 2023-02-07 Sheng Xu , Yanjing Li , Teli Ma , Mingbao Lin , Hao Dong , Baochang Zhang , Peng Gao , Jinhu Lv

Binary representation is desirable for its memory efficiency, computation speed and robustness. In this paper, we propose adjustable bounded rectifiers to learn binary representations for deep neural networks. While hard constraining…

Machine Learning · Computer Science 2015-11-20 Zhirong Wu , Dahua Lin , Xiaoou Tang

Data augmentation is conventionally used to inject robustness in Speaker Verification systems. Several recently organized challenges focus on handling novel acoustic environments. Deep learning based speech enhancement is a modern solution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-29 Saurabh Kataria , Phani Sankar Nidadavolu , Jesús Villalba , Najim Dehak

In this paper, we study 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While efficient, the lacking of representational capability and the training difficulty impede 1-bit CNNs from…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Zechun Liu , Wenhan Luo , Baoyuan Wu , Xin Yang , Wei Liu , Kwang-Ting Cheng

Although convolutional neural networks (CNNs) are now widely used in various computer vision applications, its huge resource demanding on parameter storage and computation makes the deployment on mobile and embedded devices difficult.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Zhe Xu , Ray C. C. Cheung

Speaker recognition systems based on Convolutional Neural Networks (CNNs) are often built with off-the-shelf backbones such as VGG-Net or ResNet. However, these backbones were originally proposed for image classification, and therefore may…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-01 Shaojin Ding , Tianlong Chen , Xinyu Gong , Weiwei Zha , Zhangyang Wang

There is a significant performance gap between Binary Neural Networks (BNNs) and floating point Deep Neural Networks (DNNs). We propose to improve the binary training method, by introducing a new regularization function that encourages…

Machine Learning · Computer Science 2020-04-22 Sajad Darabi , Mouloud Belbahri , Matthieu Courbariaux , Vahid Partovi Nia

In this paper, we propose an iterative framework for self-supervised speaker representation learning based on a deep neural network (DNN). The framework starts with training a self-supervision speaker embedding network by maximizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Danwei Cai , Weiqing Wang , Ming Li

Many approaches for verifying input-output properties of neural networks have been proposed recently. However, existing algorithms do not scale well to large networks. Recent work in the field of model compression studied binarized neural…

Machine Learning · Computer Science 2022-03-15 Christopher Lazarus , Mykel J. Kochenderfer

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

Machine Learning · Computer Science 2022-06-22 Aaqib Saeed

Word embeddings are commonly used as a starting point in many NLP models to achieve state-of-the-art performances. However, with a large vocabulary and many dimensions, these floating-point representations are expensive both in terms of…

Computation and Language · Computer Science 2020-01-23 Julien Tissier , Christophe Gravier , Amaury Habrard

The ever-growing computational demands of increasingly complex machine learning models frequently necessitate the use of powerful cloud-based infrastructure for their training. Binary neural networks are known to be promising candidates for…

In this paper, we present ECAPA2, a novel hybrid neural network architecture and training strategy to produce robust speaker embeddings. Most speaker verification models are based on either the 1D- or 2D-convolutional operation, often…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Jenthe Thienpondt , Kris Demuynck

Multilingual speaker verification introduces the challenge of verifying a speaker in multiple languages. Existing systems were built using i-vector/x-vector approaches along with Bi-LSTMs, which were trained to discriminate speakers,…

Sound · Computer Science 2024-08-09 Aravinda Reddy PN , Raghavendra Ramachandra , K. Sreenivasa Rao , Pabitra Mitra