English
Related papers

Related papers: A Multi-Head Relevance Weighting Framework For Lea…

200 papers

Accent recognition with deep learning framework is a similar work to deep speaker identification, they're both expected to give the input speech an identifiable representation. Compared with the individual-level features learned by speaker…

Sound · Computer Science 2021-08-26 Wei Wang , Chao Zhang , Xiaopei Wu

Today's Automatic Speech Recognition systems only rely on acoustic signals and often don't perform well under noisy conditions. Performing multi-modal speech recognition - processing acoustic speech signals and lip-reading video…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Matthijs Van keirsbilck , Bert Moons , Marian Verhelst

Networks with large receptive field (RF) have shown advanced fitting ability in recent years. In this work, we utilize the short-term residual learning method to improve the performance and robustness of networks for image denoising tasks.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-14 Shuo-Fei Wang , Wen-Kai Yu , Ya-Xin Li

Self-supervised learning methods such as wav2vec 2.0 have shown promising results in learning speech representations from unlabelled and untranscribed speech data that are useful for speech recognition. Since these representations are…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-22 Shehzeen Hussain , Van Nguyen , Shuhua Zhang , Erik Visser

Representation learning is important for solving sequence-to-sequence problems in natural language processing. Representation learning transforms raw data into vector-form representations while preserving their features. However, data with…

Computation and Language · Computer Science 2023-01-12 Yunhao Yang , Zhaokun Xue , Andrew Whinston

This paper proposes a novel lip-reading driven deep learning framework for speech enhancement. The proposed approach leverages the complementary strengths of both deep learning and analytical acoustic modelling (filtering based approach) as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Ahsan Adeel , Mandar Gogate , Amir Hussain , William M. Whitmer

Multi-label network classification is a well-known task that is being used in a wide variety of web-based and non-web-based domains. It can be formalized as a multi-relational learning task for predicting nodes labels based on their…

Machine Learning · Computer Science 2019-02-26 Ahmed Rashed , Josif Grabocka , Lars Schmidt-Thieme

Voice activity detection (VAD) makes a distinction between speech and non-speech and its performance is of crucial importance for speech based services. Recently, deep neural network (DNN)-based VADs have achieved better performance than…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Zhenpeng Zheng , Jianzong Wang , Ning Cheng , Jian Luo , Jing Xiao

In this paper, we present an end-to-end approach for environmental sound classification based on a 1D Convolution Neural Network (CNN) that learns a representation directly from the audio signal. Several convolutional layers are used to…

Sound · Computer Science 2019-04-22 Sajjad Abdoli , Patrick Cardinal , Alessandro Lameiras Koerich

Transform learning is being extensively applied in several applications because of its ability to adapt to a class of signals of interest. Often, a transform is learned using a large amount of training data, while only limited data may be…

Systems and Control · Computer Science 2017-10-31 Naushad Ansari , Anubha Gupta

Most state-of-the-art Deep Learning systems for speaker verification are based on speaker embedding extractors. These architectures are commonly composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-12 Miquel India , Pooyan Safari , Javier Hernando

Representation learning is fundamental to modern machine learning, powering applications such as text retrieval and multimodal understanding. However, learning robust and generalizable representations remains challenging. While prior work…

Machine Learning · Computer Science 2025-11-27 Jiaoyang Li , Jun Fang , Tianhao Gao , Xiaohui Zhang , Zhiyuan Liu , Chao Liu , Pengzhang Liu , Qixia Jiang

In visual recognition, the key to the performance improvement of ResNet is the success in establishing the stack of deep sequential convolutional layers using identical mapping by a shortcut connection. It results in multiple paths of data…

Computer Vision and Pattern Recognition · Computer Science 2018-11-19 Jung HyoungHo , Lee Ryong , Lee Sanghwan , Hwang Wonjun

In this paper, we presents a low-complexity deep learning frameworks for acoustic scene classification (ASC). The proposed framework can be separated into three main steps: Front-end spectrogram extraction, back-end classification, and late…

Sound · Computer Science 2021-06-17 Lam Pham , Hieu Tang , Anahid Jalali , Alexander Schindler , Ross King

Acoustic emotion recognition aims to categorize the affective state of the speaker and is still a difficult task for machine learning models. The difficulties come from the scarcity of training data, general subjectivity in emotion…

Computation and Language · Computer Science 2018-04-02 Egor Lakomkin , Cornelius Weber , Sven Magg , Stefan Wermter

Functional magnetic resonance imaging produces high dimensional data, with a less then ideal number of labelled samples for brain decoding tasks (predicting brain states). In this study, we propose a new deep temporal convolutional neural…

Machine Learning · Computer Science 2015-01-13 Orhan Firat , Emre Aksan , Ilke Oztekin , Fatos T. Yarman Vural

The volume of convolutional neural network (CNN) models proposed for face recognition has been continuously growing larger to better fit large amount of training data. When training data are obtained from internet, the labels are likely to…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Xiang Wu , Ran He , Zhenan Sun , Tieniu Tan

State-of-the-art speech recognition systems rely on fixed, hand-crafted features such as mel-filterbanks to preprocess the waveform before the training pipeline. In this paper, we study end-to-end systems trained directly from the raw…

Computation and Language · Computer Science 2018-06-22 Neil Zeghidour , Nicolas Usunier , Gabriel Synnaeve , Ronan Collobert , Emmanuel Dupoux

In this work we aim to discover high quality speech features and linguistic units directly from unlabeled speech data in a zero resource scenario. The results are evaluated using the metrics and corpora proposed in the Zero Resource Speech…

Computation and Language · Computer Science 2016-02-02 Cheng-Tao Chung , Cheng-Yu Tsai , Hsiang-Hung Lu , Chia-Hsiang Liu , Hung-yi Lee , Lin-shan Lee

DeepFake Audio, unlike DeepFake images and videos, has been relatively less explored from detection perspective, and the solutions which exist for the synthetic speech classification either use complex networks or dont generalize to…

Sound · Computer Science 2022-10-24 Vardhan Dongre , Abhinav Thimma Reddy , Nikhitha Reddeddy