English
Related papers

Related papers: Beyond Deep Learning: Speech Segmentation and Phon…

200 papers

We capitalize on large amounts of readily-available, synchronous data to learn a deep discriminative representations shared across three major natural modalities: vision, sound and language. By leveraging over a year of sound from video and…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Yusuf Aytar , Carl Vondrick , Antonio Torralba

Discrete and continuous representations of content (e.g., of language or images) have interesting properties to be explored for the understanding of or reasoning with this content by machines. This position paper puts forward our opinion on…

Neural and Evolutionary Computing · Computer Science 2022-01-05 Ruben Cartuyvels , Graham Spinks , Marie-Francine Moens

Automatically assessing emotional valence in human speech has historically been a difficult task for machine learning algorithms. The subtle changes in the voice of the speaker that are indicative of positive or negative emotional states…

Computation and Language · Computer Science 2017-05-09 Jonathan Chang , Stefan Scherer

The recently proposed Conformer architecture has shown state-of-the-art performances in Automatic Speech Recognition by combining convolution with attention to model both local and global dependencies. In this paper, we study how to reduce…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Maxime Burchi , Valentin Vielzeuf

In this paper, we present a robust and low complexity system for Acoustic Scene Classification (ASC), the task of identifying the scene of an audio recording. We first construct an ASC baseline system in which a novel…

Sound · Computer Science 2022-03-24 Lam Pham , Khoa Dinh , Dat Ngo , Hieu Tang , Alexander Schindler

Representation is a core issue in artificial intelligence. Humans use discrete language to communicate and learn from each other, while machines use continuous features (like vector, matrix, or tensor in deep neural networks) to represent…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Yuqi Wang , Xu-Yao Zhang , Cheng-Lin Liu , Zhaoxiang Zhang

Segmentation for continuous Automatic Speech Recognition (ASR) has traditionally used silence timeouts or voice activity detectors (VADs), which are both limited to acoustic features. This segmentation is often overly aggressive, given that…

Computation and Language · Computer Science 2022-10-28 Piyush Behre , Naveen Parihar , Sharman Tan , Amy Shah , Eva Sharma , Geoffrey Liu , Shuangyu Chang , Hosam Khalil , Chris Basoglu , Sayan Pathak

Recent analysis on speech emotion recognition has made considerable advances with the use of MFCCs spectrogram features and the implementation of neural network approaches such as convolutional neural networks (CNNs). Capsule networks…

Sound · Computer Science 2021-12-28 Ismail Shahin , Noor Hindawi , Ali Bou Nassif , Adi Alhudhaif , Kemal Polat

Deep learning is computationally intensive, with significant efforts focused on reducing arithmetic complexity, particularly regarding energy consumption dominated by data movement. While existing literature emphasizes inference, training…

Machine Learning · Statistics 2025-06-09 Van Minh Nguyen , Cristian Ocampo , Aymen Askri , Louis Leconte , Ba-Hien Tran

Arabic dialect recognition presents a significant challenge in speech technology due to the linguistic diversity of Arabic and the scarcity of large annotated datasets, particularly for underrepresented dialects. This research investigates…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-27 Ghazal Al-Shwayyat , Omer Nezih Gerek

Dilated convolution with learnable spacings (DCLS) is a recent convolution method in which the positions of the kernel elements are learned throughout training by backpropagation. Its interest has recently been demonstrated in computer…

Sound · Computer Science 2023-11-23 Ismail Khalfaoui-Hassani , Timothée Masquelier , Thomas Pellegrini

Accent recognition with deep learning framework is a similar work to deep speaker identification, they're both expected to give the input speech an identifiable representation. Compared with the individual-level features learned by speaker…

Sound · Computer Science 2021-08-26 Wei Wang , Chao Zhang , Xiaopei Wu

Monaural speech dereverberation is a very challenging task because no spatial cues can be used. When the additive noises exist, this task becomes more challenging. In this paper, we propose a joint training method for simultaneous speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-07 Cunhang Fan , Jianhua Tao , Bin Liu , Jiangyan Yi , Zhengqi Wen

We propose a Perceiver-based sequence classifier to detect abnormalities in speech reflective of several neurological disorders. We combine this classifier with a Universal Speech Model (USM) that is trained (unsupervised) on 12 million…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Hagen Soltau , Izhak Shafran , Alex Ottenwess , Joseph R. JR Duffy , Rene L. Utianski , Leland R. Barnard , John L. Stricker , Daniela Wiepert , David T. Jones , Hugo Botha

This paper argues that training GANs on local and non-local dependencies in speech data offers insights into how deep neural networks discretize continuous data and how symbolic-like rule-based morphophonological processes emerge in a deep…

Computation and Language · Computer Science 2021-09-14 Gašper Beguš

Speech-related Brain Computer Interface (BCI) technologies provide effective vocal communication strategies for controlling devices through speech commands interpreted from brain signals. In order to infer imagined speech from active…

Machine Learning · Computer Science 2019-04-12 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Voice controlled virtual assistants (VAs) are now available in smartphones, cars, and standalone devices in homes. In most cases, the user needs to first "wake-up" the VA by saying a particular word/phrase every time he or she wants the VA…

Human-Computer Interaction · Computer Science 2019-02-05 Atta Norouzian , Bogdan Mazoure , Dermot Connolly , Daniel Willett

Recursive processing in sentence comprehension is considered a hallmark of human linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We studied whether a modern artificial neural network trained with…

Computation and Language · Computer Science 2021-05-04 Yair Lakretz , Dieuwke Hupkes , Alessandra Vergallito , Marco Marelli , Marco Baroni , Stanislas Dehaene

Recently, many researches employ middle-layer output of convolutional neural network models (CNN) as features for different visual recognition tasks. Although promising results have been achieved in some empirical studies, such type of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-09 Jianwei Luo , Jianguo Li , Jun Wang , Zhiguo Jiang , Yurong Chen

Whole brain segmentation using deep learning (DL) is a very challenging task since the number of anatomical labels is very high compared to the number of available training images. To address this problem, previous DL methods proposed to…

Image and Video Processing · Electrical Eng. & Systems 2019-11-22 Pierrick Coupé , Boris Mansencal , Michaël Clément , Rémi Giraud , Baudouin Denis de Senneville , Vinh-Thong Ta , Vincent Lepetit , José V. Manjon