English
Related papers

Related papers: Transfer Learning From Sound Representations For A…

200 papers

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon

This article surveys convolution-based models including convolutional neural networks (CNNs), Conformers, ResNets, and CRNNs-as speech signal processing models and provide their statistical backgrounds and speech recognition, speaker…

Sound · Computer Science 2024-12-02 Nirmal Joshua Kapu , Raghav Karan

Sentiment Analysis typically refers to using natural language processing, text analysis and computational linguistics to extract affect and emotion based information from text data. Our work explores how we can effectively use deep neural…

Computation and Language · Computer Science 2022-02-14 Shahrukh Khan , Mahnoor Shahid

We propose a system to develop a basic automatic speech recognizer(ASR) for Cantonese, a low-resource language, through transfer learning of Mandarin, a high-resource language. We take a time-delayed neural network trained on Mandarin, and…

Computation and Language · Computer Science 2019-11-22 Bryan Li , Xinyue Wang , Homayoon Beigi

Emotion recognition has become a popular topic of interest, especially in the field of human computer interaction. Previous works involve unimodal analysis of emotion, while recent efforts focus on multi-modal emotion recognition from…

Computation and Language · Computer Science 2019-03-11 Chan Woo Lee , Kyu Ye Song , Jihoon Jeong , Woo Yong Choi

We study the merit of transfer learning for two sound recognition problems, i.e., audio tagging and sound event detection. Employing feature fusion, we adapt a baseline system utilizing only spectral acoustic inputs to also make use of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-27 Wim Boes , Hugo Van hamme

In human-computer interaction, Speech Emotion Recognition (SER) plays an essential role in understanding the user's intent and improving the interactive experience. While similar sentimental speeches own diverse speaker characteristics but…

Sound · Computer Science 2022-11-08 Jia-Xin Ye , Xin-Cheng Wen , Xuan-Ze Wang , Yong Xu , Yan Luo , Chang-Li Wu , Li-Yan Chen , Kun-Hong Liu

This paper proposes a Convolutional Neural Network (CNN) inspired by Multitask Learning (MTL) and based on speech features trained under the joint supervision of softmax loss and center loss, a powerful metric learning strategy, for the…

Sound · Computer Science 2019-09-04 Suraj Tripathi , Abhiram Ramesh , Abhay Kumar , Chirag Singh , Promod Yenigalla

Speech emotion conversion is the task of modifying the perceived emotion of a speech utterance while preserving the lexical content and speaker identity. In this study, we cast the problem of emotion conversion as a spoken language…

The recognition of emotions by humans is a complex process which considers multiple interacting signals such as facial expressions and both prosody and semantic content of utterances. Commonly, research on automatic recognition of emotions…

Computation and Language · Computer Science 2019-09-10 Deniz Cevher , Sebastian Zepf , Roman Klinger

Hate speech is harmful content that directly attacks or promotes hatred against members of groups or individuals based on actual or perceived aspects of identity, such as racism, religion, or sexual orientation. This can affect social life…

Computation and Language · Computer Science 2024-03-19 Arijit Das , Somashree Nandy , Rupam Saha , Srijan Das , Diganta Saha

Material classification in natural settings is a challenge due to complex interplay of geometry, reflectance properties, and illumination. Previous work on material classification relies strongly on hand-engineered features of visual…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Patrick Wieschollek , Hendrik P. A. Lensch

Over the past two decades, CNN architectures have produced compelling models of sound perception and cognition, learning hierarchical organizations of features. Analogous to successes in computer vision, audio feature classification can be…

Sound · Computer Science 2025-05-13 Prateek Verma , Jonathan Berger

Speech emotion recognition (SER) has attracted great attention in recent years due to the high demand for emotionally intelligent speech interfaces. Deriving speaker-invariant representations for speech emotion recognition is crucial. In…

Audio and Speech Processing · Electrical Eng. & Systems 2019-03-25 Ming Tu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Although speech recognition has become a widespread technology, inferring emotion from speech signals still remains a challenge. To address this problem, this paper proposes a quaternion convolutional neural network (QCNN) based speech…

Sound · Computer Science 2021-11-02 Aneesh Muppidi , Martin Radfar

This paper proposes a framework for modeling sound change that combines deep learning and iterative learning. Acquisition and transmission of speech is modeled by training generations of Generative Adversarial Networks (GANs) on unannotated…

Computation and Language · Computer Science 2021-09-23 Gašper Beguš

In this paper, a BERT based neural network model is applied to the JIGSAW data set in order to create a model identifying hateful and toxic comments (strictly seperated from offensive language) in online social platforms (English language),…

Computation and Language · Computer Science 2021-10-12 Aygul Zagidullina , Georgios Patoulidis , Jonas Bokstaller

Speech Emotion Recognition (SER) is crucial in human-machine interactions. Mainstream approaches utilize Convolutional Neural Networks or Recurrent Neural Networks to learn local energy feature representations of speech segments from speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Xiaoyu Tang , Yixin Lin , Ting Dang , Yuanfang Zhang , Jintao Cheng

Sound Event Detection (SED) aims to predict the temporal boundaries of all the events of interest and their class labels, given an unconstrained audio sample. Taking either the splitand-classify (i.e., frame-level) strategy or the more…

Sound · Computer Science 2023-08-21 Swapnil Bhosale , Sauradip Nag , Diptesh Kanojia , Jiankang Deng , Xiatian Zhu

There has been a lot of prior work on representation learning for speech recognition applications, but not much emphasis has been given to an investigation of effective representations of affect from speech, where the paralinguistic…

Computation and Language · Computer Science 2016-02-16 Sayan Ghosh , Eugene Laksana , Louis-Philippe Morency , Stefan Scherer