English
Related papers

Related papers: Speech-Based Depression Prediction Using Encoder-W…

200 papers

Transformer-based models have gained increasing popularity achieving state-of-the-art performance in many research fields including speech translation. However, Transformer's quadratic complexity with respect to the input sequence length…

Computation and Language · Computer Science 2023-10-19 Sara Papi , Marco Gaido , Matteo Negri , Marco Turchi

Clinical depression or Major Depressive Disorder (MDD) is a common and serious medical illness. In this paper, a deep recurrent neural network-based framework is presented to detect depression and to predict its severity level from speech.…

Human-Computer Interaction · Computer Science 2020-03-13 Emna Rejaibi , Ali Komaty , Fabrice Meriaudeau , Said Agrebi , Alice Othmani

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted…

Sound · Computer Science 2021-04-09 Leonardo Pepino , Pablo Riera , Luciana Ferrer

We study transfer learning in convolutional network architectures applied to the task of recognizing audio, such as environmental sound events and speech commands. Our key finding is that not only is it possible to transfer representations…

Sound · Computer Science 2017-10-24 Brian McMahan , Delip Rao

This study investigates whether speech-based depression detection models learn depression-related acoustic biomarkers or instead rely on speaker identity cues. Using the DAIC-WOZ dataset, we propose a data-splitting strategy that controls…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-17 Hsiang-Chen Yeh , Luqi Sun , Aurosweta Mahapatra , Shreeram Suresh Chandra , Emily Mower Provost , Berrak Sisman

Speech-to-text translation has many potential applications for low-resource languages, but the typical approach of cascading speech recognition with machine translation is often impossible, since the transcripts needed to train a speech…

Computation and Language · Computer Science 2018-06-19 Sameer Bansal , Herman Kamper , Karen Livescu , Adam Lopez , Sharon Goldwater

Paralinguistic speech processing is important in addressing many issues, such as sentiment and neurocognitive disorder analyses. Recently, Transformer has achieved remarkable success in the natural language processing field and has…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-01 Weidong Chen , Xiaofen Xing , Xiangmin Xu , Jianxin Pang , Lan Du

Accurately extracting clinical information from speech is critical to the diagnosis and treatment of many neurological conditions. As such, there is interest in leveraging AI for automatic, objective assessments of clinical speech to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Daniela A. Wiepert , Rene L. Utianski , Joseph R. Duffy , John L. Stricker , Leland R. Barnard , David T. Jones , Hugo Botha

Reconstructing natural speech from neural activity is vital for enabling direct communication via brain-computer interfaces. Previous efforts have explored the conversion of neural recordings into speech using complex deep neural network…

Sound · Computer Science 2024-02-01 Jiawei Li , Chunxu Guo , Li Fu , Lu Fan , Edward F. Chang , Yuanning Li

Depression is underdiagnosed in primary care, yet timely identification remains critical. Recorded clinical encounters, increasingly common with digital scribing technologies, present an opportunity to detect depression from naturalistic…

Computation and Language · Computer Science 2026-04-09 Feng Chen , Manas Bedmutha , Janice Sabin , Andrea Hartzler , Nadir Weibel , Trevor Cohen

Parkinson's disease patients develop different speech impairments that affect their communication capabilities. The automatic assessment of the speech of the patients allows the development of computer aided tools to support the diagnosis…

Machine Learning · Computer Science 2020-02-12 J. C. Vásquez-Correa , T. Arias-Vergara , C. D. Rios-Urrego , M. Schuster , J. Rusz , J. R. Orozco-Arroyave , E. Nöth

We propose a novel explainable machine learning (ML) model that identifies depression from speech, by modeling the temporal dependencies across utterances and utilizing the spectrotemporal information at the vowel level. Our method first…

Sound · Computer Science 2022-10-28 Kexin Feng , Theodora Chaspari

In this paper, we focus on improving the performance of the text-dependent speaker verification system in the scenario of limited training data. The speaker verification system deep learning based text-dependent generally needs a large…

Sound · Computer Science 2020-11-24 Xiaoyi Qin , Yaogen Yang , Lin Yang , Xuyang Wang , Junjie Wang , Ming Li

To join the advantages of classical and end-to-end approaches for speech recognition, we present a simple, novel and competitive approach for phoneme-based neural transducer modeling. Different alignment label topologies are compared and…

Computation and Language · Computer Science 2021-04-21 Wei Zhou , Simon Berger , Ralf Schlüter , Hermann Ney

Depression detection research has increased over the last few decades, one major bottleneck of which is the limited data availability and representation learning. Recently, self-supervised learning has seen success in pretraining text…

Human-Computer Interaction · Computer Science 2021-10-29 Pingyue Zhang , Mengyue Wu , Heinrich Dinkel , Kai Yu

We introduce a new approach to generative data-driven dialogue systems (e.g. chatbots) called TransferTransfo which is a combination of a Transfer learning based training scheme and a high-capacity Transformer model. Fine-tuning is…

Computation and Language · Computer Science 2019-02-05 Thomas Wolf , Victor Sanh , Julien Chaumond , Clement Delangue

Perinatal depression (PND) affects 1 in 5 mothers, with 85% lacking support. Digital health tools offer early identification and prevention, potentially reducing PND risk by over 50% and improving engagement. Despite high interest, user…

Quantitative Methods · Quantitative Biology 2025-05-13 Rachel L. Wiley , Jim Schwoebel , Joel Shor , Bindu Chanagala , Matias Caccia , Adolfo M. García , Sheehan D. Fisher , Martin G. Frasch

In this paper, we seek solutions for reducing the computation complexity of transformer-based models for speech representation learning. We evaluate 10 attention algorithms; then, we pre-train the transformer-based model with those…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-04 Tsung-Han Wu , Chun-Chen Hsieh , Yen-Hao Chen , Po-Han Chi , Hung-yi Lee

We introduce a state-of-the-art real-time, high-fidelity, audio codec leveraging neural networks. It consists in a streaming encoder-decoder architecture with quantized latent space trained in an end-to-end fashion. We simplify and speed-up…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Alexandre Défossez , Jade Copet , Gabriel Synnaeve , Yossi Adi