English
Related papers

Related papers: Predicting Heart Activity from Speech using Data-d…

200 papers

Speech is the most natural way of expressing ourselves as humans. Identifying emotion from speech is a nontrivial task due to the ambiguous definition of emotion itself. Speaker Emotion Recognition (SER) is essential for understanding human…

Sound · Computer Science 2024-11-07 Pourya Jafarzadeh , Amir Mohammad Rostami , Padideh Choobdar

Speech and voice conditions can alter the acoustic properties of speech, which could impact the performance of paralinguistic models for affect for people with atypical speech. We evaluate publicly available models for recognizing…

Machine Learning · Computer Science 2025-08-01 Jaya Narain , Amrit Romana , Vikramjit Mitra , Colin Lea , Shirley Ren

Self-supervised learning enables the training of large neural models without the need for large, labeled datasets. It has been generating breakthroughs in several fields, including computer vision, natural language processing, biology, and…

Computation and Language · Computer Science 2023-12-19 Luis Lugo , Valentin Vielzeuf

Self-supervised learning (SSL) has transformed speech processing, yet its reliance on massive pre-training datasets remains a bottleneck. While robustness is often attributed to scale and diversity, the role of the data distribution is less…

Sound · Computer Science 2026-04-24 Ryan Whetten , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Early detection of exacerbations in asthma and chronic obstructive pulmonary disease (COPD) is important for timely intervention. Speech has emerged as a promising tool for continuous, non-invasive respiratory disease monitoring. However,…

Sound · Computer Science 2026-05-19 Yuyang Yan , Sami O. Simons , Visara Urovi

Depression commonly co-occurs with neurodegenerative disorders like Multiple Sclerosis (MS), yet the potential of speech-based Artificial Intelligence for detecting depression in such contexts remains unexplored. This study examines the…

Computation and Language · Computer Science 2025-08-26 Monica Gonzalez-Machorro , Uwe Reichel , Pascal Hecker , Helly Hammer , Hesam Sagha , Florian Eyben , Robert Hoepner , Björn W. Schuller

It is widely accepted that information derived from analyzing speech (the acoustic signal) and language production (words and sentences) serves as a useful window into the health of an individual's cognitive ability. In fact, most…

Computation and Language · Computer Science 2019-11-06 Rohit Voleti , Julie M. Liss , Visar Berisha

Estimating the quality of remote speech communication is a complex task influenced by the speaker, transmission channel, and listener. For example, the degradation of transmission quality can increase listeners' cognitive load, which can…

Human-Computer Interaction · Computer Science 2023-03-02 Robert P. Spang , Karl El Hajal , Sebastian Möller , Milos Cernak

Call and messaging logs from mobile devices have been used to predict human personality traits successfully in recent years. However, the widely available accelerometer data is not yet utilized for this purpose. In this research, we…

Human-Computer Interaction · Computer Science 2019-06-20 Nan Gao , Wei Shao , Flora D Salim

Auscultation, particularly heart sound, is a non-invasive technique that provides essential vital sign information. Recently, self-supervised acoustic representation foundation models (FMs) have been proposed to offer insights into…

This study investigates whether speech-based depression detection models learn depression-related acoustic biomarkers or instead rely on speaker identity cues. Using the DAIC-WOZ dataset, we propose a data-splitting strategy that controls…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-17 Hsiang-Chen Yeh , Luqi Sun , Aurosweta Mahapatra , Shreeram Suresh Chandra , Emily Mower Provost , Berrak Sisman

Body sounds provide rich information about the state of the human body and can be useful in many medical applications. Auscultation, the practice of listening to body sounds, has been used for centuries in respiratory and cardiac medicine…

Human-Computer Interaction · Computer Science 2020-08-13 Shyam A. Tailor , Jagmohan Chauhan , Cecilia Mascolo

Accurately detecting voiced intervals in speech signals is a critical step in pitch tracking and has numerous applications. While conventional signal processing methods and deep learning algorithms have been proposed for this task, their…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Yixuan Zhang , Heming Wang , DeLiang Wang

Audio-visual pre-trained models have gained substantial attention recently and demonstrated superior performance on various audio-visual tasks. This study investigates whether pre-trained audio-visual models demonstrate non-arbitrary…

Computation and Language · Computer Science 2024-11-13 Wei-Cheng Tseng , Yi-Jen Shih , David Harwath , Raymond Mooney

While signal conversion and disentangled representation learning have shown promise for manipulating data attributes across domains such as audio, image, and multimodal generation, existing approaches, especially for speech style…

Sound · Computer Science 2025-10-10 Jonathan Svirsky , Ofir Lindenbaum , Uri Shaham

Recent innovations in self-supervised representation learning have led to remarkable advances in natural language processing. That said, in the speech processing domain, self-supervised representation learning-based systems are not yet…

Computation and Language · Computer Science 2022-03-02 Hagai Aronowitz , Itai Gat , Edmilson Morais , Weizhong Zhu , Ron Hoory

In the development of neural text-to-speech systems, model pre-training with a large amount of non-target speakers' data is a common approach. However, in terms of ultimately achieved system performance for target speaker(s), the actual…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-11 Guangyan Zhang , Yichong Leng , Daxin Tan , Ying Qin , Kaitao Song , Xu Tan , Sheng Zhao , Tan Lee

For spoken dialog systems to conduct fluid conversational interactions with users, the systems must be sensitive to turn-taking cues produced by a user. Models should be designed so that effective decisions can be made as to when it is…

Computation and Language · Computer Science 2018-07-02 Matthew Roddy , Gabriel Skantze , Naomi Harte

Suicide remains a public health challenge, necessitating improved detection methods to facilitate timely intervention and treatment. This systematic review evaluates the role of Artificial Intelligence (AI) and Machine Learning (ML) in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Ambre Marie , Marine Garnier , Thomas Bertin , Laura Machart , Guillaume Dardenne , Gwenolé Quellec , Sofian Berrouiguet

This study investigates the utility of speech signals for AI-based depression screening across varied interaction scenarios, including psychiatric interviews, chatbot conversations, and text readings. Participants include depressed patients…

Sound · Computer Science 2024-06-13 Yangbin Chen , Chenyang Xu , Chunfeng Liang , Yanbao Tao , Chuan Shi