English
Related papers

Related papers: Inverted Vocal Tract Variables and Facial Action U…

200 papers

Speech production involves the movement of various articulators, including tongue, jaw, and lips. Estimating the movement of the articulators from the acoustics of speech is known as acoustic-to-articulatory inversion (AAI). Recently, it…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-23 Aravind Illa , Prasanta Kumar Ghosh

Although many previous studies have carried out multimodal learning with real-time MRI data that captures the audio-visual kinematics of the vocal tract during speech, these studies have been limited by their reliance on multi-speaker…

Machine Learning · Computer Science 2025-06-02 Sean Foley , Hong Nguyen , Jihwan Lee , Sudarsana Reddy Kadiri , Dani Byrd , Louis Goldstein , Shrikanth Narayanan

Real-time Magnetic Resonance Imaging (rtMRI) visualizes vocal tract action, offering a comprehensive window into speech articulation. However, its signals are high dimensional and noisy, hindering interpretation. We investigate compact…

Image and Video Processing · Electrical Eng. & Systems 2026-01-30 Jay Park , Hong Nguyen , Sean Foley , Jihwan Lee , Yoonjeong Lee , Dani Byrd , Shrikanth Narayanan

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

Sound · Computer Science 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Speech neuroprostheses aim to restore communication for people with severe paralysis by decoding speech directly from neural activity. To accelerate algorithmic progress, a recent benchmark released intracranial recordings from a paralyzed…

Human-Computer Interaction · Computer Science 2025-11-04 Ebrahim Feghhi , Shreyas Kaasyap , Nima Hadidi , Jonathan C. Kao

Depression, a prevalent mental health disorder impacting millions globally, demands reliable assessment systems. Unlike previous studies that focus solely on either detecting depression or predicting its severity, our work identifies…

Decoding speech from brain activity is a long-awaited goal in both healthcare and neuroscience. Invasive devices have recently led to major milestones in that regard: deep learning algorithms trained on intracranial recordings now start to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-06 Alexandre Défossez , Charlotte Caucheteux , Jérémy Rapin , Ori Kabeli , Jean-Rémi King

Acoustic articulatory inversion is a major processing challenge, with a wide range of applications from speech synthesis to feedback systems for language learning and rehabilitation. In recent years, deep learning methods have been applied…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-13 Sofiane Azzouz , Pierre-André Vuissoz , Yves Laprie

Effective collaboration requires teams to manage complex cognitive and emotional states through Socially Shared Regulation of Learning (SSRL). Physiological synchrony (i.e., longitudinal alignment in physiological signals) can indicate…

Artificial Intelligence · Computer Science 2026-04-01 Xiaoshan Huang , Conrad Borchers , Jiayi Zhang , Susanne P. Lajoie

Voice disorders affect a large portion of the population, especially heavy voice users such as teachers or call-center workers. Most voice disorders can be treated effectively with behavioral voice therapy, which teaches patients to replace…

Sound · Computer Science 2021-02-16 Chuyao Feng , Eva van Leer , Mackenzie Lee Curtis , David V. Anderson

Depression significantly affects emotions, thoughts, and daily activities. Recent research indicates that speech signals contain vital cues about depression, sparking interest in audio-based deep-learning methods for estimating its…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Shuanglin Li , Zhijie Xie , Syed Mohsen Naqvi

Automatic detection of Alzheimer's dementia by speech processing is enhanced when features of both the acoustic waveform and the content are extracted. Audio and text transcription have been widely used in health-related tasks, as spectral…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Edward L. Campbell , Laura Docío-Fernández , Javier Jiménez Raboso , Carmen García-Mateo

Background: Depression is a major public health concern, affecting an estimated five percent of the global population. Early and accurate diagnosis is essential to initiate effective treatment, yet recognition remains challenging in many…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Jana Weber , Marcel Weber , Juan Miguel Lopez Alcaraz

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Introduction: Alzheimer's disease is a type of dementia in which early diagnosis plays a major rule in the quality of treatment. Among new works in the diagnosis of Alzheimer's disease, there are many of them analyzing the voice stream…

Machine Learning · Computer Science 2019-10-02 S. Soroush Haj Zargarbashi , Bagher Babaali

Investigating the relationship between internal tissue point motion of the tongue and oropharyngeal muscle deformation measured from tagged MRI and intelligible speech can aid in advancing speech motor control theories and developing novel…

Image and Video Processing · Electrical Eng. & Systems 2023-02-15 Xiaofeng Liu , Fangxu Xing , Jerry L. Prince , Maureen Stone , Georges El Fakhri , Jonghye Woo

Schizophrenia is a complicated mental illness characterized by a broad spectrum of symptoms affecting cognition, behavior, and emotion. The task of identifying reliable biomarkers to classify Schizophrenia accurately continues to be a…

Machine Learning · Computer Science 2023-11-22 Pradnya Rajendra Jadhav , Raviprasad Aduri

Speech sound disorders are a common communication impairment in childhood. Because speech disorders can negatively affect the lives and the development of children, clinical intervention is often recommended. To help with diagnosis and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Manuel Sam Ribeiro , Joanne Cleland , Aciel Eshky , Korin Richmond , Steve Renals

Deep learning-based techniques for automatic dysarthric speech detection have recently attracted interest in the research community. State-of-the-art techniques typically learn neurotypical and dysarthric discriminative representations by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-04 Ina Kodrasi

Spectro-temporal dynamics of consonant-vowel (CV) transition regions are considered to provide robust cues related to articulation. In this work, we propose an objective measure of precise articulation, dubbed the objective articulation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-21 Vikram C. Mathad , Julie M. Liss , Kathy Chapman , Nancy Scherer , Visar Berisha