English
Related papers

Related papers: Silent Speech Interfaces for Speech Restoration: A…

200 papers

Almost half a billion people world-wide suffer from disabling hearing loss. While hearing aids can partially compensate for this, a large proportion of users struggle to understand speech in situations with background noise. Here, we…

While search technologies have evolved to be robust and ubiquitous, the fundamental interaction paradigm has remained relatively stable for decades. With the maturity of the Brain-Machine Interface, we build an efficient and effective…

Information Retrieval · Computer Science 2021-10-18 Xuesong Chen , Ziyi Ye , Xiaohui Xie , Yiqun Liu , Weihang Su , Shuqi Zhu , Min Zhang , Shaoping Ma

This dissertation covers a single-processor approach to the speech processing pipeline of bilateral Cochlear Implants (CIs). The use of only a single processor to provide binaural stimulation signals overcomes the synchronization problem,…

Sound · Computer Science 2014-09-24 Taher Shahbazi Mirzahasanloo

While recent text-to-speech (TTS) systems have made remarkable strides toward human-level quality, the performance of cross-lingual TTS lags behind that of intra-lingual TTS. This gap is mainly rooted from the speaker-language entanglement…

Sound · Computer Science 2023-06-13 Ji-Hoon Kim , Hong-Sun Yang , Yoon-Cheol Ju , Il-Hwan Kim , Byeong-Yeol Kim

Speech is essential for human communication, yet millions of people face impairments such as dysarthria, stuttering, and aphasia conditions that often lead to social isolation and reduced participation. Despite recent progress in automatic…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Haowei Lou , Chengkai Huang , Hye-young Paik , Yongquan Hu , Aaron Quigley , Wen Hu , Lina Yao

The success of large language models (LLMs) has prompted efforts to integrate speech and audio data, aiming to create general foundation models capable of processing both textual and non-textual inputs. Recent advances, such as GPT-4o,…

Computation and Language · Computer Science 2024-10-18 Fan Bu , Yuhao Zhang , Xidong Wang , Benyou Wang , Qun Liu , Haizhou Li

Cochlear implants (CIs) provide a solution for individuals with severe sensorineural hearing loss to regain their hearing abilities. When someone experiences this form of hearing impairment in both ears, they may be equipped with two…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-03 Tom Gajecki , Waldo Nogueira

Wearable silent speech systems hold significant potential for restoring communication in patients with speech impairments. However, seamless, coherent speech remains elusive, and clinical efficacy is still unproven. Here, we present an…

Sensory feedback is critical to the performance of neural prostheses that restore movement control after neurological injury. Recent advances in direct neural control of paralyzed arms present new requirements for miniaturized, low-power…

Lip-to-speech synthesis aims to generate speech audio directly from silent facial video by reconstructing linguistic content from lip movements, providing valuable applications in situations where audio signals are unavailable or degraded.…

Sound · Computer Science 2026-02-03 Jaejun Lee , Yoori Oh , Kyogu Lee

Speech disorders such as dysarthria and anarthria can severely impair the patient's ability to communicate verbally. Speech decoding brain-computer interfaces (BCIs) offer a potential alternative by directly translating speech intentions…

Human-Computer Interaction · Computer Science 2025-05-27 Hongbin Wang , Zhihong Jia , Yuanzhong Shen , Ziwei Wang , Siyang Li , Kai Shu , Feng Hu , Dongrui Wu

The aim of the study is to investigate the complex mechanisms of speech perception and ultimately decode the electrical changes in the brain accruing while listening to speech. We attempt to decode heard speech from intracranial…

Human-Computer Interaction · Computer Science 2025-01-28 Milán András Fodor , Tamás Gábor Csapó , Frigyes Viktor Arthur

Despite the rapid advances in Brain-computer Interfacing (BCI) and continuous effort to improve the accuracy of brain decoding systems, the urge for the systems to reconstruct the experiences of the users has been widely acknowledged. This…

Signal Processing · Electrical Eng. & Systems 2017-11-20 Pouya Ghaemmaghami

The recent advancements in bio-engineering and wireless communications systems have motivated researchers to propose novel applications for telemedicine, therapeutics and human health monitoring. For instance, through wireless medical…

Systems and Control · Electrical Eng. & Systems 2021-05-03 Yevgeni Koucheryavy , Anastasia Yastrebova , Daniel P. Martins , Sasitharan Balasubramaniam

Imagine unlocking the power of the mind to communicate, create, and even interact with the world around us. Recent breakthroughs in Artificial Intelligence (AI), especially in how machines "see" and "understand" language, are now fueling…

Individuals with severe physical disabilities often experience diminished quality of life stemming from limited ability to engage with their surroundings. Brain-Computer Interface (BCI) technology aims to bridge this gap by enabling direct…

Signal Processing · Electrical Eng. & Systems 2025-06-05 Timothy B Mahoney , JingYang Liu , Huakun Xin , David B Grayden , Sam E John

Patients with amyotrophic lateral sclerosis (ALS) in the completely locked-in state (CLIS) can lose all reliable motor control and are left without any means of communication. It remains unknown whether non-invasive electroencephalogram…

Human-Computer Interaction · Computer Science 2025-07-02 Deland Liu , Frigyes Samuel Racz , Zoe Lalji , Jose del R. Millan

Speech holds promise as a cost-effective and non-invasive biomarker for neurological conditions such as Parkinson's disease (PD). While deep learning systems trained on raw audio can find subtle signals not available from hand-crafted…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-24 Peter Plantinga , Jen-Kai Chen , Roozbeh Sattari , Mirco Ravanelli , Denise Klein

Electroencephalography (EEG) signals are promising as alternatives to other biometrics owing to their protection against spoofing. Previous studies have focused on capturing individual variability by analyzing task/condition-specific EEG.…

Signal Processing · Electrical Eng. & Systems 2021-03-29 Mari Ganesh Kumar , Shrikanth Narayanan , Mriganka Sur , Hema A Murthy

In multi speakers environments, cochlear implant (CI) users may attend to a target sound source in a different manner from the normal hearing (NH) individuals during a conversation. This study attempted to investigate the effect of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-05 Sara Akbarzadeh , Sungmin Lee , Chin-Tuan Tan