English
Related papers

Related papers: A Novel Deep Learning Architecture for Decoding Im…

200 papers

EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with…

Signal Processing · Electrical Eng. & Systems 2019-01-25 Felix A. Heilmeyer , Robin T. Schirrmeister , Lukas D. J. Fiederer , Martin Völker , Joos Behncke , Tonio Ball

Auditory attention decoding (AAD) is the process of identifying the attended speech in a multi-talker environment using brain signals, typically recorded through electroencephalography (EEG). Over the past decade, AAD has undergone…

Sound · Computer Science 2025-07-08 Nhan Duc Thanh Nguyen , Huy Phan , Simon Geirnaert , Kaare Mikkelsen , Preben Kidmose

Invasive brain-computer interfaces with Electrocorticography (ECoG) have shown promise for high-performance speech decoding in medical applications, but less damaging methods like intracranial stereo-electroencephalography (sEEG) remain…

Signal Processing · Electrical Eng. & Systems 2024-11-04 Hui Zheng , Hai-Teng Wang , Wei-Bang Jiang , Zhong-Tao Chen , Li He , Pei-Yang Lin , Peng-Hu Wei , Guo-Guang Zhao , Yun-Zhe Liu

Convolutional Neural Networks (CNNs) have proven very effective in image classification and show promise for audio. We use various CNN architectures to classify the soundtracks of a dataset of 70M training videos (5.24 million hours) with…

In this paper, we propose a multi-channel network for simultaneous speech dereverberation, enhancement and separation (DESNet). To enable gradient propagation and joint optimization, we adopt the attentional selection mechanism of the…

Sound · Computer Science 2020-11-17 Yihui Fu , Jian Wu , Yanxin Hu , Mengtao Xing , Lei Xie

Accelerating deep neural networks (DNNs) has been attracting increasing attention as it can benefit a wide range of applications, e.g., enabling mobile systems with limited computing resources to own powerful visual recognition ability. A…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Tianshui Chen , Liang Lin , Wangmeng Zuo , Xiaonan Luo , Lei Zhang

This work explores the possibility of decoding Imagined Speech (IS) signals which can be used to create a new design of Human-Computer Interface (HCI). Since the underlying process generating EEG signals is unknown, various feature…

Signal Processing · Electrical Eng. & Systems 2020-11-26 Abhiram Singh , Ashwin Gumaste

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

In this paper, we propose a new methodology for emotional speech recognition using visual deep neural network models. We employ the transfer learning capabilities of the pre-trained computer vision deep models to have a mandate for the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Waleed Ragheb , Mehdi Mirzapour , Ali Delfardi , Hélène Jacquenet , Lawrence Carbon

Speech enhancement has benefited from the success of deep learning in terms of intelligibility and perceptual quality. Conventional time-frequency (TF) domain methods focus on predicting TF-masks or speech spectrum, via a naive convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-24 Yanxin Hu , Yun Liu , Shubo Lv , Mengtao Xing , Shimin Zhang , Yihui Fu , Jian Wu , Bihong Zhang , Lei Xie

Recent studies have been revisiting whole words as the basic modelling unit in speech recognition and query applications, instead of phonetic units. Such whole-word segmental systems rely on a function that maps a variable-length speech…

Computation and Language · Computer Science 2016-01-11 Herman Kamper , Weiran Wang , Karen Livescu

Electrophysiological observation plays a major role in epilepsy evaluation. However, human interpretation of brain signals is subjective and prone to misdiagnosis. Automating this process, especially seizure detection relying on scalp-based…

Machine Learning · Computer Science 2018-07-06 David Ahmedt-Aristizabal , Clinton Fookes , Kien Nguyen , Sridha Sridharan

Deep learning has been a groundbreaking technology in various fields as well as in communications systems. In spite of the notable advancements of deep neural network (DNN) based technologies in recent years, the high computational…

Information Theory · Computer Science 2018-08-08 Minhoe Kim , Woonsup Lee , Jungmin Yoon , Ohyun Jo

Deep learning has recently enabled the decoding of language from the neural activity of a few participants with electrodes implanted inside their brain. However, reliably decoding words from non-invasive recordings remains an open…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Stéphane d'Ascoli , Corentin Bel , Jérémy Rapin , Hubert Banville , Yohann Benchetrit , Christophe Pallier , Jean-Rémi King

Encouraged by the success of deep neural networks on a variety of visual tasks, much theoretical and experimental work has been aimed at understanding and interpreting how vision networks operate. Meanwhile, deep neural networks have also…

Machine Learning · Computer Science 2020-03-05 Cory Stephenson , Jenelle Feather , Suchismita Padhy , Oguz Elibol , Hanlin Tang , Josh McDermott , SueYeon Chung

Deep neural networks (DNNs) are now a central component of nearly all state-of-the-art speech recognition systems. Building neural network acoustic models requires several design decisions including network architecture, size, and training…

Computation and Language · Computer Science 2015-01-21 Andrew L. Maas , Peng Qi , Ziang Xie , Awni Y. Hannun , Christopher T. Lengerich , Daniel Jurafsky , Andrew Y. Ng

Electroencephalography (EEG) is a complex signal and can require several years of training to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn…

Machine Learning · Computer Science 2019-01-23 Yannick Roy , Hubert Banville , Isabela Albuquerque , Alexandre Gramfort , Tiago H. Falk , Jocelyn Faubert

Deep neural networks (DNN) are quickly becoming the de facto standard modeling method for many natural language generation (NLG) tasks. In order for such models to truly be useful, they must be capable of correctly generating utterances for…

Computation and Language · Computer Science 2019-11-11 Chris Kedzie , Kathleen McKeown

In this paper, we present a novel Deep Triphone Embedding (DTE) representation derived from Deep Neural Network (DNN) to encapsulate the discriminative information present in the adjoining speech frames. DTEs are generated using a four…

Sound · Computer Science 2017-10-25 Mohit Yadav , Vivek Tyagi

Brain signals could be used to control devices to assist individuals with disabilities. Signals such as electroencephalograms are complicated and hard to interpret. A set of signals are collected and should be classified to identify the…

Signal Processing · Electrical Eng. & Systems 2021-05-25 Ghazale Ghorbanzade , Zahra Nabizadeh-ShahreBabak , Shadrokh Samavi , Nader Karimi , Ali Emami , Pejman Khadivi