English
Related papers

Related papers: BENDR: using transformers and a contrastive self-s…

200 papers

Deep neural networks (DNNs) have proven successful in a wide variety of applications such as speech recognition and synthesis, computer vision, machine translation, and game playing, to name but a few. However, existing deep neural network…

Machine Learning · Computer Science 2022-08-08 Ramit Pahwa

Deep neural networks (DNNs) are observed to be successful in pattern classification. However, high classification performances of DNNs are related to their large training sets. Unfortunately, in the literature, the datasets used to classify…

Machine Learning · Computer Science 2021-03-23 Zumray Dokur , Tamer Olmez

We propose a mixed deep neural network strategy, incorporating parallel combination of Convolutional (CNN) and Recurrent Neural Networks (RNN), cascaded with deep autoencoders and fully connected layers towards automatic identification of…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Sidney Fels

Nowadays, machine and deep learning techniques are widely used in different areas, ranging from economics to biology. In general, these techniques can be used in two ways: trying to adapt well-known models and architectures to the available…

Machine Learning · Computer Science 2022-03-21 Danilo Avola , Marco Cascio , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Marco Raoul Marini , Daniele Pannone

A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained…

Signal Processing · Electrical Eng. & Systems 2022-06-16 Alessandro Gallo , Manh Duong Phung

Attending to the speech stream of interest in multi-talker environments can be a challenging task, particularly for listeners with hearing impairment. Research suggests that neural responses assessed with electroencephalography (EEG) are…

Human-Computer Interaction · Computer Science 2023-02-28 Emina Alickovic , Tobias Dorszewski , Thomas U. Christiansen , Kasper Eskelund , Leonardo Gizzi , Martin A. Skoglund , Dorothea Wendt

The success of supervised deep learning methods is largely due to their ability to learn relevant features from raw data. Deep Neural Networks (DNNs) trained on large-scale datasets are capable of capturing a diverse set of features, and…

In recent years, deep learning-based feature representation methods have shown a promising impact in electroencephalography (EEG)-based brain-computer interface (BCI). Nonetheless, owing to high intra- and inter-subject variabilities, many…

Machine Learning · Computer Science 2020-08-24 Eunjin Jeon , Wonjun Ko , Jee Seok Yoon , Heung-Il Suk

EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with…

Signal Processing · Electrical Eng. & Systems 2019-01-25 Felix A. Heilmeyer , Robin T. Schirrmeister , Lukas D. J. Fiederer , Martin Völker , Joos Behncke , Tonio Ball

There is a correlation between adjacent channels of electroencephalogram (EEG), and how to represent this correlation is an issue that is currently being explored. In addition, due to inter-individual differences in EEG signals, this…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Jie Jiao , Meiyan Xu , Qingqing Chen , Hefan Zhou , Wangliang Zhou

Deep learning, as a highly efficient method for metasurface inverse design, commonly use simulation data to train deep neural networks (DNNs) that can map desired functionalities to proper metasurface designs. However, the assumptions and…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Jingxin Zhang , Jiawei Xi , Peixing Li , Ray C. C. Cheung , Alex M. H. Wong , Jensen Li

Brain computer interface (BCI) has been popular as a key approach to monitor our brains recent year. Mental states monitoring is one of the most important BCI applications and becomes increasingly accessible. However, the mental state…

Signal Processing · Electrical Eng. & Systems 2019-11-14 Dongdong Zhang , Dong Cao , Haibo Chen

Deep Learning has impacted various fields especially in bio-medical applications. Deep learning algorithms work well with both structured and unstructured data. Especially, convolutional neural network work well with signal-based data like…

Signal Processing · Electrical Eng. & Systems 2022-01-11 Shivaditya Shivganesh

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

End-to-end neural network based approaches to audio modelling are generally outperformed by models trained on high-level data representations. In this paper we present preliminary work that shows the feasibility of training the first layers…

Sound · Computer Science 2017-12-04 Tycho Max Sylvester Tax , Jose Luis Diez Antich , Hendrik Purwins , Lars Maaløe

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Zongyan Yao , Xilin Liu

Deep learning has been successfully used in numerous applications because of its outstanding performance and the ability to avoid manual feature engineering. One such application is electroencephalogram (EEG) based brain-computer interface…

Machine Learning · Computer Science 2019-04-03 Xiao Zhang , Dongrui Wu

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

Human-Computer Interaction · Computer Science 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu