English
Related papers

Related papers: Cross-paradigm pretraining of convolutional networ…

200 papers

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

Deep neural networks such as convolutional neural networks (CNNs) and transformers have achieved many successes in image classification in recent years. It has been consistently demonstrated that best practice for image classification is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jo Plested , Musa Phiri , Tom Gedeon

Detailed mobile sensing data from phones, watches, and fitness trackers offer an unparalleled opportunity to quantify and act upon previously unmeasurable behavioral changes in order to improve individual health and accelerate responses to…

Machine Learning · Computer Science 2022-06-06 Mike A. Merrill , Tim Althoff

We propose an efficient transfer learning method for adapting ImageNet pre-trained Convolutional Neural Network (CNN) to fine-grained image classification task. Conventional transfer learning methods typically face the trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Xiangxi Mo , Ruizhe Cheng , Tianyi Fang

Pathology diagnosis based on EEG signals and decoding brain activity holds immense importance in understanding neurological disorders. With the advancement of artificial intelligence methods and machine learning techniques, the potential…

Deep neural networks have shown promising results for various clinical prediction tasks. However, training deep networks such as those based on Recurrent Neural Networks (RNNs) requires large labeled data, significant hyper-parameter tuning…

Machine Learning · Computer Science 2021-03-05 Priyanka Gupta , Pankaj Malhotra , Jyoti Narwariya , Lovekesh Vig , Gautam Shroff

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Recent breakthroughs in deep learning often rely on representation learning and knowledge transfer. In recent years, unsupervised and self-supervised techniques for learning speech representation were developed to foster automatic speech…

Computation and Language · Computer Science 2021-12-15 Pierre Beckmann , Mikolaj Kegler , Milos Cernak

Transformers have the capacity to act as supervised learning algorithms: by properly encoding a set of labeled training ("in-context") examples and an unlabeled test example into an input sequence of vectors of the same dimension, the…

Machine Learning · Computer Science 2024-12-16 Spencer Frei , Gal Vardi

Machine learning can extract information from neural recordings, e.g., surface EEG, ECoG and {\mu}ECoG, and therefore plays an important role in many research and clinical applications. Deep learning with artificial neural networks has…

Many statistical learning models hold an assumption that the training data and the future unlabeled data are drawn from the same distribution. However, this assumption is difficult to fulfill in real-world scenarios and creates barriers in…

Human-Computer Interaction · Computer Science 2020-09-16 Yuxin Ma , Arlen Fan , Jingrui He , Arun Reddy Nelakurthi , Ross Maciejewski

Transfer learning allows us to train deep architectures requiring a large number of learned parameters, even if the amount of available data is limited, by leveraging existing models previously trained for another task. Here we explore the…

Software Engineering · Computer Science 2020-03-04 Natalie Best , Jordan Ott , Erik Linstead

The electroencephalography classifier is the most important component of brain-computer interface based systems. There are two major problems hindering the improvement of it. First, traditional methods do not fully exploit multimodal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Chuanqi Tan , Fuchun Sun , Wenchang Zhang

EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with…

Signal Processing · Electrical Eng. & Systems 2019-01-25 Felix A. Heilmeyer , Robin T. Schirrmeister , Lukas D. J. Fiederer , Martin Völker , Joos Behncke , Tonio Ball

Unsupervised pre-training and transfer learning are commonly used techniques to initialize training algorithms for neural networks, particularly in settings with limited labeled data. In this paper, we study the effects of unsupervised…

Machine Learning · Statistics 2025-06-12 Taj Jones-McCormick , Aukosh Jagannath , Subhabrata Sen

We introduce here the idea of Meta-Learning for training EEG BCI decoders. Meta-Learning is a way of training machine learning systems so they learn to learn. We apply here meta-learning to a simple Deep Learning BCI architecture and…

Signal Processing · Electrical Eng. & Systems 2021-03-17 Denghao Li , Pablo Ortega , Xiaoxi Wei , Aldo Faisal

Deep learning with convolutional neural networks (ConvNets) have dramatically improved learning capabilities of computer vision applications just through considering raw data without any prior feature extraction. Nowadays, there is rising…

Signal Processing · Electrical Eng. & Systems 2019-07-15 Apdullah Yayık , Yakup Kutlu , Gökhan Altan

The variability in EEG signals between different individuals poses a significant challenge when implementing brain-computer interfaces (BCI). Commonly proposed solutions to this problem include deep learning models, due to their increased…

Signal Processing · Electrical Eng. & Systems 2023-12-01 Stylianos Bakas , Siegfried Ludwig , Dimitrios A. Adamos , Nikolaos Laskaris , Yannis Panagakis , Stefanos Zafeiriou

We apply convolutional neural networks (ConvNets) to the task of distinguishing pathological from normal EEG recordings in the Temple University Hospital EEG Abnormal Corpus. We use two basic, shallow and deep ConvNet architectures recently…

Machine Learning · Computer Science 2018-01-15 Robin Tibor Schirrmeister , Lukas Gemein , Katharina Eggensperger , Frank Hutter , Tonio Ball

Transfer learning refers to machine learning techniques that focus on acquiring knowledge from related tasks to improve generalization in the tasks of interest. In MRI, transfer learning is important for developing strategies that address…

Image and Video Processing · Electrical Eng. & Systems 2021-04-05 Juan Miguel Valverde , Vandad Imani , Ali Abdollahzadeh , Riccardo De Feo , Mithilesh Prakash , Robert Ciszek , Jussi Tohka