English
Related papers

Related papers: Sequential Transfer Learning to Decode Heard and I…

200 papers

This paper proposes a novel framework for recurrent neural networks (RNNs) inspired by the human memory models in the field of cognitive neuroscience to enhance information processing and transmission between adjacent RNNs' units. The…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Xi Chen , Zhihong Deng , Gehui Shen , Ting Huang

The dispute of how the human brain represents conceptual knowledge has been argued in many scientific fields. Brain imaging studies have shown that the spatial patterns of neural activation in the brain are correlated with thinking about…

Neurons and Cognition · Quantitative Biology 2018-06-15 Subba Reddy Oota , Naresh Manwani , Bapi Raju S

Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in deep learning and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weiyu Guo , Guoying Sun , JianXiang He , Tong Shao , Shaoguang Wang , Ziyang Chen , Meisheng Hong , Ying Sun , Hui Xiong

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

Machine Learning · Computer Science 2020-07-03 Huanru Henry Mao

We explore a novel way of conceptualising the task of polyphonic music transcription, using so-called invertible neural networks. Invertible models unify both discriminative and generative aspects in one function, sharing one set of…

Sound · Computer Science 2019-09-05 Rainer Kelz , Gerhard Widmer

Finetuning a pretrained backbone in the encoder part of an image transformer network has been the traditional approach for the semantic segmentation task. However, such an approach leaves out the semantic context that an image provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Jitesh Jain , Anukriti Singh , Nikita Orlov , Zilong Huang , Jiachen Li , Steven Walton , Humphrey Shi

Accurate decoding of surface electromyography (sEMG) is pivotal for muscle-to-machine-interfaces (MMI) and their application for e.g. rehabilitation therapy. sEMG signals have high inter-subject variability, due to various factors,…

Machine Learning · Computer Science 2022-01-03 Stephan Johann Lehmler , Muhammad Saif-ur-Rehman , Tobias Glasmachers , Ioannis Iossifidis

In recent years, research on music transcription has focused mainly on architecture design and instrument-specific data acquisition. With the lack of availability of diverse datasets, progress is often limited to solo-instrument tasks such…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-25 Frank Cwitkowitz , Kin Wai Cheuk , Woosung Choi , Marco A. Martínez-Ramírez , Keisuke Toyama , Wei-Hsiang Liao , Yuki Mitsufuji

Transfer learning makes it possible to use large vision networks on a variety of domains, by specializing their models' general filters to new tasks. However, these networks assume the input images to have 3 input channels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Mariette Schönfeld , Laurens Devos , Wannes Meert , Hendrik Blockeel

We develop and investigate several cross-lingual alignment approaches for neural sentence embedding models, such as the supervised inference classifier, InferSent, and sequential encoder-decoder models. We evaluate three alignment…

Computation and Language · Computer Science 2019-04-12 Hanan Aldarmaki , Mona Diab

Data reconstruction is a widely used pre-training task to learn the generalized features for many downstream tasks. Although reconstruction tasks have been applied to neural signal completion and denoising, neural signal reconstruction is…

Neurons and Cognition · Quantitative Biology 2024-07-02 Youzhi Qu , Junfeng Xia , Xinyao Jian , Wendu Li , Kaining Peng , Zhichao Liang , Haiyan Wu , Quanying Liu

We propose a robust spectrum sensing framework based on deep learning. The received signals at the secondary user's receiver are filtered, sampled and then directly fed into a convolutional neural network. Although this deep sensing is…

Information Theory · Computer Science 2019-08-05 Qihang Peng , Andrew Gilman , Nuno Vasconcelos , Pamela C. Cosman , Laurence B. Milstein

Transfer learning, a technique commonly used in generative artificial intelligence, allows neural network models to bring prior knowledge to bear when learning a new task. This study demonstrates that transfer learning significantly…

Quantitative Methods · Quantitative Biology 2025-06-03 William G Coon , Diego Luna , Akshita Panagrahi , Matthew Reid , Mattson Ogg

The hype about sensorimotor learning is currently reaching high fever, thanks to the latest advancement in deep learning. In this paper, we present an open-source framework for collecting large-scale, time-synchronised synthetic data from…

Robotics · Computer Science 2019-07-24 A. Barsky , C. Zito , H. Mori , T. Ogata , J. L. Wyatt

Music generated by deep learning methods often suffers from a lack of coherence and long-term organization. Yet, multi-scale hierarchical structure is a distinctive feature of music signals. To leverage this information, we propose a…

Sound · Computer Science 2024-02-29 Manvi Agarwal , Changhong Wang , Gaël Richard

The objective of this work is to explore how to effectively and efficiently adapt pre-trained visual foundation models to various downstream tasks of semantic segmentation. Previous methods usually fine-tuned the entire networks for each…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Lingbo Liu , Jianlong Chang , Bruce X. B. Yu , Liang Lin , Qi Tian , Chang-Wen Chen

When trained on language data, do transformers learn some arbitrary computation that utilizes the full capacity of the architecture or do they learn a simpler, tree-like computation, hypothesized to underlie compositional meaning systems…

Computation and Language · Computer Science 2022-11-07 Shikhar Murty , Pratyusha Sharma , Jacob Andreas , Christopher D. Manning

Tone Transfer is a novel deep-learning technique for interfacing a sound source with a synthesizer, transforming the timbre of audio excerpts while keeping their musical form content. Due to its good audio quality results and continuous…

Sound · Computer Science 2023-10-10 Franco Caspe , Andrew McPherson , Mark Sandler