English
Related papers

Related papers: SeqSleepNet: End-to-End Hierarchical Recurrent Neu…

200 papers

This study introduces a parameter-efficient Hierarchical Spatial Temporal Network (HiSTN) specifically designed for the task of emotion classification using multi-channel electroencephalogram data. The network incorporates a graph hierarchy…

Signal Processing · Electrical Eng. & Systems 2024-08-29 Dongyang Kuang , Xinyue Song , Craig Michoski

A family of super deep networks, referred to as residual networks or ResNet, achieved record-beating performance in various visual tasks such as image recognition, object detection, and semantic segmentation. The ability to train very deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Xin Yu , Zhiding Yu , Srikumar Ramalingam

Sequential recommendation effectively addresses information overload by modeling users' temporal and sequential interaction patterns. To overcome the limitations of supervision signals, recent approaches have adopted self-supervised…

Information Retrieval · Computer Science 2024-06-03 Yuxi Liu , Lianghao Xia , Chao Huang

Accurate classification of sleep stages from less obtrusive sensor measurements such as the electrocardiogram (ECG) or photoplethysmogram (PPG) could enable important applications in sleep medicine. Existing approaches to this problem have…

Machine Learning · Computer Science 2024-11-08 Jonathan F. Carter , Lionel Tarassenko

Automatic sleep scoring is essential for the diagnosis and treatment of sleep disorders and enables longitudinal sleep tracking in home environments. Conventionally, learning-based automatic sleep scoring on single-channel…

Machine Learning · Computer Science 2024-08-01 Seongju Lee , Yeonguk Yu , Seunghyeok Back , Hogeon Seo , Kyoobin Lee

Labeled data is a critical resource for training and evaluating machine learning models. However, many real-life datasets are only partially labeled. We propose a semi-supervised machine learning training strategy to improve event detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Florian Dubost , Erin Hong , Nandita Bhaskhar , Siyi Tang , Daniel Rubin , Christopher Lee-Messer

Deep neural networks have achieved remarkable performance across various tasks when supplied with large-scale labeled data. However, the collection of labeled data can be time-consuming and labor-intensive. Semi-supervised learning (SSL),…

Machine Learning · Computer Science 2024-06-28 Chaoqi Liang , Guanglei Yang , Lifeng Qiao , Zitong Huang , Hongliang Yan , Yunchao Wei , Wangmeng Zuo

Semantic segmentation with limited annotations, such as weakly supervised semantic segmentation (WSSS) and semi-supervised semantic segmentation (SSSS), is a challenging task that has attracted much attention recently. Most leading WSSS…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Junwen Pan , Pengfei Zhu , Kaihua Zhang , Bing Cao , Yu Wang , Dingwen Zhang , Junwei Han , Qinghua Hu

Motivated by the attention mechanism of the human visual system and recent developments in the field of machine translation, we introduce our attention-based and recurrent sequence to sequence autoencoders for fully unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Shahin Amiriparian , Pawel Winokurow , Vincent Karas , Sandra Ottl , Maurice Gerczuk , Björn W. Schuller

In this work, we develop new self-learning techniques with an attention-based sequence-to-sequence (seq2seq) model for automatic speech recognition (ASR). For untranscribed speech data, the hypothesis from an ASR system must be used as a…

Computation and Language · Computer Science 2021-12-23 Kenichi Kumatani , Dimitrios Dimitriadis , Yashesh Gaur , Robert Gmyr , Sefik Emre Eskimez , Jinyu Li , Michael Zeng

This work proposes a novel approach to the deep hierarchical classification task, i.e., the problem of classifying data according to multiple labels organized in a rigid parent-child structure. It consists in a multi-output deep neural…

Artificial Intelligence · Computer Science 2024-10-07 Lorenzo Fiaschi , Marco Cococcioni

Modeling the structure of coherent texts is a key NLP problem. The task of coherently organizing a given set of sentences has been commonly used to build and evaluate models that understand such structure. We propose an end-to-end…

Computation and Language · Computer Science 2017-12-25 Lajanugen Logeswaran , Honglak Lee , Dragomir Radev

Existing deep convolutional neural networks (CNNs) have shown their great success on image classification. CNNs mainly consist of convolutional and pooling layers, both of which are performed on local image areas without considering the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-29 Zhen Zuo , Bing Shuai , Gang Wang , Xiao Liu , Xingxing Wang , Bing Wang

Understanding sleep and activity patterns plays a crucial role in physical and mental health. This study introduces a novel approach for sleep detection using weakly supervised learning for scenarios where reliable ground truth labels are…

Machine Learning · Computer Science 2024-07-09 Matthias Boeker , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Hugo L. Hammer

One of the main challenges in electroencephalogram (EEG) based brain-computer interface (BCI) systems is learning the subject/session invariant features to classify cognitive activities within an end-to-end discriminative setting. We…

Signal Processing · Electrical Eng. & Systems 2022-12-12 Andac Demir , Iya Khalil , Bulent Kiziltan

Learning both hierarchical and temporal representation has been among the long-standing challenges of recurrent neural networks. Multiscale recurrent neural networks have been considered as a promising approach to resolve this issue, yet…

Machine Learning · Computer Science 2017-03-10 Junyoung Chung , Sungjin Ahn , Yoshua Bengio

We present a new recurrent neural network topology to enhance state-of-the-art machine learning systems by incorporating a broader context. Our approach overcomes recent limitations with extended narratives through a multi-layered…

Computation and Language · Computer Science 2018-08-07 Patrick Huber , Jan Niehues , Alex Waibel

Heterogeneous Graph Neural Networks (HGNNs) are widely used for deep learning on heterogeneous graphs. Typical end-to-end HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs.…

Machine Learning · Computer Science 2025-11-17 Jun Hu , Shangheng Chen , Yufei He , Yuan Li , Bryan Hooi , Bingsheng He

Real-time classification of Electromyography signals is the most challenging part of controlling a prosthetic hand. Achieving a high classification accuracy of EMG signals in a short delay time is still challenging. Recurrent neural…

Signal Processing · Electrical Eng. & Systems 2021-09-14 Reza Bagherian Azhiri , Mohammad Esmaeili , Mehrdad Nourani

The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks. We introduce an architecture based entirely on convolutional neural networks. Compared to…

Computation and Language · Computer Science 2017-07-26 Jonas Gehring , Michael Auli , David Grangier , Denis Yarats , Yann N. Dauphin