English
Related papers

Related papers: Siamese Sleep Transformer For Robust Sleep Stage S…

200 papers

In recent years, Siamese network based trackers have significantly advanced the state-of-the-art in real-time tracking. Despite their success, Siamese trackers tend to suffer from high memory costs, which restrict their applicability to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Jianbing Shen , Yuanpei Liu , Xingping Dong , Xiankai Lu , Fahad Shahbaz Khan , Steven Hoi

We introduce SiamTST, a novel representation learning framework for multivariate time series. SiamTST integrates a Siamese network with attention, channel-independent patching, and normalization techniques to achieve superior performance.…

Machine Learning · Computer Science 2024-07-03 Simen Kristoffersen , Peter Skaar Nordby , Sara Malacarne , Massimiliano Ruocco , Pablo Ortiz

Semi-supervised semantic segmentation (SSS) is an important task that utilizes both labeled and unlabeled data to reduce expenses on labeling training examples. However, the effectiveness of SSS algorithms is limited by the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhibo Tain , Xiaolin Zhang , Peng Zhang , Kun Zhan

Recently, neural networks based purely on self-attention, such as the Vision Transformer (ViT), have been shown to outperform deep learning models constructed with convolutional neural networks (CNNs) on various vision tasks, thus extending…

Sound · Computer Science 2022-02-14 Yuan Gong , Cheng-I Jeff Lai , Yu-An Chung , James Glass

We used convolutional neural networks (CNNs) for automatic sleep stage scoring based on single-channel electroencephalography (EEG) to learn task-specific filters for classification without using prior domain knowledge. We used an openly…

Machine Learning · Statistics 2016-10-07 Orestis Tsinalis , Paul M. Matthews , Yike Guo , Stefanos Zafeiriou

Automated sleep stage classification typically employs a single population-agnostic model, disregarding established demographic variations in sleep architecture. Sleep patterns, however, differ substantially across gender, age, and…

Machine Learning · Computer Science 2026-05-05 S M Asif Hossain , Shruti Kshirsagar

Score Distillation Sampling (SDS) is a recent but already widely popular method that relies on an image diffusion model to control optimization problems using text prompts. In this paper, we conduct an in-depth analysis of the SDS loss…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Thiemo Alldieck , Nikos Kolotouros , Cristian Sminchisescu

Understanding semantic content from brain activity during sleep represents a major goal in neuroscience. While studies in rodents have shown spontaneous neural reactivation of memories during sleep, capturing the semantic content of human…

Machine Learning · Computer Science 2024-05-21 Hui Zheng , Zhong-Tao Chen , Hai-Teng Wang , Jian-Yang Zhou , Lin Zheng , Pei-Yang Lin , Yun-Zhe Liu

Semi-supervised learning (SSL) has become a crucial approach in deep learning as a way to address the challenge of limited labeled data. The success of deep neural networks heavily relies on the availability of large-scale high-quality…

Machine Learning · Computer Science 2023-09-13 Chien-Chih Wang , Shaoyuan Xu , Jinmiao Fu , Yang Liu , Bryan Wang

Humans exhibit remarkable proficiency in visual classification tasks, accurately recognizing and classifying new images with minimal examples. This ability is attributed to their capacity to focus on details and identify common features…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weihao Jiang , Shuoxi Zhang , Kun He

Autonomous driving has attracted much attention over the years but turns out to be harder than expected, probably due to the difficulty of labeled data collection for model training. Self-supervised learning (SSL), which leverages unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Kai Chen , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Zongyan Yao , Xilin Liu

As sleep disorders are becoming more prevalent there is an urgent need to classify sleep stages in a less disturbing way.In particular, sleep-stage classification using simple sensors, such as single-channel electroencephalography (EEG),…

Signal Processing · Electrical Eng. & Systems 2023-02-27 Iksoo Choi , Wonyong Sung

Sleep staging is critical to assess sleep quality and diagnose disorders. Despite advancements in artificial intelligence enabling automated sleep staging, significant challenges remain: (1) Simultaneously extracting prominent temporal and…

Neurons and Cognition · Quantitative Biology 2025-09-26 Jingying Ma , Qika Lin , Ziyu Jia , Mengling Feng

This paper introduces Smooth-Distill, a novel self-distillation framework designed to simultaneously perform human activity recognition (HAR) and sensor placement detection using wearable sensor data. The proposed approach utilizes a…

Machine Learning · Computer Science 2025-07-02 Hoang-Dieu Vu , Duc-Nghia Tran , Quang-Tu Pham , Hieu H. Pham , Nicolas Vuillerme , Duc-Tan Tran

Siamese-network-based self-supervised learning (SSL) suffers from slow convergence and instability in training. To alleviate this, we propose a framework to exploit intermediate self-supervisions in each stage of deep nets, called the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ryota Yoshihashi , Shuhei Nishimura , Dai Yonebayashi , Yuya Otsuka , Tomohiro Tanaka , Takashi Miyazaki

Deep neural networks achieve remarkable performances on a wide range of tasks with the aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor-exhaustive to obtain on realistic tasks. To mitigate the requirement…

Machine Learning · Computer Science 2022-11-10 Baixu Chen , Junguang Jiang , Ximei Wang , Pengfei Wan , Jianmin Wang , Mingsheng Long

Closed-loop sleep modulation is an emerging research paradigm to treat sleep disorders and enhance sleep benefits. However, two major barriers hinder the widespread application of this research paradigm. First, subjects often need to be…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Mingzhe Sun , Aaron Zhou , Naize Yang , Yaqian Xu , Yuhan Hou , Xilin Liu

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Computer Science 2025-02-17 Pascal Jutras-Dubé , Patrick Pynadath , Ruqi Zhang

Sleep is an essential component of human physiology, contributing significantly to overall health and quality of life. Accurate sleep staging and disorder detection are crucial for assessing sleep quality. Studies in the literature have…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Kianoosh Kazemi , Iman Azimi , Michelle Khine , Rami N. Khayat , Amir M. Rahmani , Pasi Liljeberg