English
Related papers

Related papers: Siamese Sleep Transformer For Robust Sleep Stage S…

200 papers

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Semi-supervised learning (SSL) has played an important role in leveraging unlabeled data when labeled data is limited. One of the most successful SSL approaches is based on consistency regularization, which encourages the model to produce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Trung Q. Tran , Mingu Kang , Daeyoung Kim

The growing demands on GPU memory posed by the increasing number of neural network parameters call for training approaches that are more memory-efficient. Previous memory reduction training techniques, such as Low-Rank Adaptation (LoRA) and…

Machine Learning · Computer Science 2025-08-14 Jialin Zhao , Yingtao Zhang , Xinghang Li , Huaping Liu , Carlo Vittorio Cannistraci

Self-supervised learning has been widely applied to train high-quality vision transformers. Unleashing their excellent performance on memory and compute constraint devices is therefore an important research topic. However, how to distill…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Kai Wang , Fei Yang , Joost van de Weijer

Semi-supervised regression (SSR), which aims to predict continuous scores for samples while reducing the reliance on large-scale labeled data, has recently attracted considerable attention across various applications, including computer…

Machine Learning · Computer Science 2026-05-28 Ye Su , Hezhe Qiao , Wei Huang , Lin Chen

This paper presents a novel approach that leverages Transformer-based multivariate time series model and Machine Learning Ensembles to predict the quality of human sleep, emotional states, and stress levels. A formula to calculate the…

Machine Learning · Computer Science 2024-10-16 Jinjae Kim , Minjeong Ma , Eunjee Choi , Keunhee Cho , Chanwoo Lee

Offline Siamese networks have achieved very promising tracking performance, especially in accuracy and efficiency. However, they often fail to track an object in complex scenes due to the incapacity in online update. Traditional updaters…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Xinglong Sun , Guangliang Han , Lihong Guo , Tingfa Xu , Jianan Li , Peixun Liu

Transfer learning, a technique commonly used in generative artificial intelligence, allows neural network models to bring prior knowledge to bear when learning a new task. This study demonstrates that transfer learning significantly…

Quantitative Methods · Quantitative Biology 2025-06-03 William G Coon , Diego Luna , Akshita Panagrahi , Matthew Reid , Mattson Ogg

For deep learning-based speech enhancement (SE) systems, the training-test acoustic mismatch can cause notable performance degradation. To address the mismatch issue, numerous noise adaptation strategies have been derived. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Chi-Chang Lee , Cheng-Hung Hu , Yu-Chen Lin , Chu-Song Chen , Hsin-Min Wang , Yu Tsao

Automatic sleep stage scoring is crucial for the diagnosis and treatment of sleep disorders. Although deep learning models have advanced the field, many existing models are computationally demanding and designed for single-channel…

Machine Learning · Computer Science 2026-03-02 Zhaowen Wang , Dongdong Zhou , Qi Xu , Fengyu Cong , Mohammad Al-Sa'd , Jenni Raitoharju

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Semi-supervised learning provides a solution to reduce the dependency of machine learning on labeled data. As one of the efficient semi-supervised techniques, self-training (ST) has received increasing attention. Several advancements have…

Machine Learning · Computer Science 2024-04-22 Jifeng Guo , Zhulin Liu , Tong Zhang , C. L. Philip Chen

Studies on semi-supervised medical image segmentation (SSMIS) have seen fast progress recently. Due to the limited labelled data, SSMIS methods mainly focus on effectively leveraging unlabeled data to enhance the segmentation performance.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zhen Zhao , Ye Liu , Meng Zhao , Di Yin , Yixuan Yuan , Luping Zhou

We propose a method of aligning a source image to a target image, where the transform is specified by a dense vector field. The two images are encoded as feature hierarchies by siamese convolutional nets. Then a hierarchy of aligner modules…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Eric Mitchell , Stefan Keselj , Sergiy Popovych , Davit Buniatyan , H. Sebastian Seung

Manual sleep staging from polysomnography (PSG) is labor-intensive and prone to inter-scorer variability. While recent deep learning models have advanced automated staging, most rely solely on raw PSG signals and neglect contextual cues…

Machine Learning · Computer Science 2025-11-13 Woosuk Chung , Seokwoo Hong , Wonhyeok Lee , Sangyoon Bae

An electroencephalogram (EEG) signal is currently accepted as a standard for automatic sleep staging. Lately, Near-human accuracy in automated sleep staging has been achievable by Deep Learning (DL) based approaches, enabling multi-fold…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Vaibhav Joshi , Sricharan V , Preejith SP , Mohanasankar Sivaprakasam

Score-based distillation methods (e.g., variational score distillation) train one-step diffusion models by first pre-training a teacher score model and then distilling it into a one-step student model. However, the gradient estimator in the…

In biomedical studies, it is often desirable to characterize the interactive mode of multiple disease outcomes beyond their marginal risk. Ising model is one of the most popular choices serving for this purpose. Nevertheless, learning…

Methodology · Statistics 2023-11-28 Daiqing Wu , Molei Liu

Recently, the attention mechanism such as squeeze-and-excitation module (SE) and convolutional block attention module (CBAM) has achieved great success in deep learning-based speaker verification system. This paper introduces an alternative…

Sound · Computer Science 2021-10-14 Xiaoyi Qin , Na Li , Chao Weng , Dan Su , Ming Li

Siamese trackers based on 3D region proposal network (RPN) have shown remarkable success with deep Hough voting. However, using a single seed point feature as the cue for voting fails to produce high-quality 3D proposals. Additionally, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jiahao Nie , Zhiwei He , Yuxiang Yang , Xudong Lv , Mingyu Gao , Jing Zhang