English
Related papers

Related papers: PSDNorm: Test-Time Temporal Normalization for Deep…

200 papers

Modern meta-learning approaches for image classification rely on increasingly deep networks to achieve state-of-the-art performance, making batch normalization an essential component of meta-learning pipelines. However, the hierarchical…

Machine Learning · Statistics 2020-07-14 John Bronskill , Jonathan Gordon , James Requeima , Sebastian Nowozin , Richard E. Turner

Although supervised deep normal estimators have recently shown impressive results on synthetic benchmarks, their performance deteriorates significantly in real-world scenarios due to the domain gap between synthetic and real data. Building…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jie Zhang , Minghui Nie , Changqing Zou , Jian Liu , Ligang Liu , Junjie Cao

Sleep staging is a clinically important task for diagnosing various sleep disorders, but remains challenging to deploy at scale because it because it is both labor-intensive and time-consuming. Supervised deep learning-based approaches can…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Sayeri Lala , Hanlin Goh , Christopher Sandino

In many machine learning applications on signals and biomedical data, especially electroencephalogram (EEG), one major challenge is the variability of the data across subjects, sessions, and hardware devices. In this work, we propose a new…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Théo Gnassounou , Rémi Flamary , Alexandre Gramfort

Neural networks are notorious for being overconfident predictors, posing a significant challenge to their safe deployment in real-world applications. While feature normalization has garnered considerable attention within the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Sudarshan Regmi , Bibek Panthi , Sakar Dotel , Prashnna K. Gyawali , Danail Stoyanov , Binod Bhattarai

Deep learning based image reconstruction methods outperform traditional methods. However, neural networks suffer from a performance drop when applied to images from a different distribution than the training images. For example, a model…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Mohammad Zalbagi Darestani , Jiayu Liu , Reinhard Heckel

Many sleep studies suffer from the problem of insufficient data to fully utilize deep neural networks as different labs use different recordings set ups, leading to the need of training automated algorithms on rather small databases,…

Machine Learning · Computer Science 2019-06-19 Huy Phan , Oliver Y. Chén , Philipp Koch , Alfred Mertins , Maarten De Vos

Deep neural networks often suffer the data distribution shift between training and testing, and the batch statistics are observed to reflect the shift. In this paper, targeting of alleviating distribution shift in test time, we revisit the…

Machine Learning · Computer Science 2022-05-23 Tao Yang , Shenglong Zhou , Yuwang Wang , Yan Lu , Nanning Zheng

In the past few years, convolutional neural networks (CNNs), particularly U-Net, have been the prevailing technique in the medical image processing era. Specifically, the seminal U-Net, as well as its alternatives, have successfully managed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Reza Azad , Mohammad T. AL-Antary , Moein Heidari , Dorit Merhof

Pre-training large neural networks at scale imposes heavy memory demands on accelerators and often requires costly communication. We introduce Subnetwork Data Parallelism (SDP), a distributed training framework that partitions a model into…

Machine Learning · Computer Science 2025-10-06 Vaibhav Singh , Zafir Khalid , Edouard Oyallon , Eugene Belilovsky

Deep neural networks have shown promising results for various clinical prediction tasks. However, training deep networks such as those based on Recurrent Neural Networks (RNNs) requires large labeled data, significant hyper-parameter tuning…

Machine Learning · Computer Science 2021-03-05 Priyanka Gupta , Pankaj Malhotra , Jyoti Narwariya , Lovekesh Vig , Gautam Shroff

Purpose: In sleep medicine, assessing the evolution of a subject's sleep often involves the costly manual scoring of electroencephalographic (EEG) signals. In recent years, a number of Deep Learning approaches have been proposed to automate…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Mathieu Seraphim , Alexis Lechervy , Florian Yger , Luc Brun , Olivier Etard

Automating sleep staging is vital to scale up sleep assessment and diagnosis to serve millions experiencing sleep deprivation and disorders and enable longitudinal sleep monitoring in home environments. Learning from raw polysomnography…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Huy Phan , Oliver Y. Chén , Minh C. Tran , Philipp Koch , Alfred Mertins , Maarten De Vos

This paper presents a deep learning framework for medical video segmentation. Convolution neural network (CNN) and transformer-based methods have achieved great milestones in medical image segmentation tasks due to their incredible semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Chengxi Zeng , Xinyu Yang , David Smithard , Majid Mirmehdi , Alberto M Gambaruto , Tilo Burghardt

Traditional normalization techniques (e.g., Batch Normalization and Instance Normalization) generally and simplistically assume that training and test data follow the same distribution. As distribution shifts are inevitable in real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhiqiang Tang , Yunhe Gao , Yi Zhu , Zhi Zhang , Mu Li , Dimitris Metaxas

Resting-state functional magnetic resonance imaging (rs-fMRI) is a noninvasive technique pivotal for understanding human neural mechanisms of intricate cognitive processes. Most rs-fMRI studies compute a single static functional…

Neurons and Cognition · Quantitative Biology 2025-02-25 Bishal Thapaliya , Robyn Miller , Jiayu Chen , Yu-Ping Wang , Esra Akbas , Ram Sapkota , Bhaskar Ray , Pranav Suresh , Santosh Ghimire , Vince Calhoun , Jingyu Liu

Deep learning has revolutionized many industries by enabling models to automatically learn complex patterns from raw data, reducing dependence on manual feature engineering. However, deep learning algorithms are sensitive to input data, and…

Machine Learning · Computer Science 2025-07-21 Mert Sehri , Zehui Hua , Francisco de Assis Boldt , Patrick Dumond

Deep neural networks often exhibit poor performance on data that is unlikely under the train-time data distribution, for instance data affected by corruptions. Previous works demonstrate that test-time adaptation to data shift, for instance…

The application of loss reweighting in modern deep learning presents a nuanced picture. While it fails to alter the terminal learning phase in overparameterized deep neural networks (DNNs) trained on high-dimensional datasets, empirical…

Machine Learning · Computer Science 2026-01-21 Yize Zhao , Christos Thrampoulidis

Sleep disorder diagnosis relies on the analysis of polysomnography (PSG) records. As a preliminary step of this examination, sleep stages are systematically determined. In practice, sleep stage classification relies on the visual inspection…

Machine Learning · Statistics 2021-06-21 Antoine Guillot , Valentin Thorey