English
Related papers

Related papers: Wavelet-Driven Masked Multiscale Reconstruction fo…

200 papers

Magnetic resonance imaging (MRI) is an essential diagnostic tool that suffers from prolonged scan times. Reconstruction methods can alleviate this limitation by recovering clinically usable images from accelerated acquisitions. In…

Image and Video Processing · Electrical Eng. & Systems 2023-01-09 Salman UH Dar , Şaban Öztürk , Muzaffer Özbey , Tolga Çukur

Photoplethysmography (PPG) sensors allow for non-invasive and comfortable heart-rate (HR) monitoring, suitable for compact wrist-worn devices. Unfortunately, Motion Artifacts (MAs) severely impact the monitoring accuracy, causing high…

Photoplethysmography (PPG) signals, typically acquired from wearable devices, hold significant potential for continuous fitness-health monitoring. In particular, heart conditions that manifest in rare and subtle deviating heart patterns may…

Machine Learning · Computer Science 2023-07-14 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Foundation models hold promise for transforming AI in healthcare by providing modular components that are easily adaptable to downstream healthcare tasks, making AI development more scalable and cost-effective. Structured EHR foundation…

Recent general-purpose audio representations show state-of-the-art performance on various audio tasks. These representations are pre-trained by self-supervised learning methods that create training signals from the input. For example,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-09 Daisuke Niizumi , Daiki Takeuchi , Yasunori Ohishi , Noboru Harada , Kunio Kashino

Wearable sensors have become ubiquitous thanks to a variety of health tracking features. The resulting continuous and longitudinal measurements from everyday life generate large volumes of data; however, making sense of these observations…

Wearable medical sensors (WMSs) are revolutionizing smart healthcare by enabling continuous, real-time monitoring of user physiological signals, especially in the field of consumer healthcare. The integration of WMSs and modern machine…

Machine Learning · Computer Science 2024-10-22 Chia-Hao Li , Niraj K. Jha

Polysomnography (PSG) is an indispensable diagnostic tool in sleep medicine, essential for identifying various sleep disorders. By capturing physiological signals, including EEG, EOG, EMG, and cardiorespiratory metrics, PSG presents a…

Machine Learning · Computer Science 2023-11-15 Young-Seok Kweon , Gi-Hwan Shin , Heon-Gyu Kwak , Ha-Na Jo , Seong-Whan Lee

We present Masked Frequency Modeling (MFM), a unified frequency-domain-based approach for self-supervised pre-training of visual models. Instead of randomly inserting mask tokens to the input embeddings in the spatial domain, in this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Jiahao Xie , Wei Li , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

Foundation models pre-trained through masked reconstruction on large-scale EEG data have emerged as a promising paradigm for learning generalizable neural representations across diverse brain-computer interface applications. However, a…

Artificial Intelligence · Computer Science 2026-05-19 Yang Shao , Peiliang Gong , Qun Dai , Daoqiang Zhang

Inspired by the recent success of sequence modeling in RL and the use of masked language model for pre-training, we propose a masked model for pre-training in RL, RePreM (Representation Pre-training with Masked Model), which trains the…

Machine Learning · Computer Science 2023-03-06 Yuanying Cai , Chuheng Zhang , Wei Shen , Xuyun Zhang , Wenjie Ruan , Longbo Huang

Foundation models learn highly transferable representations through large-scale pretraining on diverse data. An increasing body of research indicates that these representations exhibit a remarkable degree of similarity across architectures…

Artificial Intelligence · Computer Science 2025-10-08 Jianglin Lu , Hailing Wang , Yi Xu , Yizhou Wang , Kuo Yang , Yun Fu

To date, research on sensor-equipped mobile devices has primarily focused on the purely supervised task of human activity recognition (walking, running, etc), demonstrating limited success in inferring high-level health outcomes from…

Machine Learning · Computer Science 2020-11-10 Dimitris Spathis , Ignacio Perez-Pozuelo , Soren Brage , Nicholas J. Wareham , Cecilia Mascolo

We present a three-dimensional foundation model for polycrystalline materials based on a masked autoencoder trained via large-scale self-supervised learning. The model is pretrained on $100{,}000$ voxelized synthetic face-centered cubic…

Computational Engineering, Finance, and Science · Computer Science 2025-12-24 Ting-Ju Wei , Chuin-Shan Chen

Multimodal pre-training remains constrained by the descriptive bias of image-caption pairs, leading models to favor surface linguistic cues over grounded visual understanding. We introduce MMRPT, a masked multimodal reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuhui Zheng , Kang An , Ziliang Wang , Yuhang Wang , Faqiang Qian , Yichao Wu

Wireless foundation models (WFMs) have recently demonstrated promising capabilities, jointly performing multiple wireless functions and adapting effectively to new environments. However, while current WFMs process only one modality,…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Ahmed Aboulfotouh , Hatem Abou-Zeid

Light sheet fluorescence microscopy (LSM) enables high-resolution, three-dimensional (3D) imaging of biological specimens, providing rich volumetric data for studying cellular organization, pathology, and vascular networks. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Adina Scheinfeld , Haotan Zhang , Shang Mu , Rudolf L. M. van Herten , Lucas Stoffl , Ali Erturk , Zhuhao Wu , Johannes C. Paetzold

Pre-training video transformers generally requires a large amount of data, presenting significant challenges in terms of data collection costs and concerns related to privacy, licensing, and inherent biases. Synthesizing data is one of the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yuchi Ishikawa , Masayoshi Kondo , Yoshimitsu Aoki

Smart wearables enable continuous tracking of established biomarkers such as heart rate, heart rate variability, and blood oxygen saturation via photoplethysmography (PPG). Beyond these metrics, PPG waveforms contain richer physiological…

Photoplethysmogram (PPG) and electrocardiogram (ECG) are commonly recorded in intesive care unit (ICU) and operating room (OR). However, the high incidence of poor, incomplete, and inconsistent signal quality, can lead to false alarms or…

Machine Learning · Computer Science 2025-09-16 Zongheng Guo , Tao Chen , Manuela Ferrario