English
Related papers

Related papers: Frequency-Aware Masked Autoencoders for Human Acti…

200 papers

With the exponential growth of multimedia data, leveraging multimodal sensors presents a promising approach for improving accuracy in human activity recognition. Nevertheless, accurately identifying these activities using both video data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Rex Liu , Xin Liu

Wearable accelerometers enable large-scale health monitoring, yet learning robust human-activity representations has been constrained by scarce labeled data. While self-supervised learning offers a remedy, existing methods treat sensor…

Machine Learning · Computer Science 2026-05-28 Prithviraj Tarale , Kiet Chu , Abhishek Varghese , Kai-Chun Liu , Maxwell A. Xu , Mohit Iyyer , Sunghoon I. Lee

Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder blocks to provide sustainable supervision signals and…

Information Retrieval · Computer Science 2024-04-23 Guangyuan Ma , Xing Wu , Zijia Lin , Songlin Hu

In this paper, we propose a simple yet powerful improvement over the recent Self-Supervised Audio Spectrogram Transformer (SSAST) model for speech and audio classification. Specifically, we leverage the insight that the SSAST uses a very…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-01 Alan Baade , Puyuan Peng , David Harwath

Pre-training strategies based on self-supervised learning (SSL) have proven to be effective pretext tasks for many downstream tasks in computer vision. Due to the significant disparity between medical and natural images, the application of…

Human activity recognition (HAR) with deep learning models relies on large amounts of labeled data, often challenging to obtain due to associated cost, time, and labor. Self-supervised learning (SSL) has emerged as an effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Dominique Nshimyimana , Vitor Fortes Rey , Sungho Suh , Bo Zhou , Paul Lukowicz

Use of accelerometers is now widespread within animal biotelemetry as they provide a means of measuring an animal's activity in a meaningful and quantitative way where direct observation is not possible. In sequential acceleration data…

We introduce SensorLLM, a two-stage framework that enables Large Language Models (LLMs) to perform human activity recognition (HAR) from sensor time-series data. Despite their strong reasoning and generalization capabilities, LLMs remain…

Computation and Language · Computer Science 2025-08-26 Zechen Li , Shohreh Deldari , Linyao Chen , Hao Xue , Flora D. Salim

Masked Autoencoding (MAE) has emerged as an effective approach for pre-training representations across multiple domains. In contrast to discrete tokens in natural languages, the input for image MAE is continuous and subject to additional…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Ronghang Hu , Shoubhik Debnath , Saining Xie , Xinlei Chen

Strong gravitational lensing can reveal the influence of dark-matter substructure in galaxies, but analyzing these effects from noisy, low-resolution images poses a significant challenge. In this work, we propose a masked autoencoder (MAE)…

Deep learning-based human activity recognition (HAR) methods have shown great promise in the applications of smart healthcare systems and wireless body sensor network (BSN). Despite their demonstrated performance in laboratory settings, the…

Human-Computer Interaction · Computer Science 2023-03-28 Baichun Wei , Chunzhi Yi , Qi Zhang , Haiqi Zhu , Jianfei Zhu , Feng Jiang

The use of accurate and reliable open-source human activity recognition (HAR) models on passively collected wrist-accelerometer data is essential in large-scale epidemiological studies that investigate the association between physical…

Machine Learning · Computer Science 2026-05-01 Aidan Acquah , Shing Chan , Aiden Doherty

Accurate imputation of missing laboratory values in electronic health records (EHRs) is critical to enable robust clinical predictions and reduce biases in AI systems in healthcare. Existing methods, such as XGBoost, softimpute, GAIN,…

Machine Learning · Computer Science 2025-06-27 David Restrepo , Chenwei Wu , Yueran Jia , Jaden K. Sun , Jack Gallifant , Catherine G. Bielick , Yugang Jia , Leo A. Celi

Automatic recognition of human activities from time-series sensor data (referred to as HAR) is a growing area of research in ubiquitous computing. Most recent research in the field adopts supervised deep learning paradigms to automate…

Machine Learning · Computer Science 2018-11-21 Alireza Abedin Varamin , Ehsan Abbasnejad , Qinfeng Shi , Damith Ranasinghe , Hamid Rezatofighi

Vision-based human activity recognition (HAR) has made substantial progress in recognizing predefined gestures but lacks adaptability for emerging activities. This paper introduces a paradigm shift by harnessing generative modeling and…

Human-Computer Interaction · Computer Science 2023-12-13 Nikhil Kashyap , Manas Satish Bedmutha , Prerit Chaudhary , Brian Wood , Wanda Pratt , Janice Sabin , Andrea Hartzler , Nadir Weibel

Human Activity Recognition (HAR) using Inertial Measurement Unit (IMU) sensors is critical for applications in healthcare, safety, and industrial production. However, variations in activity patterns, device types, and sensor placements…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Hua Yan , Heng Tan , Yi Ding , Pengfei Zhou , Vinod Namboodiri , Yu Yang

The emergence of self-supervised learning in the field of wearables-based human activity recognition (HAR) has opened up opportunities to tackle the most pressing challenges in the field, namely to exploit unlabeled data to derive reliable…

Signal Processing · Electrical Eng. & Systems 2022-11-22 Harish Haresamudram , Irfan Essa , Thomas Plötz

Masked Autoencoder (MAE) has recently been shown to be effective in pre-training Vision Transformers (ViT) for natural image analysis. By reconstructing full images from partially masked inputs, a ViT encoder aggregates contextual…

Image and Video Processing · Electrical Eng. & Systems 2023-04-24 Lei Zhou , Huidong Liu , Joseph Bae , Junjun He , Dimitris Samaras , Prateek Prasanna

The Masked Autoencoder (MAE) has recently demonstrated effectiveness in pre-training Vision Transformers (ViT) for analyzing natural images. By reconstructing complete images from partially masked inputs, the ViT encoder gathers contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Measures of Activity of Daily Living (ADL) are an important indicator of overall health but difficult to measure in-clinic. Automated and accurate human activity recognition (HAR) using wrist-worn accelerometers enables practical and cost…

Machine Learning · Computer Science 2021-12-24 Niranjan Sridhar , Lance Myers