English
Related papers

Related papers: Evaluation of self-supervised pre-training for aut…

200 papers

Recent success of large-scale pre-trained language models crucially hinge on fine-tuning them on large amounts of labeled data for the downstream task, that are typically expensive to acquire. In this work, we study self-training as one of…

Computation and Language · Computer Science 2020-06-30 Subhabrata Mukherjee , Ahmed Hassan Awadallah

Autism Spectrum Disorder (ASD) is characterized by challenges with social interaction and communication and by restricted or repetitive patterns of thought and behavior, with significant variability in presentation. Approximately a quarter…

Artificial Intelligence · Computer Science 2026-05-21 Yadhu Kartha , Conor Anderson , Jenny Foster , Theresa Hamlin , Johanna Lantz , Ryan Lay , Juergen Hahn , Gari D. Clifford , Hyeokhyen Kwon

The emerging field of action prediction plays a vital role in various computer vision applications such as autonomous driving, activity analysis and human-computer interaction. Despite significant advancements, accurately predicting future…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Izzeddin Teeti , Rongali Sai Bhargav , Vivek Singh , Andrew Bradley , Biplab Banerjee , Fabio Cuzzolin

In this paper, we propose the use of self-supervised pretraining on a large unlabelled data set to improve the performance of a personalized voice activity detection (VAD) model in adverse conditions. We pretrain a long short-term memory…

Sound · Computer Science 2024-01-24 Holger Severin Bovbjerg , Jesper Jensen , Jan Østergaard , Zheng-Hua Tan

We consider learning to optimize a classification metric defined by a black-box function of the confusion matrix. Such black-box learning settings are ubiquitous, for example, when the learner only has query access to the metric of…

Machine Learning · Computer Science 2021-06-25 Gaurush Hiranandani , Jatin Mathur , Harikrishna Narasimhan , Mahdi Milani Fard , Oluwasanmi Koyejo

Conventional classifiers are trained and evaluated using balanced data sets in which all classes are equally present. Classifiers are now trained on large data sets such as ImageNet, and are now able to classify hundreds (if not thousands)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Natnael Daba , Bruce McIntosh , Abhijit Mahalanobis

This paper presents a semi-supervised learning framework that is new in being designed for automatic modulation classification (AMC). By carefully utilizing unlabeled signal data with a self-supervised contrastive-learning pre-training…

Machine Learning · Computer Science 2022-03-31 Dongxin Liu , Peng Wang , Tianshi Wang , Tarek Abdelzaher

Traffic videos inherently differ from generic videos in their stationary camera setup, thus providing a strong motion prior where objects often move in a specific direction over a short time interval. Existing works predominantly employ…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Lihao Liu , Yanqi Cheng , Dongdong Chen , Jing He , Pietro Liò , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

User modeling is critical for many personalized web services. Many existing methods model users based on their behaviors and the labeled data of target tasks. However, these methods cannot exploit useful information in unlabeled user…

Information Retrieval · Computer Science 2020-10-06 Chuhan Wu , Fangzhao Wu , Tao Qi , Jianxun Lian , Yongfeng Huang , Xing Xie

Automatic and precise fitness activity recognition can be beneficial in aspects from promoting a healthy lifestyle to personalized preventative healthcare. While IMUs are currently the prominent fitness tracking modality, through iMove, we…

Signal Processing · Electrical Eng. & Systems 2024-06-04 Mengxi Liu , Vitor Fortes Rey , Yu Zhang , Lala Shakti Swarup Ray , Bo Zhou , Paul Lukowicz

Most existing sensor-based monitoring frameworks presume that a large available labeled dataset is processed to train accurate detection models. However, in settings where personalization is necessary at deployment time to fine-tune the…

Machine Learning · Computer Science 2023-05-02 Ali Tazarv , Sina Labbaf , Amir Rahmani , Nikil Dutt , Marco Levorato

Human movements are characterized by highly non-linear and multi-dimensional interactions within the motor system. Recently, an increasing emphasis on machine-learning applications has led to a significant contribution to the field of gait…

Machine Learning · Computer Science 2020-07-31 Johannes Burdack , Fabian Horst , Sven Giesselbach , Ibrahim Hassan , Sabrina Daffner , Wolfgang I. Schöllhorn

Temporal Activity Detection aims to predict activity classes per frame, in contrast to video-level predictions in Activity Classification (i.e., Activity Recognition). Due to the expensive frame-level annotations required for detection, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Kumara Kahatapitiya , Zhou Ren , Haoxiang Li , Zhenyu Wu , Michael S. Ryoo , Gang Hua

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Predictive uncertainty-a model's self awareness regarding its accuracy on an input-is key for both building robust models via training interventions and for test-time applications such as selective classification. We propose a novel…

Machine Learning · Computer Science 2024-01-04 Nishant Jain , Karthikeyan Shanmugam , Pradeep Shenoy

This paper revisits visual saliency prediction by evaluating the recent advancements in this field such as crowd-sourced mouse tracking-based databases and contextual annotations. We pursue a critical and quantitative approach towards some…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Hamed R. Tavakoli , Fawad Ahmed , Ali Borji , Jorma Laaksonen

Neonatal seizures are a commonly encountered neurological condition. They are the first clinical signs of a serious neurological disorder. Thus, rapid recognition and treatment are necessary to prevent serious fatalities. The use of…

Signal Processing · Electrical Eng. & Systems 2021-12-01 Vishal Nagarajan , Ashwini Muralidharan , Deekshitha Sriraman , Pravin Kumar S

Autonomous driving consists of a multitude of interacting modules, where each module must contend with errors from the others. Typically, the motion prediction module depends upon a robust tracking system to capture each agent's past…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Ameni Trabelsi , Ross J. Beveridge , Nathaniel Blanchard

Human activity recognition (HAR) with deep learning models relies on large amounts of labeled data, often challenging to obtain due to associated cost, time, and labor. Self-supervised learning (SSL) has emerged as an effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Dominique Nshimyimana , Vitor Fortes Rey , Sungho Suh , Bo Zhou , Paul Lukowicz

Tactile signals collected by wearable electronics are essential in modeling and understanding human behavior. One of the main applications of tactile signals is action classification, especially in healthcare and robotics. However, existing…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Jimmy Lin , Junkai Li , Jiasi Gao , Weizhi Ma , Yang Liu