English
Related papers

Related papers: Mixtraining: A Better Trade-Off Between Compute an…

200 papers

The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to…

Machine Learning · Computer Science 2025-07-01 Durgesh Singh , Ahcene Boubekki , Robert Jenssen , Michael C. Kampffmeyer

Group conversations over videoconferencing are a complex social behavior. However, the subjective moments of negative experience, where the conversation loses fluidity or enjoyment remain understudied. These moments are infrequent in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-20 Andrew Chang , Chenkai Hu , Ji Qi , Zhuojian Wei , Kexin Zhang , Viswadruth Akkaraju , David Poeppel , Dustin Freeman

Federated Learning allows the training of machine learning models by using the computation and private data resources of many distributed clients. Most existing results on Federated Learning (FL) assume the clients have ground-truth labels.…

Machine Learning · Computer Science 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

Semi-Supervised Learning (SSL) has shown its strong ability in utilizing unlabeled data when labeled data is scarce. However, most SSL algorithms work under the assumption that the class distributions are balanced in both training and test…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Ju He , Adam Kortylewski , Shaokang Yang , Shuai Liu , Cheng Yang , Changhu Wang , Alan Yuille

Efficient machine learning (ML) has become increasingly important as models grow larger and data volumes expand. In this work, we address the trade-off between generalization in multi-task learning (MTL) and precision in single-task…

Machine Learning · Computer Science 2025-05-02 Dong Liu , Yanxuan Yu

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Recently proposed consistency-based Semi-Supervised Learning (SSL) methods such as the $\Pi$-model, temporal ensembling, the mean teacher, or the virtual adversarial training, have advanced the state of the art in several SSL tasks. These…

Machine Learning · Statistics 2021-01-19 Atin Ghosh , Alexandre H. Thiery

Machine learning has great potential for efficient reconstruction and prediction of flow fields. However, existing datasets may have highly diversified labels for different flow scenarios, which are not applicable for training a model. To…

Fluid Dynamics · Physics 2023-11-28 Bonan Xu , Yuanye Zhou , Xin Bian

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

Self-supervised learning (SSL) has demonstrated significant potential in pre-training robust models with limited labeled data, making it particularly valuable for remote sensing (RS) tasks. A common assumption is that pre-training on…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Saad Lahrichi , Zion Sheng , Shufan Xia , Kyle Bradbury , Jordan Malof

In the domain of semi-supervised learning (SSL), the conventional approach involves training a learner with a limited amount of labeled data alongside a substantial volume of unlabeled data, both drawn from the same underlying distribution.…

Machine Learning · Computer Science 2023-08-29 Guy Hacohen , Daphna Weinshall

This work investigates the unexplored usability of self-supervised representation learning in the direction of functional knowledge transfer. In this work, functional knowledge transfer is achieved by joint optimization of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Prakash Chandra Chhipa , Muskaan Chopra , Gopal Mengi , Varun Gupta , Richa Upadhyay , Meenakshi Subhash Chippa , Kanjar De , Rajkumar Saini , Seiichi Uchida , Marcus Liwicki

Long-Tailed Semi-Supervised Learning (LTSSL) aims to learn from class-imbalanced data where only a few samples are annotated. Existing solutions typically require substantial cost to solve complex optimization problems, or class-balanced…

Machine Learning · Computer Science 2022-05-27 Tong Wei , Qian-Yu Liu , Jiang-Xin Shi , Wei-Wei Tu , Lan-Zhe Guo

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

Spiking Neural Networks (SNNs) have gained popularity due to their high energy efficiency. Prior works have proposed various methods for training SNNs, including backpropagation-based methods. Training SNNs is computationally expensive…

Signal Processing · Electrical Eng. & Systems 2024-11-18 Sai Sanjeet , Bibhu Datta Sahoo , Keshab K. Parhi

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Conventional text-to-SQL studies are limited to a single task with a fixed-size training and test set. When confronted with a stream of tasks common in real-world applications, existing methods struggle with the problems of insufficient…

Computation and Language · Computer Science 2022-11-22 Yongrui Chen , Xinnan Guo , Tongtong Wu , Guilin Qi , Yang Li , Yang Dong

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

Signal Processing · Electrical Eng. & Systems 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to…

Federated learning (FL) and split learning (SL) are two popular distributed machine learning approaches. Both follow a model-to-data scenario; clients train and test machine learning models without sharing raw data. SL provides better model…

Machine Learning · Computer Science 2022-02-18 Chandra Thapa , M. A. P. Chamikara , Seyit Camtepe , Lichao Sun