English
Related papers

Related papers: Self-Supervised Ensemble Learning: A Universal Met…

200 papers

Recently, self-supervised learning (SSL) has achieved tremendous success in learning image representation. Despite the empirical success, most self-supervised learning methods are rather "inefficient" learners, typically taking hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shengbang Tong , Yubei Chen , Yi Ma , Yann Lecun

Self-supervised learning methods can be used to learn meaningful representations from unlabeled data that can be transferred to supervised downstream tasks to reduce the need for labeled data. In this paper, we propose a 3D self-supervised…

Machine Learning · Computer Science 2021-10-04 Yamen Ali , Aiham Taleb , Marina M. -C. Höhne , Christoph Lippert

Extreme Learning Machine is a powerful classification method very competitive existing classification methods. It is extremely fast at training. Nevertheless, it cannot perform face verification tasks properly because face verification…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Wasu Kudisthalert , Kitsuchart Pasupa , Aythami Morales , Julian Fierrez

The supervised learning paradigm is limited by the cost - and sometimes the impracticality - of data collection and labeling in multiple domains. Self-supervised learning, a paradigm which exploits the structure of unlabeled data to create…

Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. Zero-shot learning…

Machine Learning · Computer Science 2019-04-09 Meng Ye , Yuhong Guo

Machine learning is applied to investigate the phase transition of two-dimensional complex plasmas. The Langevin dynamics simulation is employed to prepare particle suspensions in various thermodynamic states. Based on the resulted particle…

Plasma Physics · Physics 2023-07-25 He Huang , Vladimir Nosenko , Han-Xiao Huang-Fu , Hubertus M. Thomas , Cheng-Ran Du

Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ye Zhu , Jie Yang , Si-Qi Liu , Ruimao Zhang

We present local ensembles, a method for detecting underspecification -- when many possible predictors are consistent with the training data and model class -- at test time in a pre-trained model. Our method uses local second-order…

Machine Learning · Computer Science 2021-12-09 David Madras , James Atwood , Alex D'Amour

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from…

Machine Learning · Computer Science 2019-07-24 Prashnna Kumar Gyawali , Zhiyuan Li , Sandesh Ghimire , Linwei Wang

Self-supervised representation learning, particularly through contrastive methods like TS2Vec, has advanced the analysis of time series data. However, these models often falter in forecasting tasks because their objective functions…

Machine Learning · Computer Science 2025-12-01 Ganeshan Niroshan , Uthayasanker Thayasivam

Deep learning has led to remarkable advances in computer vision. Even so, today's best models are brittle when presented with variations that differ even slightly from those seen during training. Minor shifts in the pose, color, or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Mark Ibrahim , Diane Bouchacourt , Ari Morcos

Automated segmentation of multiple sclerosis (MS) lesions using multicontrast magnetic resonance (MR) images improves efficiency and reproducibility compared to manual delineation, with deep learning (DL) methods achieving state-of-the-art…

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting…

Signal Processing · Electrical Eng. & Systems 2022-10-14 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Transfer Learning is an area of statistics and machine learning research that seeks answers to the following question: how do we build successful learning algorithms when the data available for training our model is qualitatively different…

Machine Learning · Computer Science 2022-11-09 Brandon Tse Wei Chow

We present the checkpoint ensembles method that can learn ensemble models on a single training process. Although checkpoint ensembles can be applied to any parametric iterative learning technique, here we focus on neural networks. Neural…

Machine Learning · Computer Science 2017-10-11 Hugh Chen , Scott Lundberg , Su-In Lee

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

A multi-modal machine learning system uses multiple unique data sources and types to improve its performance. This article proposes a system that combines results from several types of models, all of which are trained on different data…

Machine Learning · Computer Science 2024-02-05 Aaron Mullen , Samuel E. Armstrong , Jasmine Perdeh , Bjorn Bauer , Jeffrey Talbert , V. K. Cody Bumgardner

This work presents a novel approach for selecting the optimal ensemble-based classification method and features with a primarly focus on achieving generalization, based on the state-of-the-art, to provide diagnostic support for Sickle Cell…

Machine Learning · Computer Science 2026-01-21 Nataša Petrović , Gabriel Moyà-Alcover , Antoni Jaume-i-Capó , Jose Maria Buades Rubio

In this work, a data-driven modeling framework of switched dynamical systems under time-dependent switching is proposed. The learning technique utilized to model system dynamics is Extreme Learning Machine (ELM). First, a method is…

Systems and Control · Electrical Eng. & Systems 2021-01-27 Weiming Xiang

The performance of existing point cloud-based 3D object detection methods heavily relies on large-scale high-quality 3D annotations. However, such annotations are often tedious and expensive to collect. Semi-supervised learning is a good…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Na Zhao , Tat-Seng Chua , Gim Hee Lee