English
Related papers

Related papers: Choice of training label matters: how to best use …

200 papers

Multi-label learning is a rapidly growing research area that aims to predict multiple labels from a single input data point. In the era of big data, tasks involving multi-label classification (MLC) or ranking present significant and…

Machine Learning · Computer Science 2024-06-27 Adane Nega Tarekegn , Mohib Ullah , Faouzi Alaya Cheikh

Deep learning (DL) based supervised change detection (CD) models require large labeled training data. Due to the difficulty of collecting labeled multi-temporal data, unsupervised methods are preferred in the CD literature. However,…

Machine Learning · Computer Science 2021-04-13 Sudipan Saha , Biplab Banerjee , Xiao Xiang Zhu

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

Machine Learning · Computer Science 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Deep learning (DL) powered biomedical ultrasound imaging is an emerging research field where researchers adapt the image analysis capabilities of DL algorithms to biomedical ultrasound imaging settings. A major roadblock to wider adoption…

Image and Video Processing · Electrical Eng. & Systems 2023-01-16 Ufuk Soylu , Michael L. Oelze

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mrinal Anand , Aditya Garg

Foundation models in healthcare have largely adopted self supervised pretraining objectives inherited from natural language processing and computer vision, emphasizing reconstruction and large scale representation learning prior to…

Machine Learning · Computer Science 2026-03-24 Yang Zhang , Li Fan , Samuel Lawrence , Shi Li

The label-embedded dictionary learning (DL) algorithms generate influential dictionaries by introducing discriminative information. However, there exists a limitation: All the label-embedded DL methods rely on the labels due that this way…

Machine Learning · Computer Science 2021-12-06 Shuai Shao , Lei Xing , Wei Yu , Rui Xu , Yanjiang Wang , Baodi Liu

Self-training is a simple yet effective method for semi-supervised learning, during which pseudo-label selection plays an important role for handling confirmation bias. Despite its popularity, applying self-training to landmark detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haibo Jin , Haoxuan Che , Hao Chen

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

Machine Learning · Computer Science 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised learning paradigm.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Paul F. R. Wilson , Mahdi Gilany , Amoon Jamzad , Fahimeh Fooladgar , Minh Nguyen Nhat To , Brian Wodlinger , Purang Abolmaesumi , Parvin Mousavi

Learning the optimized solution as a function of environmental parameters is effective in solving numerical optimization in real time for time-sensitive applications. Existing works of learning to optimize train deep neural networks (DNN)…

Machine Learning · Computer Science 2019-05-28 Chengjian Sun , Chenyang Yang

Providing ground truth supervision to train visual models has been a bottleneck over the years, exacerbated by domain shifts which degenerate the performance of such models. This was the case when visual tasks relied on handcrafted features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Gabriel Villalonga , Antonio M. Lopez

Self-training is a simple yet effective method within semi-supervised learning. The idea is to iteratively enhance training data by adding pseudo-labeled data. Its generalization performance heavily depends on the selection of these…

Machine Learning · Statistics 2023-03-03 Julian Rodemann , Christoph Jansen , Georg Schollmeyer , Thomas Augustin

Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Dongseok Shim , H. Jin Kim

Machine learning analysis of longitudinal neuroimaging data is typically based on supervised learning, which requires a large number of ground-truth labels to be informative. As ground-truth labels are often missing or expensive to obtain…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Zixuan Liu , Ehsan Adeli , Kilian M. Pohl

Recent deep learning models for tabular data currently compete with the traditional ML models based on decision trees (GBDT). Unlike GBDT, deep models can additionally benefit from pretraining, which is a workhorse of DL for vision and NLP.…

Machine Learning · Computer Science 2022-07-13 Ivan Rubachev , Artem Alekberov , Yury Gorishniy , Artem Babenko

This paper proposes a novel self-supervised learning method, RELAX-MORE, for quantitative MRI (qMRI) reconstruction. The proposed method uses an optimization algorithm to unroll a model-based qMRI reconstruction into a deep learning…

Biological Physics · Physics 2023-07-26 Wanyu Bian , Albert Jang , Fang Liu

Object type classification for automotive radar has greatly improved with recent deep learning (DL) solutions, however these developments have mostly focused on the classification accuracy. Before employing DL solutions in safety-critical…

Machine Learning · Computer Science 2021-09-28 Kanil Patel , William Beluch , Kilian Rambach , Michael Pfeiffer , Bin Yang

This paper briefly reviews the connections between meta-learning and self-supervised learning. Meta-learning can be applied to improve model generalization capability and to construct general AI algorithms. Self-supervised learning utilizes…

Machine Learning · Computer Science 2021-11-17 Huimin Peng

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Lars Möllenbrok , Begüm Demir