English
Related papers

Related papers: Detecting Errors and Estimating Accuracy on Unlabe…

200 papers

Semi-supervised learning is a setting in which one has labeled and unlabeled data available. In this survey we explore different types of theoretical results when one uses unlabeled data in classification and regression tasks. Most methods…

Machine Learning · Computer Science 2020-07-31 Alexander Mey , Marco Loog

Language models such as Bidirectional Encoder Representations from Transformers (BERT) have been very effective in various Natural Language Processing (NLP) and text mining tasks including text classification. However, some tasks still pose…

Computation and Language · Computer Science 2024-01-09 Abdullah Alsuhaibani , Hamad Zogan , Imran Razzak , Shoaib Jameel , Guandong Xu

Despite powering sensitive systems like autonomous vehicles, object detection remains fairly brittle in part due to annotation errors that plague most real-world training datasets. We propose ObjectLab, a straightforward algorithm to detect…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ulyana Tkachenko , Aditya Thyagarajan , Jonas Mueller

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

Machine Learning · Computer Science 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

We introduce Integrated Weak Learning, a principled framework that integrates weak supervision into the training process of machine learning models. Our approach jointly trains the end-model and a label model that aggregates multiple…

Machine Learning · Computer Science 2022-06-22 Peter Hayes , Mingtian Zhang , Raza Habib , Jordan Burgess , Emine Yilmaz , David Barber

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

Machine Learning · Computer Science 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

Recent advances in appearance-based models have shown improved eye tracking performance in difficult scenarios like occlusion due to eyelashes, eyelids or camera placement, and environmental reflections on the cornea and glasses. The key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Aayush K. Chaudhary , Prashnna K. Gyawali , Linwei Wang , Jeff B. Pelz

Machine learning and deep learning have shown great promise in mobile sensing applications, including Human Activity Recognition. However, the performance of such models in real-world settings largely depends on the availability of large…

Machine Learning · Computer Science 2021-02-12 Chi Ian Tang , Ignacio Perez-Pozuelo , Dimitris Spathis , Soren Brage , Nick Wareham , Cecilia Mascolo

This work proposes a hybrid unsupervised and supervised learning method to pre-train models applied in Earth observation downstream tasks when only a handful of labels denoting very general semantic concepts are available. We combine a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Omar A. Castaño-Idarraga , Raul Ramos-Pollán , Freddie Kalaitzis

Pseudo-labels are confident predictions made on unlabeled target data by a classifier trained on labeled source data. They are widely used for adapting a model to unlabeled data, e.g., in a semi-supervised learning setting. Our key insight…

Machine Learning · Computer Science 2022-04-22 Xudong Wang , Zhirong Wu , Long Lian , Stella X. Yu

The study of model bias and variance with respect to decision boundaries is critically important in supervised classification. There is generally a tradeoff between the two, as fine-tuning of the decision boundary of a classification model…

Machine Learning · Computer Science 2020-02-25 Matthew Almeida , Wei Ding , Scott Crouter , Ping Chen

Estimating building footprint maps from geospatial data is of paramount importance in urban planning, development, disaster management, and various other applications. Deep learning methodologies have gained prominence in building…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Anuja Vats , David Völgyes , Martijn Vermeer , Marius Pedersen , Kiran Raja , Daniele S. M. Fantin , Jacob Alexander Hay

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

Class imbalance is a pervasive issue among classification models including deep learning, whose capacity to extract task-specific features is affected in imbalanced settings. However, the challenges of handling imbalance among a large…

Machine Learning · Computer Science 2018-10-31 Shin Ando

Correct labels are indispensable for training effective machine learning models. However, creating high-quality labels is expensive, and even professionally labeled data contains errors and ambiguities. Filtering and denoising can be…

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

The rapid growth of machine learning has produced an ever-expanding ecosystem of models, making it increasingly challenging to verify the reliability of newly released models on unseen, unlabeled data. Conventional evaluation pipelines…

Machine Learning · Computer Science 2026-05-25 Trinh Pham , Viet Huynh , Hongzhi Yin , Quoc Viet Hung Nguyen , Thanh Tam Nguyen

Data imbalance is easily found in annotated data when the observations of certain continuous label values are difficult to collect for regression tasks. When they come to molecule and polymer property predictions, the annotated graph…

Machine Learning · Computer Science 2023-05-23 Gang Liu , Tong Zhao , Eric Inae , Tengfei Luo , Meng Jiang