English
Related papers

Related papers: Exploratory Machine Learning with Unknown Unknowns

200 papers

Most positive and unlabeled data is subject to selection biases. The labeled examples can, for example, be selected from the positive set because they are easier to obtain or more obviously positive. This paper investigates how learning can…

Machine Learning · Computer Science 2019-07-01 Jessa Bekker , Pieter Robberechts , Jesse Davis

In novel class discovery (NCD), we are given labeled data from seen classes and unlabeled data from unseen classes, and we train clustering models for the unseen classes. However, the implicit assumptions behind NCD are still unclear. In…

Machine Learning · Computer Science 2022-09-09 Haoang Chi , Feng Liu , Bo Han , Wenjing Yang , Long Lan , Tongliang Liu , Gang Niu , Mingyuan Zhou , Masashi Sugiyama

Models trained for classification often assume that all testing classes are known while training. As a result, when presented with an unknown class during testing, such closed-set assumption forces the model to classify it as one of the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Poojan Oza , Vishal M Patel

This paper identifies the flaws in existing open-world learning approaches and attempts to provide a complete picture in the form of \textbf{True Open-World Learning}. We accomplish this by proposing a comprehensive generalize-able…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Akshay Raj Dhamija , Touqeer Ahmad , Jonathan Schwan , Mohsen Jafarzadeh , Chunchun Li , Terrance E. Boult

Universal lesion detection has great value for clinical practice as it aims to detect various types of lesions in multiple organs on medical images. Deep learning methods have shown promising results, but demanding large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Xiaoyu Bai , Benteng Ma , Changyang Li , Yong Xia

Classic supervised learning makes the closed-world assumption, meaning that classes seen in testing must have been seen in training. However, in the dynamic world, new or unseen class examples may appear constantly. A model working in such…

Computation and Language · Computer Science 2019-03-05 Hu Xu , Bing Liu , Lei Shu , P. Yu

The primary assumption of conventional supervised learning or classification is that the test samples are drawn from the same distribution as the training samples, which is called closed set learning or classification. In many practical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Sepideh Esmaeilpour , Lei Shu , Bing Liu

The classification of textual data often yields important information. Most classifiers work in a closed world setting where the classifier is trained on a known corpus, and then it is tested on unseen examples that belong to one of the…

Machine Learning · Computer Science 2022-12-27 Justin Leo , Jugal Kalita

Machine unlearning has emerged as a prevalent technical solution for selectively removing unwanted knowledge absorbed during pre-training, without requiring full retraining. While recent unlearning techniques can effectively remove…

Machine Learning · Computer Science 2025-11-04 Myeongseob Ko , Hoang Anh Just , Charles Fleming , Ming Jin , Ruoxi Jia

This paper concerns open-world classification, where the classifier not only needs to classify test examples into seen classes that have appeared in training but also reject examples from unseen or novel classes that have not appeared in…

Machine Learning · Computer Science 2018-01-18 Lei Shu , Hu Xu , Bing Liu

Traditional machine learning mainly supervised learning, follows the assumptions of closed-world learning, i.e., for each testing class, a training class is available. However, such machine learning models fail to identify the classes which…

Machine Learning · Computer Science 2022-02-22 Jitendra Parmar , Satyendra Singh Chouhan , Vaskar Raychoudhury , Santosh Singh Rathore

Active Learning is a very common yet powerful framework for iteratively and adaptively sampling subsets of the unlabeled sets with a human in the loop with the goal of achieving labeling efficiency. Most real world datasets have imbalance…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Suraj Kothawade , Shivang Chopra , Saikat Ghosh , Rishabh Iyer

The need for labeled data is among the most common and well-known practical obstacles to deploying deep learning algorithms to solve real-world problems. The current generation of learning algorithms requires a large volume of data labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Aaron Reite , Scott Kangas , Zackery Steck , Steven Goley , Jonathan Von Stroh , Steven Forsyth

Self-training, a semi-supervised learning algorithm, leverages a large amount of unlabeled data to improve learning when the labeled data are limited. Despite empirical successes, its theoretical characterization remains elusive. To the…

Machine Learning · Computer Science 2022-02-15 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

In semi-supervised learning for classification, it is assumed that every ground truth class of data is present in the small labelled dataset. Many real-world sparsely-labelled datasets are plausibly not of this type. It could easily be the…

Machine Learning · Statistics 2021-01-11 Matthew Willetts , Stephen J Roberts , Christopher C Holmes

Unsupervised ensemble learning emerged to address the challenge of combining multiple learners' predictions without access to ground truth labels or additional data. This paradigm is crucial in scenarios where evaluating individual…

Machine Learning · Computer Science 2026-01-29 Ariel Maymon , Yanir Buznah , Uri Shaham

We investigate model based classification with partially labelled training data. In many biostatistical applications, labels are manually assigned by experts, who may leave some observations unlabelled due to class uncertainty. We analyse…

Methodology · Statistics 2019-04-08 Daniel Ahfock , Geoffrey J. McLachlan

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Acquiring and training on large-scale labeled data can be impractical due to cost constraints. Additionally, the use of small training datasets can result in considerable variability in model outcomes, overfitting, and learning of spurious…

Machine Learning · Computer Science 2025-07-08 Jiashu Tao , Reza Shokri

Neural networks for image classification tasks assume that any given image during inference belongs to one of the training classes. This closed-set assumption is challenged in real-world applications where models may encounter inputs of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Jinsol Lee , Ghassan AlRegib