English
Related papers

Related papers: Multi-Class Classification from Single-Class Data …

200 papers

This paper introduces a generic method which enables to use conventional deep neural networks as end-to-end one-class classifiers. The method is based on splitting given data from one class into two subsets. In one-class classification,…

Machine Learning · Computer Science 2019-09-17 Patrick Schlachter , Yiwen Liao , Bin Yang

Multiclass classifiers are often designed and evaluated only on a sample from the classes on which they will eventually be applied. Hence, their final accuracy remains unknown. In this work we study how a classifier's performance over the…

Machine Learning · Computer Science 2024-05-29 Yuli Slavutsky , Yuval Benjamini

Large pre-trained language models have shown remarkable performance over the past few years. These models, however, sometimes learn superficial features from the dataset and cannot generalize to the distributions that are dissimilar to the…

Computation and Language · Computer Science 2022-10-31 Jieyu Zhao , Xuezhi Wang , Yao Qin , Jilin Chen , Kai-Wei Chang

In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into…

Machine Learning · Computer Science 2024-09-25 Sjoerd de Vries , Dirk Thierens

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

Learning unbiased models on imbalanced datasets is a significant challenge. Rare classes tend to get a concentrated representation in the classification space which hampers the generalization of learned boundaries to new test examples. In…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Salman Khan , Munawar Hayat , Waqas Zamir , Jianbing Shen , Ling Shao

Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification…

Machine Learning · Computer Science 2019-04-30 Sachin Vernekar , Ashish Gaurav , Taylor Denouden , Buu Phan , Vahdat Abdelzad , Rick Salay , Krzysztof Czarnecki

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their…

Machine Learning · Computer Science 2019-02-20 Juozas Vaicenavicius , David Widmann , Carl Andersson , Fredrik Lindsten , Jacob Roll , Thomas B. Schön

We consider the few-shot classification task with an unbalanced dataset, in which some classes have sufficient training samples while other classes only have limited training samples. Recent works have proposed to solve this task by…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Vivek Roy , Yan Xu , Yu-Xiong Wang , Kris Kitani , Ruslan Salakhutdinov , Martial Hebert

There have been two separate lines of work on estimating Ising models: (1) estimating them from multiple independent samples under minimal assumptions about the model's interaction matrix; and (2) estimating them from one sample in…

Statistics Theory · Mathematics 2020-12-11 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Anthimos Vardis Kandiros

In the domains of dataset construction and crowdsourcing, a notable challenge is to aggregate labels from a heterogeneous set of labelers, each of whom is potentially an expert in some subset of tasks (and less reliable in others). To…

Machine Learning · Computer Science 2021-01-07 Surin Ahn , Ayfer Ozgur , Mert Pilanci

In machine learning, the performance of a classifier depends on both the classifier model and the dataset. For a specific neural network classifier, the training process varies with the training set used; some training data make training…

Machine Learning · Computer Science 2020-06-01 Shuyue Guan , Murray Loew , Hanseok Ko

The goal of confidence-set learning in the binary classification setting is to construct two sets, each with a specific probability guarantee to cover a class. An observation outside the overlap of the two sets is deemed to be from one of…

Machine Learning · Statistics 2018-10-01 Wenbo Wang , Xingye Qiao

Simulation-based falsification is a practical testing method to increase confidence that the system will meet safety requirements. Because full-fidelity simulations can be computationally demanding, we investigate the use of simulators with…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

We construct a universally Bayes consistent learning rule that satisfies differential privacy (DP). We first handle the setting of binary classification and then extend our rule to the more general setting of density estimation (with…

Machine Learning · Computer Science 2022-12-09 Olivier Bousquet , Haim Kaplan , Aryeh Kontorovich , Yishay Mansour , Shay Moran , Menachem Sadigurschi , Uri Stemmer

Being able to learn from small amounts of data is a key characteristic of human intelligence, but exactly {\em how} small? In this paper, we introduce a novel experimental paradigm that allows us to examine classification in an extremely…

Machine Learning · Computer Science 2022-02-11 Maya Malaviya , Ilia Sucholutsky , Kerem Oktar , Thomas L. Griffiths

This paper proposes a novel generic one-class feature learning method based on intra-class splitting. In one-class classification, feature learning is challenging, because only samples of one class are available during training. Hence,…

Machine Learning · Computer Science 2019-11-21 Patrick Schlachter , Yiwen Liao , Bin Yang

Meta learning uses information from base learners (e.g. classifiers or estimators) as well as information about the learning problem to improve upon the performance of a single base learner. For example, the Bayes error rate of a given…

Machine Learning · Computer Science 2016-03-11 Kevin R. Moon , Veronique Delouille , Alfred O. Hero

We propose a new splitting criterion for a meta-learning approach to multiclass classifier design that adaptively merges the classes into a tree-structured hierarchy of increasingly difficult binary classification problems. The…

Machine Learning · Computer Science 2017-11-10 Gerrit J. J. van den Burg , Alfred O. Hero

Classification tasks in machine learning involving more than two classes are known by the name of "multi-class classification". Performance indicators are very useful when the aim is to evaluate and compare different classification models…

Machine Learning · Statistics 2020-08-14 Margherita Grandini , Enrico Bagli , Giorgio Visani