English
Related papers

Related papers: Learning Using Privileged Information: SVM+ and We…

200 papers

The lack of interpretability often makes black-box models difficult to be applied to many practical domains. For this reason, the current work, from the black-box model input port, proposes to incorporate data-based prior information into…

Machine Learning · Statistics 2019-02-05 Shaohan Chen , Chuanhou Gao , Ping Zhang

The learning with privileged information setting has recently attracted a lot of attention within the machine learning community, as it allows the integration of additional knowledge into the training process of a classifier, even when this…

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

In domains where sample sizes are limited, efficient learning algorithms are critical. Learning using privileged information (LuPI) offers increased sample efficiency by allowing prediction models access to auxiliary information at training…

Machine Learning · Computer Science 2023-11-21 Bastian Jung , Fredrik D Johansson

We introduce a new unsupervised anomaly detection ensemble called SPI which can harness privileged information - data available only for training examples but not for (future) test examples. Our ideas build on the Learning Using Privileged…

Machine Learning · Computer Science 2018-05-25 Shubhranshu Shekhar , Leman Akoglu

Machine unlearning, as a post-hoc processing technique, has gained widespread adoption in addressing challenges like bias mitigation and robustness enhancement, colloquially, machine unlearning for fairness and robustness. However, existing…

Machine Learning · Computer Science 2025-05-27 Xinbao Qiao , Ningning Ding , Yushi Cheng , Meng Zhang

Preference-based learning of reward functions, where the reward function is learned using comparison data, has been well studied for complex robotic tasks such as autonomous driving. Existing algorithms have focused on learning reward…

Robotics · Computer Science 2021-03-05 Sydney M. Katz , Amir Maleki , Erdem Bıyık , Mykel J. Kochenderfer

Learning using privileged information (LUPI) is a powerful heterogenous feature space machine learning framework that allows a machine learning model to learn from highly informative or privileged features which are available during…

Machine Learning · Computer Science 2019-03-26 Amina Asif , Muhammad Dawood , Fayyaz ul Amir Afsar Minhas

Weighted twin support vector machines (WLTSVM) mines as much potential similarity information in samples as possible to improve the common short-coming of non-parallel plane classifiers. Compared with twin support vector machines (TWSVM),…

Machine Learning · Statistics 2022-01-28 Ruxin Xu , Huiru Wang

Learning using privileged information (LUPI) paradigm, which pioneered teacher-student interaction mechanism, makes the learning models use additional information in training stage. This paper is the first to propose an incremental learning…

Machine Learning · Computer Science 2022-03-15 Yanshuang Ao , Xinyu Zhou , Wei Dai

Science consists on conceiving hypotheses, confronting them with empirical evidence, and keeping only hypotheses which have not yet been falsified. Under deductive reasoning they are conceived in view of a theory and confronted with…

Machine Learning · Computer Science 2022-11-04 Diego Marcondes , Adilson Simonis , Junior Barrera

Deep Learning requires large amounts of data to train models that work well. In data-deficient settings, performance can be degraded. We investigate which Deep Learning methods benefit training models in a data-deficient setting, by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Robert-Jan Bruintjes , Attila Lengyel , Osman Semih Kayhan , Davide Zambrano , Nergis Tömen , Hadi Jamali-Rad , Jan van Gemert

This paper presents privileged multi-label learning (PrML) to explore and exploit the relationship between labels in multi-label learning problems. We suggest that for each individual label, it cannot only be implicitly connected with other…

Machine Learning · Statistics 2017-01-26 Shan You , Chang Xu , Yunhe Wang , Chao Xu , Dacheng Tao

In this paper, we propose a novel regression-based method for employing privileged information to estimate the height using human metrology. The actual values of the anthropometric measurements are difficult to estimate accurately using…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Nikolaos Sarafianos , Christophoros Nikou , Ioannis A. Kakadiaris

When estimating a regression model, we might have data where some labels are missing, or our data might be biased by a selection mechanism. When the response or selection mechanism is ignorable (i.e., independent of the response variable…

Statistics Theory · Mathematics 2023-08-22 Philip Boeken , Noud de Kroon , Mathijs de Jong , Joris M. Mooij , Onno Zoeter

Imitation learning offers a promising path for robots to learn general-purpose behaviors, but traditionally has exhibited limited scalability due to high data supervision requirements and brittle generalization. Inspired by recent advances…

Machine Learning · Computer Science 2022-11-16 Soroush Nasiriany , Tian Gao , Ajay Mandlekar , Yuke Zhu

In many applications, it is desirable to extract only the relevant information from complex input data, which involves making a decision about which input features are relevant. The information bottleneck method formalizes this as an…

Machine Learning · Statistics 2020-04-28 Anirudh Goyal , Yoshua Bengio , Matthew Botvinick , Sergey Levine

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

In information retrieval (IR) and related tasks, term weighting approaches typically consider the frequency of the term in the document and in the collection in order to compute a score reflecting the importance of the term for the…

Machine Learning · Computer Science 2021-09-22 Alejandro Moreo Fernández , Andrea Esuli , Fabrizio Sebastiani

Supervised learning datasets often have privileged information, in the form of features which are available at training time but are not available at test time e.g. the ID of the annotator that provided the label. We argue that privileged…

Machine Learning · Computer Science 2022-06-16 Mark Collier , Rodolphe Jenatton , Efi Kokiopoulou , Jesse Berent