English
Related papers

Related papers: A Generalized Meta-loss function for regression an…

200 papers

Leveraging privileged information (PI), or features available during training but not at test time, has recently been shown to be an effective method for addressing label noise. However, the reasons for its effectiveness are not well…

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

Successful unsupervised domain adaptation is guaranteed only under strong assumptions such as covariate shift and overlap between input domains. The latter is often violated in high-dimensional applications like image classification which,…

Machine Learning · Computer Science 2024-06-13 Adam Breitholtz , Anton Matsson , Fredrik D. Johansson

Protecting privileged communications and data from inadvertent disclosure is a paramount task in the US legal practice. Traditionally counsels rely on keyword searching and manual review to identify privileged documents in cases. As data…

Information Retrieval · Computer Science 2021-12-17 Haozhen Zhao , Shi Ye , Jingchao Yang

Learning the ability to generalize knowledge between similar contexts is particularly important in medical imaging as data distributions can shift substantially from one hospital to another, or even from one machine to another. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Steven Korevaar , Ruwan Tennakoon , Ricky O'Brien , Dwarikanath Mahapatra , Alireza Bab-Hadiasha

Neural networks can be trained to solve regression problems by using gradient-based methods to minimize the square loss. However, practitioners often prefer to reformulate regression as a classification problem, observing that training on…

Machine Learning · Computer Science 2023-03-02 Lawrence Stewart , Francis Bach , Quentin Berthet , Jean-Philippe Vert

Machine learning (ML) has emerged as a powerful tool for tackling complex regression and classification tasks, yet its success often hinges on the quality of training data. This study introduces an ML paradigm inspired by domain knowledge…

Machine Learning · Computer Science 2025-01-10 Mohsen Rashki

We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Seyed Mehdi Iranmanesh , Ali Dabouei , Nasser M. Nasrabadi

Dataset Condensation (DC) seeks to select or distill samples from large datasets into smaller subsets while preserving performance on target tasks. Existing methods primarily focus on pruning or synthesizing data in the same format as the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Shaobo Wang , Youxin Jiang , Tianle Niu , Yantai Yang , Ruiji Zhang , Shuhao Hu , Shuaiyu Zhang , Chenghao Sun , Weiya Li , Conghui He , Xuming Hu , Linfeng Zhang

Using privileged information during training can improve the sample efficiency and performance of machine learning systems. This paradigm has been applied to reinforcement learning (RL), primarily in the form of distillation or auxiliary…

Machine Learning · Computer Science 2020-05-20 Pierre-Alexandre Kamienny , Kai Arulkumaran , Feryal Behbahani , Wendelin Boehmer , Shimon Whiteson

Training foundation models is computationally intensive and often slow to converge. We introduce PIQL,Privileged Information for Quick and Quality Learning, the first framework to systematically integrate privileged information (PI) to…

Machine Learning · Computer Science 2026-05-15 Xueying Ding , Leman Akoglu

Deep neural networks for visual perception are highly susceptible to domain shift, which poses a critical challenge for real-world deployment under conditions that differ from the training data. To address this domain generalization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Gabriele Magrini , Federico Becattini , Niccolò Biondi , Pietro Pala

Unlabeled data are increasingly prevalent in contemporary economic studies, yet their effective use for improving prediction remains challenging because the outcomes are often costly or even infeasible to observe. Machine learning methods…

Methodology · Statistics 2026-05-12 Fuzhi Xu , Xingyu Yan , Xinyu Zhang

Many tasks in natural language processing can be viewed as multi-label classification problems. However, most of the existing models are trained with the standard cross-entropy loss function and use a fixed prediction policy (e.g., a…

Computation and Language · Computer Science 2019-09-11 Jiawei Wu , Wenhan Xiong , William Yang Wang

People learn to discriminate between classes without explicit exposure to negative examples. On the contrary, traditional machine learning algorithms often rely on negative examples, otherwise the model would be prone to collapse and…

Machine Learning · Computer Science 2020-05-08 Chenhao Xie , Qiao Cheng , Jiaqing Liang , Lihan Chen , Yanghua Xiao

Prior knowledge can be used to improve predictive performance of learning algorithms or reduce the amount of data required for training. The same goal is pursued within the learning using privileged information paradigm which was recently…

Machine Learning · Statistics 2014-03-04 Maksim Lapin , Matthias Hein , Bernt Schiele

In this work, we develop a simple algorithm for semi-supervised regression. The key idea is to use the top eigenfunctions of integral operator derived from both labeled and unlabeled examples as the basis functions and learn the prediction…

Machine Learning · Computer Science 2012-07-03 Ming Ji , Tianbao Yang , Binbin Lin , Rong Jin , Jiawei Han

In computer vision, it is often observed that formulating regression problems as a classification task often yields better performance. We investigate this curious phenomenon and provide a derivation to show that classification, with the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Shihao Zhang , Linlin Yang , Michael Bi Mi , Xiaoxu Zheng , Angela Yao

In many wireless application scenarios, acquiring labeled data can be prohibitively costly, requiring complex optimization processes or measurement campaigns. Semi-supervised learning leverages unlabeled samples to augment the available…

Information Theory · Computer Science 2024-10-08 Houssem Sifaou , Osvaldo Simeone

Private inference (PI) enables inference directly on cryptographically secure data.While promising to address many privacy issues, it has seen limited use due to extreme runtimes. Unlike plaintext inference, where latency is dominated by…

Cryptography and Security · Computer Science 2022-06-09 Minsu Cho , Ameya Joshi , Siddharth Garg , Brandon Reagen , Chinmay Hegde