English
Related papers

Related papers: Learning Purified Feature Representations from Tas…

200 papers

Training data plays an essential role in modern applications of machine learning. However, gathering labeled training data is time-consuming. Therefore, labeling is often outsourced to less experienced users, or completely automated. This…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Alex Bäuerle , Heiko Neumann , Timo Ropinski

Existing deep learning approaches for learning visual features tend to overlearn and extract more information than what is required for the task at hand. From a privacy preservation perspective, the input visual information is not protected…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Naveen Panwar , Tarun Tater , Anush Sankaran , Senthil Mani

The recent rise of unsupervised and self-supervised learning has dramatically reduced the dependency on labeled data, providing effective image representations for transfer to downstream vision tasks. Furthermore, recent works employed…

Machine Learning · Computer Science 2021-06-14 Andrey Voynov , Stanislav Morozov , Artem Babenko

Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Nicole Meister , Ruth Fong , Olga Russakovsky

Since the recent advent of regulations for data protection (e.g., the General Data Protection Regulation), there has been increasing demand in deleting information learned from sensitive data in pre-trained models without retraining from…

Machine Learning · Computer Science 2024-01-17 Sungmin Cha , Sungjun Cho , Dasol Hwang , Honglak Lee , Taesup Moon , Moontae Lee

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

Evidence suggests that networks trained on large datasets generalize well not solely because of the numerous training examples, but also class diversity which encourages learning of enriched features. This raises the question of whether…

Active learning (AL) is a prominent technique for reducing the annotation effort required for training machine learning models. Deep learning offers a solution for several essential obstacles to deploying AL in practice but introduces many…

Computation and Language · Computer Science 2022-05-10 Akim Tsvigun , Artem Shelmanov , Gleb Kuzmin , Leonid Sanochkin , Daniil Larionov , Gleb Gusev , Manvel Avetisian , Leonid Zhukov

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

Being able to segment unseen classes not observed during training is an important technical challenge in deep learning, because of its potential to reduce the expensive annotation required for semantic segmentation. Prior zero-label…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Giuseppe Pastore , Fabio Cermelli , Yongqin Xian , Massimiliano Mancini , Zeynep Akata , Barbara Caputo

Deep neural models have achieved state of the art performance on a wide range of problems in computer science, especially in computer vision. However, deep neural networks often require large datasets of labeled samples to generalize…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Patrick Kage , Jay C. Rothenberger , Pavlos Andreadis , Dimitrios I. Diochnos

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer

Label-noise or curated unlabeled data is used to compensate for the assumption of clean labeled data in training the conditional generative adversarial network; however, satisfying such an extended assumption is occasionally laborious or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Kai Katsumata , Duc Minh Vo , Tatsuya Harada , Hideki Nakayama

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Hierarchical image recognition seeks to predict class labels along a semantic taxonomy, from broad categories to specific ones, typically under the tidy assumption that every training image is fully annotated along its taxonomy path.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Seulki Park , Zilin Wang , Stella X. Yu

Can we automatically group images into semantically meaningful clusters when ground-truth annotations are absent? The task of unsupervised image classification remains an important, and open challenge in computer vision. Several recent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Marc Proesmans , Luc Van Gool

Semi-supervised learning methods are motivated by the availability of large datasets with unlabeled features in addition to labeled data. Unlabeled data is, however, not guaranteed to improve classification performance and has in fact been…

Machine Learning · Statistics 2019-10-25 Xiuming Liu , Dave Zachariah , Johan Wågberg , Thomas B. Schön

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

Machine Learning · Computer Science 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Minghan Li , Xialei Liu , Joost van de Weijer , Bogdan Raducanu