English
Related papers

Related papers: Privacy-preserving Active Learning on Sensitive Da…

200 papers

Data generation and labeling are usually an expensive part of learning for robotics. While active learning methods are commonly used to tackle the former problem, preference-based learning is a concept that attempts to solve the latter by…

Machine Learning · Computer Science 2018-10-11 Erdem Bıyık , Dorsa Sadigh

During recent years, active learning has evolved into a popular paradigm for utilizing user's feedback to improve accuracy of learning algorithms. Active learning works by selecting the most informative sample among unlabeled data and…

Machine Learning · Computer Science 2016-11-17 Alireza Ghasemi , Hamid R. Rabiee , Mohsen Fadaee , Mohammad T. Manzuri , Mohammad H. Rohban

Active learning (AL) aims to enable training high performance classifiers with low annotation cost by predicting which subset of unlabelled instances would be most beneficial to label. The importance of AL has motivated extensive research,…

Machine Learning · Computer Science 2018-06-14 Kunkun Pang , Mingzhi Dong , Yang Wu , Timothy Hospedales

Active learning is a powerful tool when labelling data is expensive, but it introduces a bias because the training data no longer follows the population distribution. We formalize this bias and investigate the situations in which it can be…

Machine Learning · Statistics 2021-06-01 Sebastian Farquhar , Yarin Gal , Tom Rainforth

Optimal design for model training is a critical topic in machine learning. Active Learning aims at obtaining improved models by querying samples with maximum uncertainty according to the estimation model for artificially labeling; this has…

The growing development of artificial intelligence based solutions, together with privacy legislation, has driven the rise of the so-called privacy preserving machine learning architectures, such as federated learning. While federated…

Cryptography and Security · Computer Science 2026-05-05 Judith Sáinz-Pardo Díaz , Álvaro López García

We consider a user releasing her data containing some personal information in return of a service. We model user's personal information as two correlated random variables, one of them, called the secret variable, is to be kept private,…

Information Theory · Computer Science 2021-02-19 Ecenaz Erdemir , Pier Luigi Dragotti , Deniz Gunduz

Active learning aims to reduce annotation cost by predicting which samples are useful for a human expert to label. Although this field is quite old, several important challenges to using active learning in real-world settings still remain…

Machine Learning · Computer Science 2021-04-27 Louis Desreumaux , Vincent Lemaire

We consider active learning with logged data, where labeled examples are drawn conditioned on a predetermined logging policy, and the goal is to learn a classifier on the entire population, not just conditioned on the logging policy. Prior…

Machine Learning · Computer Science 2018-06-14 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Data privacy has emerged as an important issue as data-driven deep learning has been an essential component of modern machine learning systems. For instance, there could be a potential privacy risk of machine learning systems via the model…

Machine Learning · Computer Science 2019-11-25 Taihong Xiao , Yi-Hsuan Tsai , Kihyuk Sohn , Manmohan Chandraker , Ming-Hsuan Yang

Deep neural networks have reached high accuracy on object detection but their success hinges on large amounts of labeled data. To reduce the labels dependency, various active learning strategies have been proposed, typically based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ismail Elezi , Zhiding Yu , Anima Anandkumar , Laura Leal-Taixe , Jose M. Alvarez

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

The cost of annotating transcriptions for large speech corpora becomes a bottleneck to maximally enjoy the potential capacity of deep neural network-based automatic speech recognition models. In this paper, we present a new training…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 Jihwan Bang , Heesu Kim , YoungJoon Yoo , Jung-Woo Ha

Annotating abusive language is expensive, logistically complex and creates a risk of psychological harm. However, most machine learning research has prioritized maximizing effectiveness (i.e., F1 or accuracy score) rather than data…

Computation and Language · Computer Science 2022-09-22 Hannah Rose Kirk , Bertie Vidgen , Scott A. Hale

Despite considerable recent progress, the creation of well-balanced and diverse resources remains a time-consuming and costly challenge in Argument Mining. Active Learning reduces the amount of data necessary for the training of machine…

Computation and Language · Computer Science 2021-09-29 Nikolai Solmsdorf , Dietrich Trautmann , Hinrich Schütze

Deep learning algorithms are often said to be data hungry. The performance of such algorithms generally improve as more and more annotated data is fed into the model. While collecting unlabelled data is easier (as they can be scraped easily…

Machine Learning · Computer Science 2024-01-04 Abhishek Sinha , Shreya Singh

Due to the privacy protection or the difficulty of data collection, we cannot observe individual outputs for each instance, but we can observe aggregated outputs that are summed over multiple instances in a set in some real-world…

Machine Learning · Statistics 2022-10-05 Tomoharu Iwata

In the context of text classification, the financial burden of annotation exercises for creating training data is a critical issue. Active learning techniques, particularly those rooted in uncertainty sampling, offer a cost-effective…

Computation and Language · Computer Science 2024-06-19 Hamidreza Rouzegar , Masoud Makrehchi

Data privacy is an important concern in machine learning, and is fundamentally at odds with the task of training useful learning models, which typically require the acquisition of large amounts of private user data. One possible way of…

Machine Learning · Computer Science 2019-02-14 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

While many active learning papers assume that the learner can simply ask for a label and receive it, real annotation often presents a mismatch between the form of a label (say, one among many classes), and the form of an annotation…

Machine Learning · Computer Science 2019-07-10 Peiyun Hu , Zachary C. Lipton , Anima Anandkumar , Deva Ramanan