English
Related papers

Related papers: Differentially Private Domain Adaptation with Theo…

200 papers

We study differentially private (DP) algorithms for stochastic non-convex optimization. In this problem, the goal is to minimize the population loss over a $p$-dimensional space given $n$ i.i.d. samples drawn from a distribution. We improve…

Machine Learning · Computer Science 2020-08-12 Yingxue Zhou , Xiangyi Chen , Mingyi Hong , Zhiwei Steven Wu , Arindam Banerjee

Domain adaptation (DA) aims to transfer knowledge from a label-rich but heterogeneous domain to a label-scare domain, which alleviates the labeling efforts and attracts considerable attention. Different from previous methods focusing on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Jian Liang , Dapeng Hu , Jiashi Feng

We present novel, computationally efficient, and differentially private algorithms for two fundamental high-dimensional learning problems: learning a multivariate Gaussian and learning a product distribution over the Boolean hypercube in…

Data Structures and Algorithms · Computer Science 2019-05-31 Gautam Kamath , Jerry Li , Vikrant Singhal , Jonathan Ullman

Unsupervised domain adaption aims to learn a powerful classifier for the target domain given a labeled source data set and an unlabeled target data set. To alleviate the effect of `domain shift', the major challenge in domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yexun Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

Unsupervised domain adaptation addresses the problem of classifying data in an unlabeled target domain, given labeled source domain data that share a common label space but follow a different distribution. Most of the recent methods take…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Hui Tang , Yaowei Wang , Kui Jia

Domain adaptation aims to transfer knowledge from a domain with adequate labeled samples to a domain with scarce labeled samples. Prior research has introduced various open set domain adaptation settings in the literature to extend the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Tasfia Shermin , Guojun Lu , Shyh Wei Teng , Manzur Murshed , Ferdous Sohel

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by…

Machine Learning · Computer Science 2023-12-04 Yishay Mansour , Mehryar Mohri , Afshin Rostamizadeh

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the…

Machine Learning · Computer Science 2019-06-03 Rui Wang , Guoyin Wang , Ricardo Henao

Pre-training large transformer models with in-domain data improves domain adaptation and helps gain performance on the domain-specific downstream tasks. However, sharing models pre-trained on potentially sensitive data is prone to…

Computation and Language · Computer Science 2025-08-14 Ying Yin , Ivan Habernal

One of the most effective algorithms for differentially private learning and optimization is objective perturbation. This technique augments a given optimization problem (e.g. deriving from an ERM problem) with a random linear term, and…

Machine Learning · Computer Science 2021-01-01 Seth Neel , Aaron Roth , Giuseppe Vietri , Zhiwei Steven Wu

Deep domain adaptation models learn a neural network in an unlabeled target domain by leveraging the knowledge from a labeled source domain. This can be achieved by learning a domain-invariant feature space. Though the learned…

Machine Learning · Computer Science 2020-03-13 Yinghua Zhang , Yu Zhang , Ying Wei , Kun Bai , Yangqiu Song , Qiang Yang

This paper considers distributed optimization (DO) where multiple agents cooperate to minimize a global objective function, expressed as a sum of local objectives, subject to some constraints. In DO, each agent iteratively solves a local…

Optimization and Control · Mathematics 2023-03-01 Minseok Ryu , Kibaek Kim

Linear programming is a fundamental tool in a wide range of decision systems. However, without privacy protections, sharing the solution to a linear program may reveal information about the underlying data used to formulate it, which may be…

Optimization and Control · Mathematics 2025-11-11 Alexander Benvenuti , Brendan Bialy , Miriam Dennis , Matthew Hale

Classifiers deployed in high-stakes real-world applications must output calibrated confidence scores, i.e. their predicted probabilities should reflect empirical frequencies. Recalibration algorithms can greatly improve a model's…

Machine Learning · Computer Science 2020-08-25 Rachel Luo , Shengjia Zhao , Jiaming Song , Jonathan Kuck , Stefano Ermon , Silvio Savarese

Differential privacy is known to protect against threats to validity incurred due to adaptive, or exploratory, data analysis -- even when the analyst adversarially searches for a statistical estimate that diverges from the true value of the…

Cryptography and Security · Computer Science 2022-07-25 Elbert Du , Cynthia Dwork

Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased…

Machine Learning · Computer Science 2018-06-07 Seth Neel , Aaron Roth

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

Machine Learning · Computer Science 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang

This paper develops a novel differentially private framework to solve convex optimization problems with sensitive optimization data and complex physical or operational constraints. Unlike standard noise-additive algorithms, that act…

Cryptography and Security · Computer Science 2020-06-23 Vladimir Dvorkin , Ferdinando Fioretto , Pascal Van Hentenryck , Jalal Kazempour , Pierre Pinson

This work addresses the unsupervised adaptation of an existing object detector to a new target domain. We assume that a large number of unlabeled videos from this domain are readily available. We automatically obtain labels on the target…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Aruni RoyChowdhury , Prithvijit Chakrabarty , Ashish Singh , SouYoung Jin , Huaizu Jiang , Liangliang Cao , Erik Learned-Miller

Unsupervised domain adaptation for person re-identification (Person Re-ID) is the task of transferring the learned knowledge on the labeled source domain to the unlabeled target domain. Most of the recent papers that address this problem…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Hamza Rami , Matthieu Ospici , Stéphane Lathuilière