English
Related papers

Related papers: Differentially Private Domain Adaptation with Theo…

200 papers

One recent research demonstrated successful application of the label alignment property for unsupervised domain adaptation in a linear regression settings. Instead of regularizing representation learning to be domain invariant, the research…

Machine Learning · Computer Science 2025-03-13 Xuanrui Zeng

The aim of unsupervised domain adaptation is to leverage the knowledge in a labeled (source) domain to improve a model's learning performance with an unlabeled (target) domain -- the basic strategy being to mitigate the effects of…

Machine Learning · Computer Science 2020-10-09 Zhen Fang , Jie Lu , Feng Liu , Junyu Xuan , Guangquan Zhang

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain…

Machine Learning · Statistics 2016-03-28 Ozan Sener , Hyun Oh Song , Ashutosh Saxena , Silvio Savarese

Domain Adaptation methodologies have shown to effectively generalize from a labeled source domain to a label scarce target domain. Previous research has either focused on unlabeled domain adaptation without any target supervision or…

Machine Learning · Computer Science 2022-02-14 Jonas Sonntag , Gunnar Behrens , Lars Schmidt-Thieme

We study the space complexity of the two related fields of differential privacy and adaptive data analysis. Specifically, (1) Under standard cryptographic assumptions, we show that there exists a problem P that requires exponentially more…

Cryptography and Security · Computer Science 2023-02-14 Itai Dinur , Uri Stemmer , David P. Woodruff , Samson Zhou

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

In the problem of domain adaptation for binary classification, the learner is presented with labeled examples from a source domain, and must correctly classify unlabeled examples from a target domain, which may differ from the source.…

Machine Learning · Statistics 2019-03-01 Clayton Scott

Parameter-transfer is a well-known and versatile approach for meta-learning, with applications including few-shot learning, federated learning, and reinforcement learning. However, parameter-transfer algorithms often require sharing models…

Machine Learning · Computer Science 2020-02-24 Jeffrey Li , Mikhail Khodak , Sebastian Caldas , Ameet Talwalkar

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

In the absence of labeled target data, unsupervised domain adaptation approaches seek to align the marginal distributions of the source and target domains in order to train a classifier for the target. Unsupervised domain alignment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

This paper addresses the problem of unsupervised domain adaption from theoretical and algorithmic perspectives. Existing domain adaptation theories naturally imply minimax optimization algorithms, which connect well with the domain…

Machine Learning · Computer Science 2019-07-24 Yuchen Zhang , Tianle Liu , Mingsheng Long , Michael I. Jordan

Top-performing deep architectures are trained on massive amounts of labeled data. In the absence of labeled data for a certain task, domain adaptation often provides an attractive option given that labeled data of similar nature but from a…

Machine Learning · Statistics 2015-03-02 Yaroslav Ganin , Victor Lempitsky

Domain adaptation (DA) aims at transferring knowledge from a labeled source domain to an unlabeled target domain. Though many DA theories and algorithms have been proposed, most of them are tailored into classification settings and may fail…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Junguang Jiang , Yifei Ji , Ximei Wang , Yufeng Liu , Jianmin Wang , Mingsheng Long

In recent years, deep neural networks have emerged as a dominant machine learning tool for a wide variety of application domains. However, training a deep neural network requires a large amount of labeled data, which is an expensive process…

Computer Vision and Pattern Recognition · Computer Science 2017-06-26 Hemanth Venkateswara , Jose Eusebio , Shayok Chakraborty , Sethuraman Panchanathan

Unsupervised domain adaptation is effective in leveraging rich information from a labeled source domain to an unlabeled target domain. Though deep learning and adversarial strategy made a significant breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-08-25 You-Wei Luo , Chuan-Xian Ren , Dao-Qing Dai , Hong Yan

Domain adaptation helps transfer the knowledge gained from a labeled source domain to an unlabeled target domain. During the past few years, different domain adaptation techniques have been published. One common flaw of these approaches is…

Machine Learning · Computer Science 2020-12-25 Mohammad J. Hashemi , Eric Keller

Classical machine learning assumes that the training and test sets come from the same distributions. Therefore, a model learned from the labeled training data is expected to perform well on the test data. However, This assumption may not…

Machine Learning · Computer Science 2020-10-12 Abolfazl Farahani , Sahar Voghoei , Khaled Rasheed , Hamid R. Arabnia

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

When applying differential privacy to sensitive data, we can often improve performance using external information such as other sensitive data, public data, or human priors. We propose to use the learning-augmented algorithms (or algorithms…

Cryptography and Security · Computer Science 2023-05-09 Mikhail Khodak , Kareem Amin , Travis Dick , Sergei Vassilvitskii