English
Related papers

Related papers: Learning unbiased features

200 papers

Face recognition systems are usually faced with unseen domains in real-world applications and show unsatisfactory performance due to their poor generalization. For example, a well-trained model on webface data cannot deal with the ID vs.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Jianzhu Guo , Xiangyu Zhu , Chenxu Zhao , Dong Cao , Zhen Lei , Stan Z. Li

Unsupervised domain adaptation is effective in leveraging rich information from a labeled source domain to an unlabeled target domain. Though deep learning and adversarial strategy made a significant breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-08-25 You-Wei Luo , Chuan-Xian Ren , Dao-Qing Dai , Hong Yan

Representation learning is the foundation for the recent success of neural network models. However, the distributed representations generated by neural networks are far from ideal. Due to their highly entangled nature, they are di cult to…

Machine Learning · Computer Science 2016-02-09 William Whitney

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Daniel Shalam , Simon Korman

We present a new method to learn video representations from large-scale unlabeled video data. Ideally, this representation will be generic and transferable, directly usable for new tasks such as action recognition and zero or few-shot…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 AJ Piergiovanni , Anelia Angelova , Michael S. Ryoo

Metric learning seeks to embed images of objects suchthat class-defined relations are captured by the embeddingspace. However, variability in images is not just due to different depicted object classes, but also depends on other latent…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karsten Roth , Biagio Brattoli , Björn Ommer

Machine learning is a tool for building models that accurately represent input training data. When undesired biases concerning demographic groups are in the training data, well-trained models will reflect those biases. We present a…

Machine Learning · Computer Science 2018-01-25 Brian Hu Zhang , Blake Lemoine , Margaret Mitchell

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

If our models are used in new or unexpected cases, do we know if they will make fair predictions? Previously, researchers developed ways to debias a model for a single problem domain. However, this is often not how models are trained and…

Machine Learning · Computer Science 2019-11-18 Candice Schumann , Xuezhi Wang , Alex Beutel , Jilin Chen , Hai Qian , Ed H. Chi

In this work, we analyze the conditions under which information about the context of an input $X$ can improve the predictions of deep learning models in new domains. Following work in marginal transfer learning in Domain Generalization…

Machine Learning · Computer Science 2025-10-23 Jens Müller , Lars Kühmichel , Martin Rohbeck , Stefan T. Radev , Ullrich Köthe

Decision analysis deals with modeling and enhancing decision processes. A principal challenge in improving behavior is in obtaining a transparent description of existing behavior in the first place. In this paper, we develop an expressive,…

Machine Learning · Statistics 2023-10-31 Daniel Jarrett , Alihan Hüyük , Mihaela van der Schaar

Domain generalization models learn to generalize to previously unseen domains, but suffer from prediction uncertainty and domain shift. In this paper, we address both problems. We introduce a probabilistic meta-learning model for domain…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yingjun Du , Jun Xu , Huan Xiong , Qiang Qiu , Xiantong Zhen , Cees G. M. Snoek , Ling Shao

In recent years, pattern analysis plays an important role in data mining and recognition, and many variants have been proposed to handle complicated scenarios. In the literature, it has been quite familiar with high dimensionality of data…

Machine Learning · Computer Science 2018-11-09 Miao Cheng , Zunren Liu , Hongwei Zou , Ah Chung Tsoi

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

Representation learning is the dominant technique for unsupervised domain adaptation, but existing approaches often require the specification of "pivot features" that generalize across domains, which are selected by task-specific…

Computation and Language · Computer Science 2015-04-17 Yi Yang , Jacob Eisenstein

Image classification models tend to make decisions based on peripheral attributes of data items that have strong correlation with a target variable (i.e., dataset bias). These biased models suffer from the poor generalization capability…

Machine Learning · Computer Science 2021-10-26 Jungsoo Lee , Eungyeup Kim , Juyoung Lee , Jihyeon Lee , Jaegul Choo

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

Machine Learning · Computer Science 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

This paper proposes an information-theoretic representation learning framework, named conditional information flow maximization, to extract noise-invariant sufficient representations for the input data and target task. It promotes the…

Machine Learning · Computer Science 2024-08-13 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu