English
Related papers

Related papers: Towards Shape Biased Unsupervised Representation L…

200 papers

Neural network models often generalize poorly to mismatched domains or distributions. In NLP, this issue arises in particular when models are expected to generalize compositionally, that is, to novel combinations of familiar words and…

Computation and Language · Computer Science 2021-11-10 Wang Zhu , Peter Shaw , Tal Linzen , Fei Sha

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

Machine Learning · Computer Science 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

Spatial autocorrelation and spatial heterogeneity widely exist in spatial data, which make the traditional machine learning model perform badly. Spatial domain generalization is a spatial extension of domain generalization, which can…

Machine Learning · Computer Science 2022-12-29 Dazhou Yu , Guangji Bai , Yun Li , Liang Zhao

Neural networks (NNs) are known to exhibit simplicity bias where they tend to prefer learning 'simple' features over more 'complex' ones, even when the latter may be more informative. Simplicity bias can lead to the model making biased…

Machine Learning · Computer Science 2023-10-11 Bhavya Vasudeva , Kameron Shahabi , Vatsal Sharan

Traditional deep learning-based visual imitation learning techniques require a large amount of demonstration data for model training, and the pre-trained models are difficult to adapt to new scenarios. To address these limitations, we…

Robotics · Computer Science 2022-04-26 Dandan Zhang , Wen Fan , John Lloyd , Chenguang Yang , Nathan Lepora

Self-supervised representation learning is able to learn semantically meaningful features; however, much of its recent success relies on multiple crops of an image with very few objects. Instead of learning view-invariant representation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Yuwen Xiong , Mengye Ren , Wenyuan Zeng , Raquel Urtasun

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

We present a novel unsupervised domain adaptation method for semantic segmentation that generalizes a model trained with source images and corresponding ground-truth labels to a target domain. A key to domain adaptive semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Geon Lee , Chanho Eom , Wonkyung Lee , Hyekang Park , Bumsub Ham

Recognizing wild faces is extremely hard as they appear with all kinds of variations. Traditional methods either train with specifically annotated variation data from target domains, or by introducing unlabeled target variation data to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Yichun Shi , Xiang Yu , Kihyuk Sohn , Manmohan Chandraker , Anil K. Jain

Implicit neural representation is a recent approach to learn shape collections as zero level-sets of neural networks, where each shape is represented by a latent code. So far, the focus has been shape reconstruction, while shape…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Matan Atzmon , David Novotny , Andrea Vedaldi , Yaron Lipman

Current state-of-the-art self-supervised approaches, are effective when trained on individual domains but show limited generalization on unseen domains. We observe that these models poorly generalize even when trained on a mixture of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Neha Kalibhat , Sam Sharpe , Jeremy Goodsitt , Bayan Bruss , Soheil Feizi

The objective of unsupervised domain adaptation is to leverage features from a labeled source domain and learn a classifier for an unlabeled target domain, with a similar but different data distribution. Most deep learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-19 Pedro O. Pinheiro

In this work, we study different approaches to self-supervised pretraining of object detection models. We first design a general framework to learn a spatially consistent dense representation from an image, by randomly sampling and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Trung Dang , Simon Kornblith , Huy Thong Nguyen , Peter Chin , Maryam Khademi

The objective of domain generalization (DG) is to enable models to be robust against domain shift. DG is crucial for deploying vision-language models (VLMs) in real-world applications, yet most existing methods rely on domain labels that…

Machine Learning · Computer Science 2026-02-02 Zhixing Li , Arsham Gholamzadeh Khoee , Yinan Yu

Unsupervised domain adaptation is effective in leveraging the rich information from the source domain to the unsupervised target domain. Though deep learning and adversarial strategy make an important breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-03-02 You-Wei Luo , Chuan-Xian Ren , Pengfei Ge , Ke-Kun Huang , Yu-Feng Yu

Humans have the ability to accumulate knowledge of new tasks in varying conditions, but deep neural networks often suffer from catastrophic forgetting of previously learned knowledge after learning a new task. Many recent methods focus on…

There is an emerging sense that the vulnerability of Image Convolutional Neural Networks (CNN), i.e., sensitivity to image corruptions, perturbations, and adversarial attacks, is connected with Texture Bias. This relative lack of Shape Bias…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Maruthi Narayanan , Vickram Rajendran , Benjamin Kimia

Recent semi-supervised and self-supervised methods have shown great success in the image and text domain by utilizing augmentation techniques. Despite such success, it is not easy to transfer this success to tabular domains. It is not easy…

Machine Learning · Computer Science 2022-12-05 Morteza Mohammady Gharasuie , Fenjiao Wang