English
Related papers

Related papers: Domain Generalization In Robust Invariant Represen…

200 papers

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable…

Machine Learning · Computer Science 2024-02-27 José Manuel de Frutos , Pablo M. Olmos , Manuel A. Vázquez , Joaquín Míguez

Equivariant neural networks, whose hidden features transform according to representations of a group G acting on the data, exhibit training efficiency and an improved generalisation performance. In this work, we extend group invariant and…

Machine Learning · Computer Science 2024-04-15 Robin Winter , Marco Bertolini , Tuan Le , Frank Noé , Djork-Arné Clevert

Transformation groups, such as translations or rotations, effectively express part of the variability observed in many recognition problems. The group structure enables the construction of invariant signal representations with appealing…

Artificial Intelligence · Computer Science 2013-01-17 Joan Bruna , Arthur Szlam , Yann LeCun

Machine learning models have made incredible progress, but they still struggle when applied to examples from unseen domains. This study focuses on a specific problem of domain generalization, where a model is trained on one source domain…

Computation and Language · Computer Science 2024-04-23 Tao Feng , Lizhen Qu , Zhuang Li , Haolan Zhan , Yuncheng Hua , Gholamreza Haffari

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Ngan Le

The goal of Deep Domain Adaptation is to make it possible to use Deep Nets trained in one domain where there is enough annotated training data in another where there is little or none. Most current approaches have focused on learning…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

The objective of domain generalization (DG) is to enable models to be robust against domain shift. DG is crucial for deploying vision-language models (VLMs) in real-world applications, yet most existing methods rely on domain labels that…

Machine Learning · Computer Science 2026-02-02 Zhixing Li , Arsham Gholamzadeh Khoee , Yinan Yu

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Minh Do

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

Machine Learning · Computer Science 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

In general, graph representation learning methods assume that the train and test data come from the same distribution. In this work we consider an underexplored area of an otherwise rapidly developing field of graph representation learning:…

Machine Learning · Computer Science 2021-12-08 Beatrice Bevilacqua , Yangze Zhou , Bruno Ribeiro

This paper presents an approach for learning invariant features for object affordance understanding. One of the major problems for a robotic agent acquiring a deeper understanding of affordances is finding sensory-grounded semantics. Being…

Robotics · Computer Science 2019-01-31 Martin Hjelm , Carl Henrik Ek , Renaud Detry , Danica Kragic

The introduction of convolutional layers greatly advanced the performance of neural networks on image tasks due to innately capturing a way of encoding and learning translation-invariant operations, matching one of the underlying symmetries…

Computer Vision and Pattern Recognition · Computer Science 2016-12-15 Nicholas Guttenberg , Nathaniel Virgo , Olaf Witkowski , Hidetoshi Aoki , Ryota Kanai

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Given the importance of remote sensing, surprisingly little attention has been paid to it by the representation learning community. To address it and to establish baselines and a common evaluation protocol in this domain, we provide…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Maxim Neumann , Andre Susano Pinto , Xiaohua Zhai , Neil Houlsby

Machine learning models will often fail when deployed in an environment with a data distribution that is different than the training distribution. When multiple environments are available during training, many methods exist that learn…

Machine Learning · Computer Science 2023-09-26 Alan Q. Wang , Minh Nguyen , Mert R. Sabuncu

Generalising well in supervised learning tasks relies on correctly extrapolating the training data to a large region of the input space. One way to achieve this is to constrain the predictions to be invariant to transformations on the input…

Machine Learning · Computer Science 2018-08-17 Mark van der Wilk , Matthias Bauer , ST John , James Hensman

To generalize well, classifiers must learn to be invariant to nuisance transformations that do not alter an input's class. Many problems have "class-agnostic" nuisance transformations that apply similarly to all classes, such as lighting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Allan Zhou , Fahim Tajwar , Alexander Robey , Tom Knowles , George J. Pappas , Hamed Hassani , Chelsea Finn

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

Machine Learning · Computer Science 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan

Domain generalization is a critical challenge for machine learning systems. Prior domain generalization methods focus on extracting domain-invariant features across several stationary domains to enable generalization to new domains.…

Machine Learning · Computer Science 2024-01-17 Binghui Xie , Yongqiang Chen , Jiaqi Wang , Kaiwen Zhou , Bo Han , Wei Meng , James Cheng