English
Related papers

Related papers: Domain Generalization through Meta-Learning: A Sur…

200 papers

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

A machine learning (ML) system must learn not only to match the output of a target function on a training set, but also to generalize to novel situations in order to yield accurate predictions at deployment. In most practical applications,…

Machine Learning · Computer Science 2022-12-13 Clare Lyle

Deep neural networks (DNN) are the state of the art on many engineering problems such as computer vision and audition. A key factor in the success of the DNN is scalability - bigger networks work better. However, the reason for this…

Machine Learning · Computer Science 2015-02-13 Andrew J. R. Simpson

Recent progress in research on Deep Graph Networks (DGNs) has led to a maturation of the domain of learning on graphs. Despite the growth of this research field, there are still important challenges that are yet unsolved. Specifically,…

Machine Learning · Computer Science 2024-04-10 Alessio Gravina , Davide Bacciu

Deep learning models heavily rely on large scale annotated datasets for training. Unfortunately, datasets cannot capture the infinite variability of the real world, thus neural networks are inherently limited by the restricted visual and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Massimiliano Mancini

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Deep Neural Networks (DNNs) have recently been achieving state-of-the-art performance on a variety of computer vision related tasks. However, their computational cost limits their ability to be implemented in embedded systems with…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Laurent Dillard , Yosuke Shinya , Taiji Suzuki

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

How to handle domain shifts when recognizing or segmenting visual data across domains has been studied by learning and vision communities. In this paper, we address domain generalized semantic segmentation, in which the segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Zu-Yun Shiau , Wei-Wei Lin , Ci-Siang Lin , Yu-Chiang Frank Wang

We introduce a new hierarchical deep learning framework for recursive higher-order meta-learning that enables neural networks (NNs) to construct, solve, and generalise across hierarchies of tasks. Central to this approach is a generative…

Machine Learning · Computer Science 2025-07-04 David H. Mguni

Despite their unprecedented success, DNNs are notoriously fragile to small shifts in data distribution, demanding effective testing techniques that can assess their dependability. Despite recent advances in DNN testing, there is a lack of…

Machine Learning · Computer Science 2024-03-26 Sondess Missaoui , Simos Gerasimou , Nikolaos Matragkas

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Domain generalization (DG) tends to alleviate the poor generalization capability of deep neural networks by learning model with multiple source domains. A classical solution to DG is domain augmentation, the common belief of which is that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Fangrui Lv , Jian Liang , Shuang Li , Jinming Zhang , Di Liu

Availability of labelled data is the major obstacle to the deployment of deep learning algorithms for computer vision tasks in new domains. The fact that many frameworks adopted to solve different tasks share the same architecture suggests…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Pierluigi Zama Ramirez , Adriano Cardace , Luca De Luigi , Alessio Tonioni , Samuele Salti , Luigi Di Stefano

Traditional deep learning algorithms often fail to generalize when they are tested outside of the domain of the training data. The issue can be mitigated by using unlabeled data from the target domain at training time, but because data…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to unseen test domains. To accurately evaluate the OOD…

Machine Learning · Computer Science 2024-03-26 Han Yu , Xingxuan Zhang , Renzhe Xu , Jiashuo Liu , Yue He , Peng Cui