中文
相关论文

相关论文: Towards Combating Frequency Simplicity-biased Lear…

200 篇论文

We propose a simple domain adaptation method for neural networks in a supervised setting. Supervised domain adaptation is a way of improving the generalization performance on the target domain by using the source domain dataset, assuming…

计算与语言 · 计算机科学 2016-07-05 Yusuke Watanabe , Kazuma Hashimoto , Yoshimasa Tsuruoka

A common issue in exploiting simulated ultrasound data for training neural networks is the domain shift problem, where the trained models on synthetic data are not generalizable to clinical data. Recently, Fourier Domain Adaptation (FDA)…

图像与视频处理 · 电气工程与系统科学 2021-09-22 Mostafa Sharifzadeh , Ali K. Z. Tehrani , Habib Benali , Hassan Rivaz

Over-parameterized deep neural networks (DNNs) with sufficient capacity to memorize random noise can achieve excellent generalization performance, challenging the bias-variance trade-off in classical learning theory. Recent studies claimed…

机器学习 · 计算机科学 2022-11-15 Xiao Zhang , Haoyi Xiong , Dongrui Wu

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

机器学习 · 统计学 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Tensor neural networks (TNNs) have demonstrated their superiority in solving high-dimensional problems. However, similar to conventional neural networks, TNNs are also influenced by the Frequency Principle, which limits their ability to…

机器学习 · 计算机科学 2026-05-15 Jizu Huang , Yue Qiu , Rukang You

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Jin Chen , Zhi Gao , Xinxiao Wu , Jiebo Luo

Recent studies have proven that DNNs, unlike human vision, tend to exploit texture information rather than shape. Such texture bias is one of the factors for the poor generalization performance of DNNs. We observe that the texture bias…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Hwan Heo , Youngjin Oh , Jaewon Lee , Hyunwoo J. Kim

Despite the large research effort devoted to learning dependencies between time series, the state of the art still faces a major limitation: existing methods learn partial correlations but fail to discriminate across distinct frequency…

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

机器学习 · 计算机科学 2022-09-30 Mohammad Rostami

Image pre-processing in the frequency domain has traditionally played a vital role in computer vision and was even part of the standard pipeline in the early days of deep learning. However, with the advent of large datasets, many…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Cristina Vasconcelos , Hugo Larochelle , Vincent Dumoulin , Nicolas Le Roux , Ross Goroshin

Unsupervised domain adaptation (UDA) aims to learn a model trained on source domain and performs well on unlabeled target domain. In medical image segmentation field, most existing UDA methods depend on adversarial learning to address the…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Shaolei Liu , Siqi Yin , Linhao Qu , Manning Wang

The problem of domain generalization is to learn from multiple training domains, and extract a domain-agnostic model that can then be applied to an unseen domain. Domain generalization (DG) has a clear motivation in contexts where there are…

计算机视觉与模式识别 · 计算机科学 2017-10-10 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Understanding the internal process of ConvNets is commonly done using visualization techniques. However, these techniques do not usually provide a tool for estimating the stability of a ConvNet against noise. In this paper, we show how to…

计算机视觉与模式识别 · 计算机科学 2015-11-17 Elnaz J. Heravi , Hamed H. Aghdam , Domenec Puig

Deep learning models usually suffer from domain shift issues, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Cheng Ouyang , Chen Chen , Surui Li , Zeju Li , Chen Qin , Wenjia Bai , Daniel Rueckert

Domain generalization (DG) is a fundamental yet very challenging research topic in machine learning. The existing arts mainly focus on learning domain-invariant features with limited source domains in a static model. Unfortunately, there is…

机器学习 · 计算机科学 2022-05-30 Zhishu Sun , Zhifeng Shen , Luojun Lin , Yuanlong Yu , Zhifeng Yang , Shicai Yang , Weijie Chen

As the success of Generative Adversarial Networks (GANs) on natural images quickly propels them into various real-life applications across different domains, it becomes more and more important to clearly understand their limitations.…

机器学习 · 计算机科学 2020-12-21 Mahyar Khayatkhoei , Ahmed Elgammal

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

计算与语言 · 计算机科学 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Traditional domain generalization methods often rely on domain alignment to reduce inter-domain distribution differences and learn domain-invariant representations. However, domain shifts are inherently difficult to eliminate, which limits…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuheng Xu , Taiping Zhang

It is known that, without awareness of the process, our brain appears to focus on the general shape of objects rather than superficial statistics of context. On the other hand, learning autonomously allows discovering invariant regularities…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Nader Asadi , Amir M. Sarfi , Mehrdad Hosseinzadeh , Zahra Karimpour , Mahdi Eftekhari

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

机器学习 · 计算机科学 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long