中文
相关论文

相关论文: Bridging the Generalization Gap: Training Robust M…

200 篇论文

Causal inference starts with a simple idea: compare groups that differ by treatment, not much else. Traditionally, similar groups are constructed using only observed covariates; however, it remains a long-standing challenge to incorporate…

统计方法学 · 统计学 2025-11-21 Ying Jin , José Zubizarreta

Machine learning methods such as convolutional neural networks (CNNs) are becoming an integral part of scientific research in many disciplines, spatial vector data often fail to be analyzed using these powerful learning methods because of…

机器学习 · 统计学 2018-09-24 Xiongfeng Yan , Tinghua Ai

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar…

图像与视频处理 · 电气工程与系统科学 2021-10-08 Uddeshya Upadhyay , Viswanath P. Sudarshan , Suyash P. Awate

We consider the task of out-of-distribution (OOD) generalization, where the distribution shift is due to an unobserved confounder ($Z$) affecting both the covariates ($X$) and the labels ($Y$). This confounding introduces heterogeneity in…

机器学习 · 计算机科学 2025-08-14 Parjanya Prashant , Seyedeh Baharan Khatami , Bruno Ribeiro , Babak Salimi

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN comes with a fundamental drawback: it incentivizes the model…

机器学习 · 计算机科学 2022-07-05 Saeid Asgari Taghanaki , Ali Gholami , Fereshte Khani , Kristy Choi , Linh Tran , Ran Zhang , Aliasghar Khani

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

机器学习 · 计算机科学 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

机器学习 · 计算机科学 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

Perturbation experiments allow biologists to discover causal relationships between variables of interest, but the sparsity and high dimensionality of these data pose significant challenges for causal structure learning algorithms.…

定量方法 · 定量生物学 2024-10-21 Peiwen Li , Menghua Wu

Generalisation of a deep neural network (DNN) is one major concern when employing the deep learning approach for solving practical problems. In this paper we propose a new technique, named approximated orthonormal normalisation (AON), to…

机器学习 · 计算机科学 2020-01-15 Guoqiang Zhang , Kenta Niwa , W. B. Kleijn

Conventional predictive Artificial Neural Networks (ANNs) commonly employ deterministic weight matrices; therefore, their prediction is a point estimate. Such a deterministic nature in ANNs causes the limitations of using ANNs for medical…

机器学习 · 计算机科学 2020-07-02 Minhyeok Lee , Junhee Seok

To unbiasedly estimate a causal effect on an outcome unconfoundedness is often assumed. If there is sufficient knowledge on the underlying causal structure then existing confounder selection criteria can be used to select subsets of the…

统计方法学 · 统计学 2017-03-20 Jenny Häggström

Deep learning techniques have demonstrated significant capacity in modeling some of the most challenging real world problems of high complexity. Despite the popularity of deep models, we still strive to better understand the underlying…

计算机视觉与模式识别 · 计算机科学 2016-07-11 Yu Zhong , Gil Ettinger

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

We develop a novel method for personalized off-policy learning in scenarios with unobserved confounding. Thereby, we address a key limitation of standard policy learning: standard policy learning assumes unconfoundedness, meaning that no…

机器学习 · 计算机科学 2026-02-18 Konstantin Hess , Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

One can improve predictability in the unknown domain by combining forecasts of imperfect complex computational models using a Bayesian statistical machine learning framework. In many cases, however, the models used in the mixing process are…

核理论 · 物理学 2024-08-21 Pablo Giuliani , Kyle Godbey , Vojtech Kejzlar , Witold Nazarewicz

The problem of multi-domain learning of deep networks is considered. An adaptive layer is induced per target domain and a novel procedure, denoted covariance normalization (CovNorm), proposed to reduce its parameters. CovNorm is a data…

计算机视觉与模式识别 · 计算机科学 2019-06-26 Yunsheng Li , Nuno Vasconcelos

The emergence of large-scale pre-trained vision foundation models has greatly advanced the medical imaging field through the pre-training and fine-tuning paradigm. However, selecting appropriate medical data for downstream fine-tuning…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Anyang Ji , Qingbo Kang , Wei Xu , Changfan Wang , Kang Li , Qicheng Lao

Despite their compelling theoretical properties, Bayesian neural networks (BNNs) tend to perform worse than frequentist methods in classification-based uncertainty quantification (UQ) tasks such as out-of-distribution (OOD) detection. In…

机器学习 · 计算机科学 2022-02-03 Agustinus Kristiadi , Matthias Hein , Philipp Hennig

Generative Adversarial Networks (GANs) is a powerful family of models that learn an underlying distribution to generate synthetic data. Many existing studies of GANs focus on improving the realness of the generated image data for visual…

机器学习 · 计算机科学 2021-11-04 Si-An Chen , Chun-Liang Li , Hsuan-Tien Lin