中文
相关论文

相关论文: Adapting to Shifting Correlations with Unlabeled D…

200 篇论文

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

机器学习 · 计算机科学 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Gaussian Processes (\textbf{GPs}) are flexible non-parametric models with strong probabilistic interpretation. While being a standard choice for performing inference on time series, GPs have few techniques to work in a streaming setting.…

机器学习 · 统计学 2021-07-22 Théo Galy-Fajou , Manfred Opper

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

机器学习 · 统计学 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

机器学习 · 计算机科学 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach

The standard supervised learning paradigm works effectively when training data shares the same distribution as the upcoming testing samples. However, this stationary assumption is often violated in real-world applications, especially when…

机器学习 · 计算机科学 2023-01-18 Yong Bai , Yu-Jie Zhang , Peng Zhao , Masashi Sugiyama , Zhi-Hua Zhou

We address the problem of federated domain generalization in an unsupervised setting for the first time. We first theoretically establish a connection between domain shift and alignment of gradients in unsupervised federated learning and…

机器学习 · 计算机科学 2025-01-06 Farhad Pourpanah , Mahdiyar Molahasani , Milad Soltany , Michael Greenspan , Ali Etemad

Autonomous systems operate in environments that may change over time. An example is the control of a self-driving vehicle among pedestrians and human-controlled vehicles whose behavior may change based on factors such as traffic density,…

系统与控制 · 电气工程与系统科学 2026-02-16 Kaizer Rahaman , Jyotirmoy V. Deshmukh , Ashish R. Hota , Lars Lindemann

The consideration of predictive uncertainty in medical imaging with deep learning is of utmost importance. We apply estimation of both aleatoric and epistemic uncertainty by variational Bayesian inference with Monte Carlo dropout to…

图像与视频处理 · 电气工程与系统科学 2021-04-27 Max-Heinrich Laves , Sontje Ihler , Jacob F. Fast , Lüder A. Kahrs , Tobias Ortmaier

Graph is a flexible and effective tool to represent complex structures in practice and graph neural networks (GNNs) have been shown to be effective on various graph tasks with randomly separated training and testing data. In real…

机器学习 · 计算机科学 2021-10-11 Shengyu Zhang , Kun Kuang , Jiezhong Qiu , Jin Yu , Zhou Zhao , Hongxia Yang , Zhongfei Zhang , Fei Wu

In many real-world applications, graph-structured data used for training and testing have differences in distribution, such as in high energy physics (HEP) where simulation data used for training may not match real experiments. Graph domain…

机器学习 · 计算机科学 2023-06-07 Shikun Liu , Tianchun Li , Yongbin Feng , Nhan Tran , Han Zhao , Qiu Qiang , Pan Li

Many real-world resource allocation systems, such as humanitarian logistics and vaccine distribution, must preposition limited supply across multiple locations before demand is realized while stockouts incur irreversible service losses. To…

人工智能 · 计算机科学 2026-05-11 Tzeh Yuan Neoh , Davin Choo , Mengchu Yue , Milind Tambe

Unsupervised domain adaptation (UDA) deals with the adaptation of models from a given source domain with labeled data to an unlabeled target domain. In this paper, we utilize the inherent prediction uncertainty of a model to accomplish the…

计算机视觉与模式识别 · 计算机科学 2020-09-15 Tobias Ringwald , Rainer Stiefelhagen

After deployment, machine learning models often experience performance degradation due to shifts in data distribution. It is challenging to assess post-deployment performance accurately when labels are missing or delayed. Existing proxy…

机器学习 · 计算机科学 2025-10-22 Jakub Białek , Juhani Kivimäki , Wojtek Kuberski , Nikolaos Perrakis

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

机器学习 · 计算机科学 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

机器学习 · 计算机科学 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

In this study, we focus on the unsupervised domain adaptation problem where an approximate inference model is to be learned from a labeled data domain and expected to generalize well to an unlabeled data domain. The success of unsupervised…

计算机视觉与模式识别 · 计算机科学 2020-08-11 Jing Wang , Jiahong Chen , Jianzhe Lin , Leonid Sigal , Clarence W. de Silva

Domain Generalization (DG) research has gained considerable traction as of late, since the ability to generalize to unseen data distributions is a requirement that eludes even state-of-the-art training algorithms. In this paper we observe…

机器学习 · 计算机科学 2025-07-22 Aristotelis Ballas , Christos Diou

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

机器学习 · 计算机科学 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu