English
Related papers

Related papers: Preventing Failures Due to Dataset Shift: Learning…

200 papers

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

Machine Learning · Statistics 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

Machine learning models often require large datasets and struggle to generalize beyond their training distribution. These limitations pose significant challenges in scientific and engineering contexts, where generating exhaustive datasets…

Chemical Physics · Physics 2025-06-12 Salman N. Salman , Sergey A. Shteingolts , Ron Levie , Dan Mendels

In practice, the data distribution at test time often differs, to a smaller or larger extent, from that of the original training data. Consequentially, the so-called source classifier, trained on the available labelled data, deteriorates on…

Machine Learning · Statistics 2021-06-18 Wouter M. Kouw , Marco Loog

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

Machine Learning · Computer Science 2024-12-11 Yuli Slavutsky , Yuval Benjamini

Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere, agents trained in a…

Machine Learning · Computer Science 2021-11-02 Marco Federici , Ryota Tomioka , Patrick Forré

Learning behavioral patterns from observational data has been a de-facto approach to motion forecasting. Yet, the current paradigm suffers from two shortcomings: brittle under distribution shifts and inefficient for knowledge transfer. In…

Machine Learning · Computer Science 2022-04-06 Yuejiang Liu , Riccardo Cadei , Jonas Schweizer , Sherwin Bahmani , Alexandre Alahi

We study the prevalent problem when a test distribution differs from the training distribution. We consider a setting where our training set consists of a small number of sample domains, but where we have many samples in each domain. Our…

Machine Learning · Computer Science 2011-05-05 Dean Foster , Sham Kakade , Ruslan Salakhutdinov

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Human beings learn causal models and constantly use them to transfer knowledge between similar environments. We use this intuition to design a transfer-learning framework using object-oriented representations to learn the causal…

Machine Learning · Computer Science 2020-07-21 Purva Pruthi , Javier González , Xiaoyu Lu , Madalina Fiterau

Symbolic regression algorithms search a space of mathematical expressions for formulas that explain given data. Transformer-based models have emerged as a promising, scalable approach shifting the expensive combinatorial search to a…

Machine Learning · Computer Science 2025-09-25 Henrik Voigt , Paul Kahlmeyer , Kai Lawonn , Michael Habeck , Joachim Giesen

In this paper, we consider the problem of learning a linear regression model on a data domain of interest (target) given few samples. To aid learning, we are provided with a set of pre-trained regression models that are trained on…

Machine Learning · Computer Science 2023-06-27 Navjot Singh , Suhas Diggavi

Over the last decades, many prognostic models based on artificial intelligence techniques have been used to provide detailed predictions in healthcare. Unfortunately, the real-world observational data used to train and validate these models…

Machine Learning · Computer Science 2023-11-21 Alice Bernasconi , Alessio Zanga , Peter J. F. Lucas , Marco Scutari , Fabio Stella

Recent work has shown that the performance of machine learning models can vary substantially when models are evaluated on data drawn from a distribution that is close to but different from the training distribution. As a result, predicting…

Machine Learning · Computer Science 2021-08-23 Devin Guillory , Vaishaal Shankar , Sayna Ebrahimi , Trevor Darrell , Ludwig Schmidt

Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve the model's generalization ability on unseen target domains.…

Machine Learning · Computer Science 2021-06-03 Yunqi Wang , Furui Liu , Zhitang Chen , Qing Lian , Shoubo Hu , Jianye Hao , Yik-Chung Wu

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung

Machine learning models rely on various assumptions to attain high accuracy. One of the preliminary assumptions of these models is the independent and identical distribution, which suggests that the train and test data are sampled from the…

Machine Learning · Computer Science 2022-11-08 Paras Sheth , Raha Moraffah , K. Selçuk Candan , Adrienne Raglin , Huan Liu

Varying domains and biased datasets can lead to differences between the training and the target distributions, known as covariate shift. Current approaches for alleviating this often rely on estimating the ratio of training and target…

Machine Learning · Statistics 2020-10-27 Bijan Mazaheri , Siddharth Jain , Jehoshua Bruck

Structural causal models describe how the components of a robotic system interact. They provide both structural and functional information about the relationships that are present in the system. The structural information outlines the…

Robotics · Computer Science 2025-08-12 Alejandro Murillo-Gonzalez , Junhong Xu , Lantao Liu

Transfer learning is beneficial for survival analysis, especially when the target study has a limited number of events. However, existing transfer learning methods rely on the restrictive assumption that the target and source studies share…

Methodology · Statistics 2026-03-13 Yu Gu , Donglin Zeng , D. Y. Lin

Domain adaptation (DA) arises as an important problem in statistical machine learning when the source data used to train a model is different from the target data used to test the model. Recent advances in DA have mainly been…

Machine Learning · Statistics 2021-11-25 Yuansi Chen , Peter Bühlmann