English
Related papers

Related papers: SLOPE and Designing Robust Studies for Generalizat…

200 papers

Scientists frequently generalize population level causal quantities such as average treatment effect from a source population to a target population. When the causal effects are heterogeneous, differences in subject characteristics between…

Methodology · Statistics 2023-06-16 Rui Chen , Guanhua Chen , Menggang Yu

When faced with a supervised learning problem, we hope to have rich enough data to build a model that predicts future instances well. However, in practice, problems can exhibit predictive heterogeneity: most instances might be relatively…

Machine Learning · Statistics 2016-08-02 Rhiannon V. Rose , Daniel J. Lizotte

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

Machine Learning · Statistics 2025-04-29 Steve Hanneke , Samory Kpotufe

Generalizing empirical findings to new environments, settings, or populations is essential in most scientific explorations. This article treats a particular problem of generalizability, called "transportability", defined as a license to…

Artificial Intelligence · Computer Science 2014-01-03 Elias Bareinboim , Judea Pearl

Robustness is often regarded as a critical future challenge for real-world applications, where stability is essential. However, as models often learn tasks in a similar order, we hypothesize that easier tasks will be easier regardless of…

Machine Learning · Computer Science 2026-02-04 Shir Ashury-Tahan , Ariel Gera , Elron Bandel , Michal Shmueli-Scheuer , Leshem Choshen

Dropout has been demonstrated as a simple and effective module to not only regularize the training process of deep neural networks, but also provide the uncertainty estimation for prediction. However, the quality of uncertainty estimation…

Machine Learning · Computer Science 2021-03-09 Xinjie Fan , Shujian Zhang , Korawat Tanwisuth , Xiaoning Qian , Mingyuan Zhou

Extracting relevant features from data sets where the number of observations ($n$) is much smaller then the number of predictors ($p$) is a major challenge in modern statistics. Sorted L-One Penalized Estimation (SLOPE), a generalization of…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Małgorzata Bogdan , Jonas Wallin

The generalizability of empirical findings to new environments, settings or populations, often called "external validity," is essential in most scientific explorations. This paper treats a particular problem of generalizability, called…

Methodology · Statistics 2015-03-06 Judea Pearl , Elias Bareinboim

Accurately predicting the relevance of items to users is crucial to the success of many social platforms. Conventional approaches train models on logged historical data; but recommendation systems, media services, and online marketplaces…

Machine Learning · Computer Science 2022-10-11 Amir Feder , Guy Horowitz , Yoav Wald , Roi Reichart , Nir Rosenfeld

A standard assumption for causal inference from observational data is that one has measured a sufficiently rich set of covariates to ensure that within covariate strata, subjects are exchangeable across observed treatment values. Skepticism…

Methodology · Statistics 2020-09-24 Eric J Tchetgen Tchetgen , Andrew Ying , Yifan Cui , Xu Shi , Wang Miao

Systematic generalization remains challenging for current language models, which are known to be both sensitive to semantically similar permutations of the input and to struggle with known concepts presented in novel contexts. Although…

Computation and Language · Computer Science 2025-05-28 Sondre Wold , Lucas Georges Gabriel Charpentier , Étienne Simon

Transferability estimation has been attached to great attention in the computer vision fields. Researchers try to estimate with low computational cost the performance of a model when transferred from a source task to a given target task.…

Computation and Language · Computer Science 2023-12-11 Jun Bai , Xiaofeng Zhang , Chen Li , Hanhua Hong , Xi Xu , Chenghua Lin , Wenge Rong

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Most research designing novel predictive models, or employing existing ones, assumes that training and testing data are independent and identically distributed. In practice, the data encountered at serving time often deviate from the…

Machine Learning · Computer Science 2026-03-30 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

We show that there may exist an inherent tension between the goal of adversarial robustness and that of standard generalization. Specifically, training robust models may not only be more resource-consuming, but also lead to a reduction of…

Machine Learning · Statistics 2019-09-10 Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Alexander Turner , Aleksander Madry

Understanding model's sensitivity to its training data is crucial but can also be challenging and costly, especially during training. To simplify such issues, we present the Memory-Perturbation Equation (MPE) which relates model's…

Machine Learning · Computer Science 2024-01-17 Peter Nickl , Lu Xu , Dharmesh Tailor , Thomas Möllenhoff , Mohammad Emtiyaz Khan

Exchangeability -- in which the distribution of an infinite sequence is invariant to reorderings of its elements -- implies the existence of a simple conditional independence structure that may be leveraged in the design of statistical…

Statistics Theory · Mathematics 2022-07-25 Trevor Campbell , Saifuddin Syed , Chiao-Yu Yang , Michael I. Jordan , Tamara Broderick

The goal of machine learning is to find models that minimize prediction error on data that has not yet been seen. Its operational paradigm assumes access to a dataset $S$ and articulates a scheme for evaluating how well a given model…

Machine Learning · Computer Science 2026-04-22 Maxim Raginsky , Benjamin Recht

We consider high-dimensional sparse regression problems in which we observe $y = X \beta + z$, where $X$ is an $n \times p$ design matrix and $z$ is an $n$-dimensional vector of independent Gaussian errors, each with variance $\sigma^2$.…

Statistics Theory · Mathematics 2015-09-25 Weijie Su , Emmanuel Candes

Machine learning models are often susceptible to adversarial perturbations of their inputs. Even small perturbations can cause state-of-the-art classifiers with high "standard" accuracy to produce an incorrect prediction with high…

Machine Learning · Computer Science 2018-05-03 Ludwig Schmidt , Shibani Santurkar , Dimitris Tsipras , Kunal Talwar , Aleksander Mądry