English
Related papers

Related papers: A First Step Towards Distribution Invariant Regres…

200 papers

Estimation and inference with modern longitudinal data from wearable devices, which consist of biological signals at high-frequency time points, is burdened by massive computational costs. We propose a distributed estimation and inference…

Methodology · Statistics 2023-09-13 Cole Manschot , Emily C. Hector

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Prediction models often fail if train and test data do not stem from the same distribution. Out-of-distribution (OOD) generalization to unseen, perturbed test data is a desirable but difficult-to-achieve property for prediction models and…

Methodology · Statistics 2022-05-25 Lucas Kook , Beate Sick , Peter Bühlmann

We consider the problem of predicting a response variable from a set of covariates on a data set that differs in distribution from the training data. Causal parameters are optimal in terms of predictive accuracy if in the new distribution…

Methodology · Statistics 2020-05-12 Dominik Rothenhäusler , Nicolai Meinshausen , Peter Bühlmann , Jonas Peters

We consider a variant of regression problem, where the correspondence between input and output data is not available. Such shuffled data is commonly observed in many real world problems. Taking flow cytometry as an example, the measuring…

Machine Learning · Computer Science 2021-02-12 Yujia Xie , Yixiu Mao , Simiao Zuo , Hongteng Xu , Xiaojing Ye , Tuo Zhao , Hongyuan Zha

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

In many learning problems, the training and testing data follow different distributions and a particularly common situation is the \textit{covariate shift}. To correct for sampling biases, most approaches, including the popular kernel mean…

Machine Learning · Computer Science 2020-03-13 Henry Lam , Fengpei Li , Siddharth Prusty

This paper investigates the large sample properties of local regression distribution estimators, which include a class of boundary adaptive density estimators as a prime example. First, we establish a pointwise Gaussian large sample…

Econometrics · Economics 2021-01-29 Matias D. Cattaneo , Michael Jansson , Xinwei Ma

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these…

Machine Learning · Computer Science 2024-11-05 Edwige Cyffers , Muni Sreenivas Pydi , Jamal Atif , Olivier Cappé

The application of machine learning to physics problems is widely found in the scientific literature. Both regression and classification problems are addressed by a large array of techniques that involve learning algorithms. Unfortunately,…

Machine Learning · Computer Science 2022-10-03 Umberto Michelucci , Francesca Venturini

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

Methodology · Statistics 2024-02-09 Ryo Okano , Masaaki Imaizumi

With the rise of neural models across the field of information retrieval, numerous publications have incrementally pushed the envelope of performance for a multitude of IR tasks. However, these networks often sample data in random order,…

Information Retrieval · Computer Science 2018-06-12 Daniel Cohen , Scott M. Jordan , W. Bruce Croft

Machine learning models are often deployed in different settings than they were trained and validated on, posing a challenge to practitioners who wish to predict how well the deployed model will perform on a target distribution. If an…

Machine Learning · Computer Science 2022-04-12 Mayee Chen , Karan Goel , Nimit S. Sohoni , Fait Poms , Kayvon Fatahalian , Christopher Ré

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Large-scale rare events data are commonly encountered in practice. To tackle the massive rare events data, we propose a novel distributed estimation method for logistic regression in a distributed system. For a distributed framework, we…

Methodology · Statistics 2023-04-06 Xuetong Li , Xuening Zhu , Hansheng Wang

Random forests are an ensemble method relevant for many problems, such as regression or classification. They are popular due to their good predictive performance (compared to, e.g., decision trees) requiring only minimal tuning of…

Methodology · Statistics 2022-10-20 Nikolaus Umlauf , Nadja Klein

In real-world regression tasks, datasets frequently exhibit imbalanced distributions, characterized by a scarcity of data in high-complexity regions and an abundance in low-complexity areas. This imbalance presents significant challenges…

Machine Learning · Computer Science 2025-02-05 Donghe Chen , Jiaxuan Yue , Tengjie Zheng , Lanxuan Wang , Lin Cheng

The true distribution parameterizations of commonly used image datasets are inaccessible. Rather than designing metrics for feature spaces with unknown characteristics, we propose to measure GAN performance by evaluating on explicitly…

Machine Learning · Computer Science 2018-12-31 Shayne O'Brien , Matt Groh , Abhimanyu Dubey

The paper algorithmizes the problem of regime change point identification for data measured in a system exhibiting impulsive behaviors. This is a fundamental challenge for annotation of measurement data relevant, e.g., for designing…

The problem of modeling the relationship between univariate distributions and one or more explanatory variables has found increasing interest. Traditional functional data methods cannot be applied directly to distributional data because of…

Methodology · Statistics 2025-02-04 Yidong Zhou , Hans-Georg Müller