English
Related papers

Related papers: Distributional Change in Ordinal Data with Missing…

200 papers

We propose a method to identify and characterize distribution shifts in classification datasets based on optimal transport. It allows the user to identify the extent to which each class is affected by the shift, and retrieves corresponding…

Machine Learning · Computer Science 2022-08-08 Neha Hulkund , Nicolo Fusi , Jennifer Wortman Vaughan , David Alvarez-Melis

Systematics contaminate observables, leading to distribution shifts relative to theoretically simulated signals-posing a major challenge for using pre-trained models to label such observables. Since systematics are often poorly understood…

Instrumentation and Methods for Astrophysics · Physics 2025-11-18 Sultan Hassan , Sambatra Andrianomena , Benjamin D. Wandelt

In many real-world prediction tasks, class labels contain information about the relative order between labels that are not captured by commonly used loss functions such as multicategory cross-entropy. Recently, the preference for unimodal…

Machine Learning · Computer Science 2025-03-21 Jaime S. Cardoso , Ricardo Cruz , Tomé Albuquerque

Existing measures and representations for trajectories have two longstanding fundamental shortcomings, i.e., they are computationally expensive and they can not guarantee the `uniqueness' property of a distance function: dist(X,Y) = 0 if…

Machine Learning · Computer Science 2023-01-03 Yufan Wang , Kai Ming Ting , Yuanyi Shang

In the real world, planning is often challenged by distribution shifts. As such, a model of the environment obtained under one set of conditions may no longer remain valid as the distribution of states or the environment dynamics change,…

Artificial Intelligence · Computer Science 2026-03-02 Matteo Ceriscioli , Karthika Mohan

As machine learning models are increasingly deployed in dynamic environments, it becomes paramount to assess and quantify uncertainties associated with distribution shifts. A distribution shift occurs when the underlying data-generating…

Methodology · Statistics 2024-10-08 Jiawei Ge , Debarghya Mukherjee , Jianqing Fan

Many causal and structural parameters in economics can be identified and estimated by computing the value of an optimization program over all distributions consistent with the model and the data. Existing tools apply when the data is…

Econometrics · Economics 2025-07-31 Andrei Voronin

Partial identification often arises when the joint distribution of the data is known only up to its marginals. We consider the corresponding partially identified GMM model and develop a methodology for identification, estimation, and…

Econometrics · Economics 2025-12-29 Grigory Franguridi , Laura Liu

Many causal estimands are only partially identifiable since they depend on the unobservable joint distribution between potential outcomes. Stratification on pretreatment covariates can yield sharper bounds; however, unless the covariates…

Econometrics · Economics 2024-11-19 Wenlong Ji , Lihua Lei , Asher Spector

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

Machine Learning · Statistics 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

We present a new partial order reduction method for reachability analysis of nondeterministic labeled transition systems over metric spaces. Nondeterminism arises from both the choice of the initial state and the choice of actions, and the…

Logic in Computer Science · Computer Science 2018-05-14 Chuchu Fan , Zhenqi Huang , Sayan Mitra

Making informed decisions about model adequacy has been an outstanding issue for regression models with discrete outcomes. Standard assessment tools for such outcomes (e.g. deviance residuals) often show a large discrepancy from the…

Methodology · Statistics 2021-04-02 Lu Yang

This paper investigates a novel offline change-point detection problem from an information-theoretic perspective. In contrast to most related works, we assume that the knowledge of the underlying pre- and post-change distributions are not…

Information Theory · Computer Science 2021-10-05 Haiyun He , Qiaosheng Zhang , Vincent Y. F. Tan

Geometric data sets arising in modern applications are often very large and change dynamically over time. A popular framework for dealing with such data sets is the evolving data framework, where a discrete structure continuously varies…

Computational Geometry · Computer Science 2025-04-28 Aditya Acharya , David M. Mount

When split conformal prediction operates in batch mode with exchangeable data, we determine the exact distribution of the empirical coverage of prediction sets produced for a finite batch of future observables, as well as the exact…

Statistics Theory · Mathematics 2025-01-23 Paulo C. Marques F

Order statistics theory is applied in this paper to probabilistic robust control theory to compute the minimum sample size needed to come up with a reliable estimate of an uncertain quantity under continuity assumption of the related…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou

We develop algorithms for detecting multiple changepoints in functional data when the number of changepoints is unknown (unsupervised case), when it is specified apriori (supervised case), and when certain bounds are available…

Methodology · Statistics 2025-11-19 Sourav Chakrabarty , Anirvan Chakraborty , Shyamal K. De

Nonparametric two-sample tests such as the Maximum Mean Discrepancy (MMD) are often used to detect differences between two distributions in machine learning applications. However, the majority of existing literature assumes that error-free…

Machine Learning · Statistics 2023-08-08 Ron Nafshi , Maggie Makar

Optimal algorithms are developed for robust detection of changes in non-stationary processes. These are processes in which the distribution of the data after change varies with time. The decision-maker does not have access to precise…

Methodology · Statistics 2025-05-14 Yingze Hou , Yousef Oleyaeimotlagh , Rahul Mishra , Hoda Bidkhori , Taposh Banerjee

Being able to identify service slowdowns is crucial to many operational problems. We study how to use observational congestion data to learn service slowdown in a multi-server system that uses adaptive congestion control mechanisms. We show…

Physics and Society · Physics 2025-03-18 Xu Kuang , Gal Mendelson