English
Related papers

Related papers: Discrete Choice Models for Nonmonotone Nonignorabl…

200 papers

We study aleatoric and epistemic uncertainty estimation in a learned regressive system dynamics model. Disentangling aleatoric uncertainty (the inherent randomness of the system) from epistemic uncertainty (the lack of data) is crucial for…

Machine Learning · Computer Science 2025-03-21 Zhiyu An , Zhibo Hou , Wan Du

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Fueled by the call for formative assessments, diagnostic classification models (DCMs) have recently gained popularity in psychometrics. Despite their potential for providing diagnostic information that aids in classroom instruction and…

Computation · Statistics 2022-08-26 Motonori Oka , Kensuke Okada

Longitudinal data are characterized by the dependence between observations coming from the same individual. In a regression perspective, such a dependence can be usefully ascribed to unobserved features (covariates) specific to each…

Methodology · Statistics 2015-09-07 Maria Francesca Marino , Marco Alfó

Tensor classification is gaining importance across fields, yet handling partially observed data remains challenging. In this paper, we introduce a novel approach to tensor classification with incomplete data, framed within high-dimensional…

Machine Learning · Statistics 2024-11-01 Elynn Chen , Yuefeng Han , Jiayu Li

Standard approaches for variable selection in linear models are not tailored to deal properly with high-dimensional and incomplete data. Currently, methods dedicated to high-dimensional data handle missing values by ad-hoc strategies, like…

Methodology · Statistics 2021-06-09 Avner Bar-Hen , Vincent Audigier

While deep neural networks (DNNs) are used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN estimator under…

Machine Learning · Statistics 2026-03-18 Xuran Meng , Yi Li

We argue that the selective inclusion of data points based on latent objectives is common in practical situations, such as music sequences. Since this selection process often distorts statistical analysis, previous work primarily views it…

Machine Learning · Computer Science 2024-07-02 Yujia Zheng , Zeyu Tang , Yiwen Qiu , Bernhard Schölkopf , Kun Zhang

Missing data is a common concern in health datasets, and its impact on good decision-making processes is well documented. Our study's contribution is a methodology for tackling missing data problems using a combination of synthetic dataset…

Machine Learning · Computer Science 2022-11-08 Gift Khangamwa , Terence L. van Zyl , Clint J. van Alten

During the semiconductor manufacturing process, predicting the yield of the semiconductor is an important problem. Early detection of defective product production in the manufacturing process can save huge production cost. The data…

Applications · Statistics 2021-08-03 Sewon Park , Kyeongwon Lee , Da-Eun Jeong , Heung-Kook Ko , Jaeyong Lee

This paper establishes a general equivalence between discrete choice and rational inattention models. Matejka and McKay (2015, AER) showed that when information costs are modelled using the Shannon entropy function, the resulting choice…

Econometrics · Economics 2017-09-27 Mogens Fosgerau , Emerson Melo , Andre de Palma , Matthew Shum

We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distributions over observed and latent variables. Under the key…

Machine Learning · Computer Science 2023-04-21 William I. Walker , Hugo Soulat , Changmin Yu , Maneesh Sahani

High throughput metabolomics data are fraught with both non-ignorable missing observations and unobserved factors that influence a metabolite's measured concentration, and it is well known that ignoring either of these complications can…

Methodology · Statistics 2019-09-09 Chris McKennan , Carole Ober , Dan Nicolae

State-of-the-art causal discovery methods usually assume that the observational data is complete. However, the missing data problem is pervasive in many practical scenarios such as clinical trials, economics, and biology. One…

Machine Learning · Computer Science 2023-01-18 Erdun Gao , Ignavier Ng , Mingming Gong , Li Shen , Wei Huang , Tongliang Liu , Kun Zhang , Howard Bondell

When a missing process depends on the missing values themselves, it needs to be explicitly modelled and taken into account while doing likelihood-based inference. We present an approach for building and fitting deep latent variable models…

Machine Learning · Statistics 2021-03-19 Niels Bruun Ipsen , Pierre-Alexandre Mattei , Jes Frellsen

This work introduces a novel deep learning-based architecture, termed the Deep Belief Markov Model (DBMM), which provides efficient, model-formulation agnostic inference in Partially Observable Markov Decision Process (POMDP) problems. The…

Machine Learning · Computer Science 2025-03-18 Giacomo Arcieri , Konstantinos G. Papakonstantinou , Daniel Straub , Eleni Chatzi

Longitudinal data are essential for studying within subject change and between subject differences in change. However, missing data, especially when the observed variables are nonnormal, remain a significant challenge in longitudinal…

Methodology · Statistics 2025-04-21 Dandan Tang , Xin Tong , Jianhui Zhou

Handling missing data in time series is a complex problem due to the presence of temporal dependence. General-purpose imputation methods, while widely used, often distort key statistical properties of the data, such as variance and…

Methodology · Statistics 2026-03-18 Guilherme Pumi , Taiane Schaedler Prass , Douglas Krauthein Verdum

Missing data are inevitable in clinical trials, and trials that produce categorical ordinal responses are not exempted from this. Typically, missing values in the data occur due to different missing mechanisms, such as missing completely at…

Methodology · Statistics 2025-05-09 Arnab Kumar Maity , Huaming Tan , Vivek Pradhan , Soutir Bandyopadhyay

Boosting has emerged as a useful machine learning technique over the past three decades, attracting increased attention. Most advancements in this area, however, have primarily focused on numerical implementation procedures, often lacking…

Methodology · Statistics 2026-02-23 Yuan Bian , Grace Y. Yi , Wenqing He