English
Related papers

Related papers: Doubly-robust and heteroscedasticity-aware sample …

200 papers

We propose a sampling scheme suitable for reducing a data set prior to selecting a hypothesis with minimum empirical risk. The sampling only considers a subset of the ultimate (unknown) hypothesis set, but can nonetheless guarantee that the…

Machine Learning · Computer Science 2013-06-25 Paul Mineiro , Nikos Karampatziakis

Combining information from multiple samples is often needed in biomedical and economic studies, but the differences between these samples must be appropriately taken into account in the analysis of the combined data. We study estimation for…

Methodology · Statistics 2018-08-14 Heng Shu , Zhiqiang Tan

Inferring causal directions on discrete and categorical data is an important yet challenging problem. Even though the additive noise models (ANMs) approach can be adapted to the discrete data, the functional structure assumptions make it…

Machine Learning · Statistics 2021-09-02 Austin Goddard , Yu Xiang

Bayesian doubly robust (DR) causal inference faces a fundamental dilemma: joint modeling of outcome and propensity score suffers from the feedback problem where outcome information contaminates propensity score estimation, while two-step…

Methodology · Statistics 2026-01-05 Shunichiro Orihara , Tomotaka Momozaki , Shonosuke Sugasawa

This paper serves as a literature review of methodology concerning the (modern) causal inference methods to address the causal estimand with observational/survey data that have been or will be used in social science research. Mainly, this…

Econometrics · Economics 2024-08-02 Guanghui Pan

For better learning, large datasets are often split into small batches and fed sequentially to the predictive model. In this paper, we study such batch decompositions from a probabilistic perspective. We assume that data points (possibly…

Machine Learning · Computer Science 2025-04-10 Ghurumuruhan Ganesan

The concept of biased data is well known and its practical applications range from social sciences and biology to economics and quality control. These observations arise when a sampling procedure chooses an observation with probability that…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich

The standard approach to compressive sampling considers recovering an unknown deterministic signal with certain known structure, and designing the sub-sampling pattern and recovery algorithm based on the known structure. This approach…

Information Theory · Computer Science 2016-02-03 Yen-Huan Li , Volkan Cevher

The increasing use of stochastic models for describing complex phenomena warrants surrogate models that capture the reference model characteristics at a fraction of the computational cost, foregoing potentially expensive Monte Carlo…

Machine Learning · Computer Science 2024-06-10 Neil Kichler , Sher Afghan , Uwe Naumann

Doubly robust estimators have gained popularity in the field of causal inference due to their ability to provide consistent point estimates when either an outcome or exposure model is correctly specified. However, for nonrandomized…

In clinical and epidemiological research doubly truncated data often appear. This is the case, for instance, when the data registry is formed by interval sampling. Double truncation generally induces a sampling bias on the target variable,…

Methodology · Statistics 2023-01-11 Jacobo de Uña-Álvarez

Spurious association arises from covariance between propensity for the treatment and individual risk for the outcome. For sensitivity analysis with stochastic counterfactuals we introduce a methodology to characterize uncertainty in causal…

Methodology · Statistics 2021-03-11 Brian Knaeble , Braxton Osting , Placede Tshiaba

We propose a simultaneous learning and pruning algorithm capable of identifying and eliminating irrelevant structures in a neural network during the early stages of training. Thus, the computational cost of subsequent training iterations,…

Machine Learning · Computer Science 2023-01-16 Valentin Frank Ingmar Guenter , Athanasios Sideris

Recent years have seen significant efforts to adopt Artificial Intelligence (AI) in healthcare for various use cases, from computer-aided diagnosis to ICU triage. However, the size of AI models has been rapidly growing due to scaling laws…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Mohammed Adnan , Qinle Ba , Nazim Shaikh , Shivam Kalra , Satarupa Mukherjee , Auranuch Lorsakul

Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We…

Machine Learning · Computer Science 2016-03-22 Mohammad Ghasemi Hamed , Mathieu Serrurier , Nicolas Durand

Stochastic optimization techniques are standard in variational inference algorithms. These methods estimate gradients by approximating expectations with independent Monte Carlo samples. In this paper, we explore a technique that uses…

Machine Learning · Computer Science 2019-08-15 Mike Wu , Noah Goodman , Stefano Ermon

Neural networks can be compressed to reduce memory and computational requirements, or to increase accuracy by facilitating the use of a larger base architecture. In this paper we focus on pruning individual neurons, which can simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Bin Dai , Chen Zhu , David Wipf

External controls from historical trials or observational data can augment randomized controlled trials when large-scale randomization is impractical or unethical, such as in drug evaluation for rare diseases. However, non-randomized…

Methodology · Statistics 2025-05-08 Ke Zhu , Shu Yang , Xiaofei Wang

Deep learning has been able to outperform humans in terms of classification accuracy in many tasks. However, to achieve robustness to adversarial perturbations, the best methodologies require to perform adversarial training on a much larger…

Machine Learning · Computer Science 2024-05-13 Javier Maroto , Pascal Frossard

We consider the problem of deciding on sampling strategy, in particular sampling design. We propose a risk measure, whose minimizing value guides the choice. The method makes use of a superpopulation model and takes into account uncertainty…

Methodology · Statistics 2020-07-06 Edgar Bueno , Dan Hedlin