English
Related papers

Related papers: Forecasting with Sparse but Informative Variables:…

200 papers

With the growing prevalence of diabetes and the associated public health burden, it is crucial to identify modifiable factors that could improve patients' glycemic control. In this work, we seek to examine associations between medication…

Applications · Statistics 2025-12-22 Alexander Coulter , Rashmi N. Aurora , Naresh M. Punjabi , Irina Gaynanova

With the widespread use of online social media platforms, information diffusion has become a prevalent phenomenon, making Information Diffusion Prediction (IDP) increasingly important for various applications. Despite significant…

Social and Information Networks · Computer Science 2024-11-01 Songbo Yang

In many problem settings that require spatio-temporal forecasting, the values in the time-series not only exhibit spatio-temporal correlations but are also influenced by spatial diffusion across locations. One such example is forecasting…

Machine Learning · Computer Science 2024-12-19 Malay Pandey , Vaishali Jain , Nimit Godhani , Sachchida Nand Tripathi , Piyush Rai

In designing external validation studies of clinical prediction models, contemporary sample size calculation methods are based on the frequentist inferential paradigm. One of the widely reported metrics of model performance is net benefit…

Applications · Statistics 2025-02-28 Mohsen Sadatsafavi , Andrew J Vickers , Tae Yoon Lee , Paul Gustafson , Laure Wynants

Gaussian Processes (GPs) are Bayesian models that provide uncertainty estimates associated to the predictions made. They are also very flexible due to their non-parametric nature. Nevertheless, GPs suffer from poor scalability as the number…

Machine Learning · Computer Science 2021-07-16 Bahram Jafrasteh , Carlos Villacampa-Calvo , Daniel Hernández-Lobato

Instrumental variables (IV) regression is widely used to estimate causal treatment effects in settings where receipt of treatment is not fully random, but there exists an instrument that generates exogenous variation in treatment exposure.…

Econometrics · Economics 2021-08-10 Stephen Coussens , Jann Spiess

Latent variable models are powerful statistical tools that can uncover relevant variation between patients or cells, by inferring unobserved hidden states from observable high-dimensional data. A major shortcoming of current methods,…

Machine Learning · Statistics 2022-04-12 Arber Qoku , Florian Buettner

Learning individual-level causal effects from observational data, such as inferring the most effective medication for a specific patient, is a problem of growing importance for policy makers. The most important aspect of inferring causal…

Machine Learning · Statistics 2017-11-07 Christos Louizos , Uri Shalit , Joris Mooij , David Sontag , Richard Zemel , Max Welling

The onset of several silent, chronic diseases such as diabetes can be detected only through diagnostic tests. Due to cost considerations, self-reported outcomes are routinely collected in lieu of expensive diagnostic tests in large-scale…

Applications · Statistics 2015-09-15 Xiangdong Gu , Yunsheng Ma , Raji Balasubramanian

Estimating causal effects from observational data is challenging, especially in the presence of latent confounders. Much work has been done on addressing this challenge, but most of the existing research ignores the bias introduced by the…

Machine Learning · Computer Science 2024-08-15 Yang Xie , Ziqi Xu , Debo Cheng , Jiuyong Li , Lin Liu , Yinghao Zhang , Zaiwen Feng

Instrumental variables have been widely used for estimating the causal effect between exposure and outcome. Conventional estimation methods require complete knowledge about all the instruments' validity; a valid instrument must not have a…

Methodology · Statistics 2014-09-23 Hyunseung Kang , Anru Zhang , T. Tony Cai , Dylan S. Small

The defining challenge for causal inference from observational data is the presence of `confounders', covariates that affect both treatment assignment and the outcome. To address this challenge, practitioners collect and adjust for the…

Machine Learning · Computer Science 2021-07-28 Claudia Shi , Victor Veitch , David Blei

In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of…

Systems and Control · Electrical Eng. & Systems 2019-10-02 Siqi Pan , Rodrigo A. González , James S. Welsh , Cristian R. Rojas

We consider unbiased estimation of a sparse nonrandom vector corrupted by additive white Gaussian noise. We show that while there are infinitely many unbiased estimators for this problem, none of them has uniformly minimum variance.…

Statistics Theory · Mathematics 2010-06-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

In this study, we delve into the intricate relationships between diabetes and a range of health indicators, with a particular focus on the newly added variable of income. Utilizing data from the 2015 Behavioral Risk Factor Surveillance…

Machine Learning · Computer Science 2024-04-23 Fariba Jafari Horestani , M. Mehdi Owrang O

When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced…

Data Analysis, Statistics and Probability · Physics 2012-03-26 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

We tackle a common domain adaptation setting in causal systems. In this setting, the target variable is observed in the source domain but is entirely missing in the target domain. We aim to impute the target variable in the target domain…

Machine Learning · Computer Science 2026-01-09 Mohammad Ali Javidian

Approximate inference via information projection has been recently introduced as a general-purpose approach for efficient probabilistic inference given sparse variables. This manuscript goes beyond classical sparsity by proposing efficient…

Machine Learning · Statistics 2016-07-13 Rajiv Khanna , Joydeep Ghosh , Russell Poldrack , Oluwasanmi Koyejo

Epidemics are inherently stochastic, and stochastic models provide an appropriate way to describe and analyse such phenomena. Given temporal incidence data consisting of, for example, the number of new infections or removals in a given time…

Methodology · Statistics 2024-05-24 Sam A. Whitaker , Andrew Golightly , Colin S. Gillespie , Theodore Kypraios

In this paper, we further develop the approach, originating in [14 (arXiv:1311.6765),20 (arXiv:1604.02576)], to "computation-friendly" hypothesis testing and statistical estimation via Convex Programming. Specifically, we focus on…

Statistics Theory · Mathematics 2018-04-16 Anatoli Juditsky , Arkadi Nemirovski