English
Related papers

Related papers: Sparse Bayesian Partially Identified Models for Se…

200 papers

Linear Mixed Models (LMMs) are important tools in statistical genetics. When used for feature selection, they allow to find a sparse set of genetic traits that best predict a continuous phenotype of interest, while simultaneously correcting…

Model selection in machine learning (ML) is a crucial part of the Bayesian learning procedure. Model choice may impose strong biases on the resulting predictions, which can hinder the performance of methods such as Bayesian neural networks…

Machine Learning · Statistics 2022-08-09 Simón Rodríguez Santana , Luis A. Ortega , Daniel Hernández-Lobato , Bryan Zaldívar

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

Data dispersed across multiple files are commonly integrated through probabilistic linkage methods, where even minimal error rates in record matching can significantly contaminate subsequent statistical analyses. In regression problems, we…

Statistics Theory · Mathematics 2024-09-18 Abhisek Chakraborty , Saptati Datta

Parametric Bayesian modeling offers a powerful and flexible toolbox for machine learning. Yet the model, however detailed, may still be wrong, and this can make inferences untrustworthy. In this paper we introduce a new class of…

Methodology · Statistics 2026-04-03 Bohan Wu , Eli N. Weinstein , Sohrab Salehi , Yixin Wang , David M. Blei

We present a new class of methods for high-dimensional nonparametric regression and classification called sparse additive models (SpAM). Our methods combine ideas from sparse linear modeling and additive nonparametric regression. We derive…

Statistics Theory · Mathematics 2008-04-09 Pradeep Ravikumar , John Lafferty , Han Liu , Larry Wasserman

In the analysis of single-cell RNA sequencing data, researchers often characterize the variation between cells by estimating a latent variable, such as cell type or pseudotime, representing some aspect of the individual cell's state. They…

Methodology · Statistics 2022-10-19 Anna Neufeld , Lucy L. Gao , Joshua Popp , Alexis Battle , Daniela Witten

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. A critical question remains unsettled; that is, is it possible…

Methodology · Statistics 2025-01-06 Xiaorui Zhu , Yichen Qin , Peng Wang

Bayesian variable selection methods are powerful techniques for fitting and inferring on sparse high-dimensional linear regression models. However, many are computationally intensive or require restrictive prior distributions on model…

Methodology · Statistics 2023-10-10 Alexander C. McLain , Anja Zgodic , Howard Bondell

We introduce Supersparse Linear Integer Models (SLIM) as a tool to create scoring systems for binary classification. We derive theoretical bounds on the true risk of SLIM scoring systems, and present experimental results to show that SLIM…

Machine Learning · Statistics 2013-06-26 Berk Ustun , Stefano Traca , Cynthia Rudin

A central challenge in statistical inference is the presence of confounding variables that may distort observed associations between treatment and outcome. Conventional "causal" methods, grounded in assumptions such as ignorability, exclude…

Methodology · Statistics 2025-09-09 Ellis Scharfenaker , Duncan K. Foley

Motivation: Recent advances in technology for brain imaging and high-throughput genotyping have motivated studies examining the influence of genetic variation on brain structure. Wang et al. (Bioinformatics, 2012) have developed an approach…

Methodology · Statistics 2016-10-18 Keelin Greenlaw , Elena Szefer , Jinko Graham , Mary Lesperance , Farouk S. Nathoo

Early in an infectious disease outbreak, timely and accurate estimation of the basic reproduction number ($R_0$) and the serial interval (SI) is critical for understanding transmission dynamics and informing public health responses. While…

Methodology · Statistics 2026-01-29 Tatiana Krikella , Jane M. Heffernan , Hanna Jankowski

We develop machinery to design efficiently computable and consistent estimators, achieving estimation error approaching zero as the number of observations grows, when facing an oblivious adversary that may corrupt responses in all but an…

Machine Learning · Computer Science 2021-11-05 Tommaso d'Orsi , Chih-Hung Liu , Rajai Nasser , Gleb Novikov , David Steurer , Stefan Tiegel

The quantitative formulation of evolution equations is the backbone for prediction, control, and understanding of dynamical systems across diverse scientific fields. Besides deriving differential equations for dynamical systems based on…

Data Analysis, Statistics and Probability · Physics 2025-01-06 Tim W. Kroll , Oliver Kamps

Due to the unobservability of confoundings, there has been widespread concern about how to compute causality quantitatively. To address this challenge, proxy-based negative control approaches have been commonly adopted, where auxiliary…

Optimization and Control · Mathematics 2022-11-09 Zhiheng Zhang

Multivariate matched proportions (MMP) data appears in a variety of contexts including post-market surveillance of adverse events in pharmaceuticals, disease classification, and agreement between care providers. It consists of multiple sets…

Methodology · Statistics 2023-05-08 Mark J. Meyer , Haobo Cheng , Katherine Hobbs Knutson

Bayesian hierarchical models can provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models typically comprise a conditionally Gaussian prior model for the unknown which is augmented by a generalized…

Numerical Analysis · Mathematics 2025-01-09 Jonathan Lindbloom , Jan Glaubitz , Anne Gelb

An informative sampling design leads to the selection of units whose inclusion probabilities are correlated with the response variable of interest. Model inference performed on the resulting observed sample will be biased for the population…

Methodology · Statistics 2018-06-29 Matthew R. Williams , Terrance D. Savitsky