中文
相关论文

相关论文: Sparsity Oriented Importance Learning for High-dim…

200 篇论文

We present a new data analysis perspective to determine variable importance regardless of the underlying learning task. Traditionally, variable selection is considered an important step in supervised learning for both classification and…

机器学习 · 计算机科学 2023-04-11 Ayhan Demiriz

This paper considers errors-in-variables models in a high-dimensional setting where the number of covariates can be much larger than the sample size, and there are only a small number of non-zero covariates. The presence of measurement…

统计方法学 · 统计学 2018-09-03 Linh Nghiem , Cornelis Potgieter

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

统计方法学 · 统计学 2022-03-22 Thomas Lumley , Tong Chen

Ordinary differential equations (ODE) have been widely used for modeling dynamical complex systems. For high-dimensional ODE models where the number of differential equations is large, it remains challenging to estimate the ODE parameters…

统计方法学 · 统计学 2022-06-20 Muye Nanshan , Nan Zhang , Xiaolei Xun , Jiguo Cao

In the sparse linear regression setting, we consider testing the significance of the predictor variable that enters the current lasso model, in the sequence of models visited along the lasso solution path. We propose a simple test statistic…

统计理论 · 数学 2014-05-27 Richard Lockhart , Jonathan Taylor , Ryan J. Tibshirani , Robert Tibshirani

Recent advances in deep learning have pushed the performances of visual saliency models way further than it has ever been. Numerous models in the literature present new ways to design neural networks, to arrange gaze pattern data, or to…

计算机视觉与模式识别 · 计算机科学 2019-07-05 Alexandre Bruckert , Hamed R. Tavakoli , Zhi Liu , Marc Christie , Olivier Le Meur

There are a variety of settings where vague prior information may be available on the importance of predictors in high-dimensional regression settings. Examples include ordering on the variables offered by their empirical variances (which…

统计方法学 · 统计学 2022-05-20 Benjamin G. Stokell , Rajen D. Shah

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

统计方法学 · 统计学 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

In federated learning (FL), accommodating clients' varied computational capacities poses a challenge, often limiting the participation of those with constrained resources in global model training. To address this issue, the concept of model…

分布式、并行与集群计算 · 计算机科学 2024-12-10 Feijie Wu , Xingchen Wang , Yaqing Wang , Tianci Liu , Lu Su , Jing Gao

Structured sparsity has recently emerged in statistics, machine learning and signal processing as a promising paradigm for learning in high-dimensional settings. All existing methods for learning under the assumption of structured sparsity…

机器学习 · 统计学 2015-09-16 Nino Shervashidze , Francis Bach

This chapter makes a review, in a complete methodological framework, of various global sensitivity analysis methods of model output. Numerous statistical and probabilistic tools (regression, smoothing, tests, statistical learning, Monte…

统计理论 · 数学 2014-04-10 Bertrand Iooss , Paul Lemaître

Variable importance (VI) tools describe how much covariates contribute to a prediction model's accuracy. However, important variables for one well-performing model (for example, a linear model $f(\mathbf{x})=\mathbf{x}^{T}\beta$ with a…

统计方法学 · 统计学 2019-12-24 Aaron Fisher , Cynthia Rudin , Francesca Dominici

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

统计理论 · 数学 2007-06-13 Hemant Ishwaran , J. Sunil Rao

Survey weighting allows researchers to account for bias in survey samples, due to unit nonresponse or convenience sampling, using measured demographic covariates. Unfortunately, in practice, it is impossible to know whether the estimated…

统计方法学 · 统计学 2023-03-07 Erin Hartman , Melody Huang

Approaches for appraising feature importance approximations, alternatively referred to as attribution methods, have been established across an extensive array of contexts. The development of resilient techniques for performance benchmarking…

机器学习 · 计算机科学 2026-01-06 Junhwa Song , Keumgang Cha , Junghoon Seo

In this paper, we consider a high-dimensional quantile regression model where the sparsity structure may differ between two sub-populations. We develop $\ell_1$-penalized estimators of both regression coefficients and the threshold…

统计方法学 · 统计学 2018-12-07 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

Saliency methods are used extensively to highlight the importance of input features in model predictions. These methods are mostly used in vision and language tasks, and their applications to time series data is relatively unexplored. In…

机器学习 · 计算机科学 2020-10-28 Aya Abdelsalam Ismail , Mohamed Gunady , Héctor Corrada Bravo , Soheil Feizi

This paper introduces a generalised version of importance subsampling for time series reduction/aggregation in optimisation-based power system planning models. Recent studies indicate that reliably determining optimal electricity…

应用统计 · 统计学 2020-08-26 Adriaan P Hilbers , David J Brayshaw , Axel Gandy

Variable selection in high-dimensional scenarios is of great interested in statistics. One application involves identifying differentially expressed genes in genomic analysis. Existing methods for addressing this problem have some limits or…

统计方法学 · 统计学 2018-06-19 Liuhua Peng , Long Qu , Dan Nettleton

Complex statistical models such as scalar-on-image regression often require strong assumptions to overcome the issue of non-identifiability. While in theory it is well understood that model assumptions can strongly influence the results,…

统计方法学 · 统计学 2020-05-04 Clara Happ , Sonja Greven , Volker J. Schmid