English
Related papers

Related papers: Aggregated Sure Independence Screening for Variabl…

200 papers

Variable selection is a challenging issue in statistical applications when the number of predictors $p$ far exceeds the number of observations $n$. In this ultra-high dimensional setting, the sure independence screening (SIS) procedure was…

Methodology · Statistics 2015-06-08 Xiangyu Wang , Chenlei Leng

Screening before model building is a reasonable strategy to reduce the dimension of regression problems. Sure independence screening is an efficient approach to this purpose. It applies the slope estimate of a simple linear regression as a…

Applications · Statistics 2014-01-21 Sheng-Mao Chang

The problem of learning the structure of a high dimensional graphical model from data has received considerable attention in recent years. In many applications such as sensor networks and proteomics it is often expensive to obtain samples…

Machine Learning · Statistics 2016-04-08 Gautam Dasarathy , Aarti Singh , Maria-Florina Balcan , Jong Hyuk Park

In each of the last five years, a few dozen empirical studies appeared in visualization journals and conferences. The existing empirical studies have already featured a large number of variables. There are many more variables yet to be…

Human-Computer Interaction · Computer Science 2020-09-29 Min Chen , Alfie Abdul-Rahman , David H. Laidlaw

Detecting interaction effects among predictors on the response variable is a crucial step in various applications. In this paper, we first propose a simple method for sure screening interactions (SSI). Although its computation complexity is…

Methodology · Statistics 2020-12-16 Min Zhou , Mingwei Dai , Yuan Yao , Jin Liu , Can Yang , Heng Peng

Consider a setting where there are $N$ heterogeneous units and $p$ interventions. Our goal is to learn unit-specific potential outcomes for any combination of these $p$ interventions, i.e., $N \times 2^p$ causal parameters. Choosing a…

Methodology · Statistics 2024-01-17 Abhineet Agarwal , Anish Agarwal , Suhas Vijaykumar

The randomized group-greedy method and its customized method for large-scale sensor selection problems are proposed. The randomized greedy sensor selection algorithm is applied straightforwardly to the group-greedy method, and a customized…

Signal Processing · Electrical Eng. & Systems 2023-03-27 Takayuki Nagata , Keigo Yamada , Kumi Nakai , Yuji Saito , Taku Nonomura

The multiresolution Gaussian process (GP) has gained increasing attention as a viable approach towards improving the quality of approximations in GPs that scale well to large-scale data. Most of the current constructions assume full…

Machine Learning · Statistics 2019-02-26 Jalil Taghia , Thomas B. Schön

This paper treats the problem of screening for variables with high correlations in high dimensional data in which there can be many fewer samples than variables. We focus on threshold-based correlation screening methods for three related…

Machine Learning · Statistics 2015-03-18 Alfred O. Hero , Bala Rajaratnam

Synthesis of program parts is very useful for concurrent systems. However, most synthesis approaches do not support common design tasks, like modifying a single process without having to re-synthesize or verify the whole system.…

Logic in Computer Science · Computer Science 2014-11-18 Roderick Bloem , Krishnendu Chatterjee , Swen Jacobs , Robert Koenighofer

Confounding matters in almost all observational studies that focus on causality. In order to eliminate bias caused by connfounders, oftentimes a substantial number of features need to be collected in the analysis. In this case, large p…

Statistics Theory · Mathematics 2019-12-30 Shinyuu Lee , Yuru Zhu

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

While achieving high prediction accuracy is a fundamental goal in machine learning, an equally important task is finding a small number of features with high explanatory power. One popular selection technique is permutation importance,…

Machine Learning · Statistics 2024-10-02 Min Lu , Hemant Ishwaran

Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample…

Methodology · Statistics 2021-07-08 Shai Gorsky , Li Ma

In big data analysis, a simple task such as linear regression can become very challenging as the variable dimension $p$ grows. As a result, variable screening is inevitable in many scientific studies. In recent years, randomized algorithms…

Methodology · Statistics 2019-02-13 Yu-Hsiang Cheng , Tzee-Ming Huang , Su-Yun Huang

We compute the integral of a function or the expectation of a random variable with minimal cost and use, for our new algorithm and for upper bounds of the complexity, i.i.d. samples. Under certain assumptions it is possible to select a…

Numerical Analysis · Mathematics 2018-10-24 Robert J. Kunsch , Erich Novak , Daniel Rudolf

We present a new algorithm for exactly solving decision making problems represented as influence diagrams. We do not require the usual assumptions of no forgetting and regularity; this allows us to solve problems with simultaneous decisions…

Artificial Intelligence · Computer Science 2015-03-19 Denis Deratani Mauá , Cassio Polpo de Campos , Marco Zaffalon

User dependence remains one of the most difficult general problems in Human Activity Recognition (HAR), in particular when using wearable sensors. This is due to the huge variability of the way different people execute even the simplest…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Sungho Suh , Vitor Fortes Rey , Paul Lukowicz

We study the capacity with which a system of independent neuron-like units represents a given set of stimuli. We assume that each neuron provides a fixed amount of information, and that the information provided by different neurons has a…

Disordered Systems and Neural Networks · Physics 2007-05-23 Ines Samengo

We consider the problem of estimating assortment probabilities, which is common in operations management applications, including product bundling, advertising, etc. Existing approaches typically model each assortment as a category and apply…

Statistics Theory · Mathematics 2026-03-23 Alexandre Belloni , Yan Chen , Matthew Harding